Speed up installation

[jitbasemartin]

Describe the solution you'd like:
Currently, I am using a custom ISO of registry.suse.com/suse/sl-micro/6.1/base-os-container and between the moment that I start the ISO and the (k3s) cluster is running it took me ~25min

I don't know how to improve it ? In an ideal world, I would like to have a (k3s) cluster running in 5m
Can you show me how to reduce this time ? Maybe with k3s preinstalled ?
I would like to understand what is taking this time

Thank you !

PS: I love what you made with Elemental, I am an ex user of k3sOS and I can tell that you did a great job

[frelon]

Hi @jitbasemartin!

Great to hear from a user of k3sos! 25 minutes does seem like a long time, what kind of hardware or VM are you running this on?

[jitbasemartin]

Hi @frelon

Yeah 25min is not that bad, it’s more when we are doing some development and testing with Elemental where that start to be long to wait multiple times a day 25min

Most of the time we are using Virtual box, 4 CPU and 4GB of RAM

[frelon]

Could you share some logs so we can see what is taking time (journalctl) and any insights into if it's the elemental installation process or the cluster deployment taking time? Also, the custom Dockerfile would be interesting if it's available!

[jitbasemartin]

So I managed to reduce to 10min now, I had some network issues that was slowing down the process

Here my custom Dockerfile:

# https://registry.suse.com/repositories/suse-sl-micro-6-2-base-os-container
ARG FROM_IMAGE=registry.suse.com/suse/sl-micro/6.2/base-os-container:2.3.0
FROM ${FROM_IMAGE} AS reference


# Repositories: https://en.opensuse.org/Package_repositories
RUN zypper addrepo https://download.opensuse.org/tumbleweed/repo/oss/ opensuse-tumbleweed-oss && \
    # zypper addrepo http://download.opensuse.org/tumbleweed/repo/src-oss/ opensuse-tumbleweed-src-oss && \
    # zypper addrepo https://download.opensuse.org/repositories/security:/netfilter/openSUSE_Tumbleweed/ opensuse-security-netfilter && \
    zypper --gpg-auto-import-keys ref && \
    # From https://github.com/rancher/elemental/blob/main/.obs/dockerfile/SL-Micro-baremetal-container/Dockerfile
    zypper install -y \
    etcdctl \
    procps \
    openssh \
    openssh-server \
    # vim-small \ # nano prefered
    nano \
    less \
    # kernel-firmware-all \ # For baremetal PC
    # NetworkManager-wwan \ # Useful for Wifi
    # cryptsetup \ # Encrypt disk
    # avahi \ # broadcast hostname
    bash-completion \
    # catatonit \
    # conmon \
    conntrack-tools \
    # container-selinux \
    ethtool \
    fuse-overlayfs \
    # hdparm \
    hyper-v \
    # hostname \
    htop \
    # NOTE: iptables needs to be compiled on the destination OS to avoid unknown --dst-type error
    #iptables \
    #iptables-backend-nft \
    # issue-generator \
    # jq \
    # keyutils \
    # lshw \
    # lsof \
    # lsscsi \
    # mdadm \
    # multipath-tools \
    # netcat-openbsd \
    net-tools \
    # nfs-client \
    nftables \
    # nss-mdns \
    # open-iscsi \
    # open-vm-tools \
    # pciutils \
    # pciutils-ids \
    # podman \
    # policycoreutils \
    # procmail \
    # psmisc \
    # rpcbind \
    runc \
    # selinux-policy \
    # selinux-policy-targeted \
    # selinux-tools \
    # slirp4netns \
    # strace \
    sudo \
    # sysstat \
    # system-user-nobody \
    tcpdump \
    timezone \
    # traceroute \
    xtables-plugins

FROM reference AS os-deps

ENV IPTABLES_GIT_TAG=v1.8.11
RUN zypper install -y make git gcc make libtool autoconf libmnl-devel libnftnl-devel pkgconfig zlib-devel && \
    git clone --branch $IPTABLES_GIT_TAG https://git.netfilter.org/iptables  && \
    cd iptables  && \
    ./autogen.sh  && \
    ./configure  && \
    make -j$(nproc)  && \
    make install DESTDIR=/tmp/iptables-package

FROM reference AS os-container

# IMPORTANT: /etc/os-release is used for versioning/upgrade. The
# values here should reflect the tag of the image currently being built
ARG IMAGE_REPO=gateway-image-generator
ARG IMAGE_TAG=$APP_FULLVERSION
RUN \
    # Set image versioning
    sed -i -e "s|^IMAGE_REPO=.*|IMAGE_REPO=\"${IMAGE_REPO}\"|g" /etc/os-release && \
    sed -i -e "s|^IMAGE_TAG=.*|IMAGE_TAG=\"${IMAGE_TAG}\"|g" /etc/os-release && \
    sed -i -e "s|^IMAGE=.*|IMAGE=\"${IMAGE_REPO}:${IMAGE_TAG}\"|g" /etc/os-release && \
    sed -i -e "s|^PRETTY_NAME=.*|PRETTY_NAME=\"JITbase Gateway v${APP_VERSION}\"|g" /etc/os-release && \
    sed -i -e "s|^GRUB_ENTRY_NAME=.*|GRUB_ENTRY_NAME=\"JITbase Gateway\"|g" /etc/os-release && \
    # Init essentials cloud configs in /system/oem
    elemental init --force cloud-config-essentials

# Get Gateway management
COPY --from=gatewaymanagement /app/gateway-management /usr/bin
# Get VPN node
COPY --from=vpnnode /app/vpn-node /usr/bin
# Get wstunnel
COPY --from=wstunnel /home/app/wstunnel /usr/bin
# Get iptables
COPY --from=os-deps /tmp/iptables-package /
# Override rootfs files
COPY overlay /

# Make it executable
RUN zypper clean --all && \
    rm -rf /var/log/update* && \
    >/var/log/lastlog && \
    rm -rf /boot/vmlinux* && \
    # IMPORTANT: it is good practice to recreate the initrd and re-apply `elemental-init`
    # command that was used in the base image. This ensures that any eventual change that should
    # be synced in initrd included binaries is also applied there and consistent.
    elemental init --force elemental-rootfs,grub-config,dracut-config,elemental-setup,boot-assessment

FROM os-container AS os-dev

RUN zypper install -y make git

# Copy all modified files from original
COPY --from=reference /system/oem /original/system/oem
COPY --from=reference /etc /original/etc
# Copy tests files
COPY overlay /overlay
COPY --chown=1000:1000 test /test

# The released OS already includes the toolchain for building ISOs
FROM reference AS builder

ARG TARGETARCH
WORKDIR /iso
COPY --from=os-container / rootfs

ENV OUTPUT_NAME=jitbase-gateway.iso
ENV OUTPUT_DIR=/output
ENV BASE_NAME=jitbase-gateway-${TARGETARCH}
ENV BASE_ISO=${OUTPUT_DIR}/${BASE_NAME}.iso

COPY config/manifest.yaml /config/manifest.yaml

# work around buildah issue: https://github.com/containers/buildah/issues/4242
RUN rm -f rootfs/etc/resolv.conf && \
    # Build iso
    elemental --config-dir /config build-iso \
    dir:rootfs \
    -o ${OUTPUT_DIR} -n "${BASE_NAME}"

FROM busybox AS os-iso
COPY --from=builder /output /elemental-iso

ENTRYPOINT ["busybox", "sh", "-c"]

FROM builder AS os-debug
# Use local config files to flash the ISO
COPY /config/livecd-cloud-config.yaml /rootfs/overlay/reg/
COPY /config/cloud-config.yaml /rootfs/overlay/iso-config/cloud-config.yaml
RUN xorriso -indev ${BASE_ISO} -outdev ${OUTPUT_DIR}/${OUTPUT_NAME} -map /rootfs/overlay/reg/livecd-cloud-config.yaml /livecd-cloud-config.yaml -map /rootfs/overlay/iso-config/cloud-config.yaml /iso-config/cloud-config.yaml -boot_image any replay && rm -rf ${BASE_ISO} && cd ${OUTPUT_DIR} && sha256sum ${OUTPUT_NAME} > ${OUTPUT_NAME}.sha256

Do you know if I can create a custom Dockerfile with rancher and k3s stuff pre-installed?