Alpine Linux Root on ZFS

ZFSBootMenu

ZFSBootMenu is an alternative bootloader free of such limitations and has support for boot environments. Do not follow instructions on this page if you plan to use ZBM, as the layouts are not compatible. Refer to their site for installation details.

Customization

Unless stated otherwise, it is not recommended to customize system configuration before reboot.

Only use well-tested pool features

You should only use well-tested pool features. Avoid using new features if data integrity is paramount. See, for example, this comment.

UEFI support only

Only UEFI is supported by this guide.

Preparation

  1. Disable Secure Boot. ZFS modules can not be loaded if Secure Boot is enabled.

  2. Download latest extended variant of Alpine Linux live image, verify checksum and boot from it.

    gpg --auto-key-retrieve --keyserver hkps://keyserver.ubuntu.com --verify alpine-extended-*.asc
    
    dd if=input-file of=output-file bs=1M
    
  3. Login as root user. There is no password.

  4. Configure Internet

    setup-interfaces -r
    # You must use "-r" option to start networking services properly
    # example:
    network interface: wlan0
    WiFi name:         <ssid>
    ip address:        dhcp
    <enter done to finish network config>
    manual netconfig:  n
    
  5. If you are using wireless network and it is not shown, see Alpine Linux wiki for further details. wpa_supplicant can be installed with apk add wpa_supplicant without internet connection.

  6. Configure SSH server

    setup-sshd
    # example:
    ssh server:        openssh
    allow root:        "prohibit-password" or "yes"
    ssh key:           "none" or "<public key>"
    

    Configurations set here will be copied verbatim to the installed system.

  7. Set root password or /root/.ssh/authorized_keys.

    Choose a strong root password, as it will be copied to the installed system. However, authorized_keys is not copied.

  8. Connect from another computer

    ssh root@192.168.1.91
    
  9. Configure NTP client for time synchronization

    setup-ntp busybox
    
  10. Set up apk-repo. A list of available mirrors is shown. Press space bar to continue

    setup-apkrepos
    
  11. Throughout this guide, we use predictable disk names generated by udev

    apk update
    apk add eudev
    setup-devd udev
    

    It can be removed after reboot with setup-devd mdev && apk del eudev.

  12. Target disk

    List available disks with

    find /dev/disk/by-id/
    

    If virtio is used as disk bus, power off the VM and set serial numbers for disk. For QEMU, use -drive format=raw,file=disk2.img,serial=AaBb. For libvirt, edit domain XML. See this page for examples.

    Declare disk array

    DISK='/dev/disk/by-id/ata-FOO /dev/disk/by-id/nvme-BAR'
    

    For single disk installation, use

    DISK='/dev/disk/by-id/disk1'
    
  13. Set a mount point

    MNT=$(mktemp -d)
    
  14. Set partition size:

    Set swap size in GB, set to 1 if you don’t want swap to take up too much space

    SWAPSIZE=4
    

    Set how much space should be left at the end of the disk, minimum 1GB

    RESERVE=1
    
  15. Install ZFS support from live media:

    apk add zfs
    
  16. Install bootloader programs and partition tool

    apk add parted e2fsprogs cryptsetup util-linux
    

System Installation

  1. Partition the disks.

    Note: you must clear all existing partition tables and data structures from target disks.

    For flash-based storage, this can be done by the blkdiscard command below:

    partition_disk () {
     local disk="${1}"
     blkdiscard -f "${disk}" || true
    
     parted --script --align=optimal  "${disk}" -- \
     mklabel gpt \
     mkpart EFI 1MiB 4GiB \
     mkpart rpool 4GiB -$((SWAPSIZE + RESERVE))GiB \
     mkpart swap  -$((SWAPSIZE + RESERVE))GiB -"${RESERVE}"GiB \
     set 1 esp on \
    
     partprobe "${disk}"
    }
    
    for i in ${DISK}; do
       partition_disk "${i}"
    done
    
  2. Setup temporary encrypted swap for this installation only. This is useful if the available memory is small:

    for i in ${DISK}; do
       cryptsetup open --type plain --key-file /dev/random "${i}"-part3 "${i##*/}"-part3
       mkswap /dev/mapper/"${i##*/}"-part3
       swapon /dev/mapper/"${i##*/}"-part3
    done
    
  3. Load ZFS kernel module

    modprobe zfs
    
  4. Create root pool

    • Unencrypted:

      # shellcheck disable=SC2046
      zpool create \
          -o ashift=12 \
          -o autotrim=on \
          -R "${MNT}" \
          -O acltype=posixacl \
          -O canmount=off \
          -O dnodesize=auto \
          -O normalization=formD \
          -O relatime=on \
          -O xattr=sa \
          -O mountpoint=none \
          rpool \
          mirror \
         $(for i in ${DISK}; do
            printf '%s ' "${i}-part2";
           done)
      
  5. Create root system container:

    zfs create -o canmount=noauto -o mountpoint=legacy rpool/root
    

    Create system datasets, manage mountpoints with mountpoint=legacy

    zfs create -o mountpoint=legacy rpool/home
    mount -o X-mount.mkdir -t zfs rpool/root "${MNT}"
    mount -o X-mount.mkdir -t zfs rpool/home "${MNT}"/home
    
  6. Format and mount ESP. Only one of them is used as /boot, you need to set up mirroring afterwards

    for i in ${DISK}; do
     mkfs.vfat -n EFI "${i}"-part1
    done
    
    for i in ${DISK}; do
     mount -t vfat -o fmask=0077,dmask=0077,iocharset=iso8859-1,X-mount.mkdir "${i}"-part1 "${MNT}"/boot
     break
    done
    

System Configuration

  1. Install system to disk

    BOOTLOADER=none setup-disk -k lts -v "${MNT}"
    

    The error message about ZFS kernel module can be ignored.

  2. Install rEFInd boot loader:

    # from http://www.rodsbooks.com/refind/getting.html
    # use Binary Zip File option
    apk add curl
    curl -L http://sourceforge.net/projects/refind/files/0.14.0.2/refind-bin-0.14.0.2.zip/download --output refind.zip
    unzip refind
    
    mkdir -p "${MNT}"/boot/EFI/BOOT
    find ./refind-bin-0.14.0.2/ -name 'refind_x64.efi' -print0 \
    | xargs -0I{} mv {} "${MNT}"/boot/EFI/BOOT/BOOTX64.EFI
    rm -rf refind.zip refind-bin-0.14.0.2
    
  3. Add boot entry:

    tee -a "${MNT}"/boot/refind-linux.conf <<EOF
    "Alpine Linux" "root=ZFS=rpool/root"
    EOF
    
  4. Unmount filesystems and create initial system snapshot:

    umount -Rl "${MNT}"
    zfs snapshot -r rpool@initial-installation
    zpool export -a
    
  5. Reboot

    reboot
    
  6. Mount other EFI system partitions then set up a service for syncing their contents.