Pyxis/Enroot on Beta

Created by Anthony Siracuse, Modified on Tue, 16 Jun at 2:55 PM by Anthony Siracuse

The Blackwell compute nodes feature a minimal software installation. All workloads should run within containers (NVIDIA NGC containers are recommended) utilizing the Pyxis/Enroot runtime framework.

Please refer to the official documentation for more information:
- Pyxis Usage Guide

- Enroot Usage Guide

This is our current Enroot configuration on the NVL72 system - if you find any missing features, please reach out to sysadmin@empireai.edu or submit a Freshdesk ticket for the sysadmin team to evaluate.

ENROOT_RUNTIME_PATH /run/enroot/runtime/${SLURM_JOB_ID:-}
ENROOT_DATA_PATH /var/lib/enroot/data/$(id -u)
ENROOT_SQUASH_OPTIONS      -noI -noD -noF -noX -no-duplicates
ENROOT_MOUNT_HOME          no
ENROOT_CONFIG_PATH         ${HOME}/.config/enroot
ENROOT_RESTRICT_DEV        yes
ENROOT_ROOTFS_WRITABLE     no
ENROOT_ZSTD_OPTIONS        -1
ENROOT_TRANSFER_RETRIES    5
ENROOT_CONNECT_TIMEOUT     60
ENROOT_TRANSFER_TIMEOUT    1200
ENROOT_MAX_CONNECTIONS     10