Prerequisites

  • Architecture: x86_64
  • Chip models: Generic GPU
  • Host driver: 610.43.02
  • Container toolkit (optional) : nvidia-container-toolkit

Image contents

Built on

harbor.baai.ac.cn/flagos-runtime/flagos-runtime-nvidia-cuda12.8:2.2.0 open_in_new

Python

3.12

Application package

megatron-core[training]==0.18.2

Launch

Published: harbor.baai.ac.cn/flagos-app/megatron_training0.18.2-generic-12.8:2.2.0-0.3.0

The image name is long — assign it to a variable first:

  IMG=harbor.baai.ac.cn/flagos-app/megatron_training0.18.2-generic-12.8:2.2.0-0.3.0

The two approaches below are alternatives — pick the one that matches how your host runs containers:

With the container toolkit

Start an interactive shell:

  docker run --rm -it \
  --gpus all \
  $IMG bash

Start the app with its default settings:

  docker run --rm -it \
  --gpus all \
  $IMG

Pass arguments to the launcher:

  docker run --rm -it \
  --gpus all \
  $IMG megatron-train --model-type GPT

Without a toolkit — plain docker / podman

Start an interactive shell:

  docker run --rm -it \
  --device /dev/nvidia0 \
  --device /dev/nvidiactl \
  --device /dev/nvidia-uvm \
  -v /usr/bin/nvidia-smi:/usr/bin/nvidia-smi:ro \
  -v /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:ro \
  -v /usr/lib/x86_64-linux-gnu/libcuda.so.1:/usr/lib/x86_64-linux-gnu/libcuda.so.1:ro \
  $IMG bash

Start the app with its default settings:

  docker run --rm -it \
  --device /dev/nvidia0 \
  --device /dev/nvidiactl \
  --device /dev/nvidia-uvm \
  -v /usr/bin/nvidia-smi:/usr/bin/nvidia-smi:ro \
  -v /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:ro \
  -v /usr/lib/x86_64-linux-gnu/libcuda.so.1:/usr/lib/x86_64-linux-gnu/libcuda.so.1:ro \
  $IMG

Pass arguments to the launcher:

  docker run --rm -it \
  --device /dev/nvidia0 \
  --device /dev/nvidiactl \
  --device /dev/nvidia-uvm \
  -v /usr/bin/nvidia-smi:/usr/bin/nvidia-smi:ro \
  -v /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1:ro \
  -v /usr/lib/x86_64-linux-gnu/libcuda.so.1:/usr/lib/x86_64-linux-gnu/libcuda.so.1:ro \
  $IMG megatron-train --model-type GPT
Edit this page

Last updated 26 Sep 2026, 12:57 +0800. history