Prerequisites

  • Architecture: x86_64
  • Chip models: Enflame Zixiao C200 (S60)
  • Host driver: 1.9.10
  • Container toolkit (optional) : tencent-container-toolkit >= 2.0.52

Image contents

Built on

harbor.baai.ac.cn/flagos-runtime/flagos-runtime-enflame-tops1.9.10:2.2.0 open_in_new

Python

3.12

Application package

sglang==0.5.18+flagos

sglang-fl==0.1.dev1+g32eabf40e

Environment

  • TORCHINDUCTOR_COMPILE_THREADS=1
  • SGLANG_IS_FLASHINFER_AVAILABLE=false
  • SGLANG_SKIP_SGL_KERNEL_VERSION_CHECK=1
  • SGLANG_WARMUP_TIMEOUT=3600

Launch

Published: harbor.baai.ac.cn/flagos-app/sglang0.5.18-enflame-tops1.9.10:2.2.0-0.1.dev1_g32eabf40e

The image name is long — assign it to a variable first:

  IMG=harbor.baai.ac.cn/flagos-app/sglang0.5.18-enflame-tops1.9.10:2.2.0-0.1.dev1_g32eabf40e

The two approaches below are alternatives — pick the one that matches how your host runs containers:

With the container toolkit

Start an interactive shell:

  docker run --rm -it \
  --network host \
  -e ENFLAME_VISIBLE_DEVICES=all \
  -e TENCENT_VISIBLE_DEVICES=all \
  $IMG bash

Start the app with its default settings:

  docker run --rm -it \
  --network host \
  -e ENFLAME_VISIBLE_DEVICES=all \
  -e TENCENT_VISIBLE_DEVICES=all \
  $IMG

Pass arguments to the launcher:

  docker run --rm -it \
  --network host \
  -e ENFLAME_VISIBLE_DEVICES=all \
  -e TENCENT_VISIBLE_DEVICES=all \
  $IMG sglang-serve --model-path <path> --port 9000

Without a toolkit — plain docker / podman

Start an interactive shell:

  docker run --rm -it \
  --privileged \
  -v /dev:/dev \
  $IMG bash

Start the app with its default settings:

  docker run --rm -it \
  --privileged \
  -v /dev:/dev \
  $IMG

Pass arguments to the launcher:

  docker run --rm -it \
  --privileged \
  -v /dev:/dev \
  $IMG sglang-serve --model-path <path> --port 9000
Edit this page

Last updated 29 Sep 2026, 09:53 +0800. history