已经指定了base_gpu_id 从8开始,为什么在0号卡上还会看到进程任务 #9681
Unanswered
JeanHero2025
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
使用如下命令启动TP8,发现除了8-15号有进程,0号卡上也有进程在运行,这是什么原因?
python3 -m sglang.launch_server --model-path /data/models/deepseek-r1-w8a8/ --device npu --trust-remote-code --attention-backend npumla --moe-a2a-backend deepep --deepep-mode normal --quantization w8a8_int8 --disaggregation-mode prefill --host 7.150.15.41 --port 40001 --trust-remote-code --tp-size 8 --base-gpu-id 8 --mem-fraction-static 0.95 --disaggregation-transfer-backend mooncake --disable-radix-cache --max-prefill-tokens 16384 --max-running-requests 32 --skip-server-warmup --max-total-tokens 102400
Beta Was this translation helpful? Give feedback.
All reactions