How can I use bench_one_batch.py for DeepSeek-V3 685B model? #5936
Unanswered
Blueblack319
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I would like to modify the model architecture and check the correctness easily by using bench_one_batch.py for DeepSeek-V3 685B model. I could found how to run DeepSeek-V3 via launch_server.py and bench_serving from sglang/benchmark/deepseek_v3 instruction. How can I use python/sglang/bench_one_batch.py for DeepSeek-V3 685B model?
Beta Was this translation helpful? Give feedback.
All reactions