[Questions] How can I see the request content sent by the user in the terminal logs, just like in VLLM? #5658
Replies: 1 comment 3 replies
-
|
|
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment


Uh oh!
There was an error while loading. Please reload this page.
-
Checklist
Describe the bug
Users might input excessively long tokens that cause OOM (Out of Memory) issues.
We need to locate these problems through the logs, but the terminal logs do not show detailed request information. How can we solve this issue?
Reproduction
Environment
0.4.4
Beta Was this translation helpful? Give feedback.
All reactions