What are some ways we can run PD on a 4090? #7836
Unanswered
ZhenshengWu
asked this question in
Q&A
Replies: 1 comment
-
|
can set PROTOCOL to tcp? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
As we know, the 4090 doesn’t have NVLink or RDMA, but we still want to use Mooncake with the TCP protocol to transfer the KV cache. Is there any way to achieve this?
kvcache-ai/Mooncake#602
Beta Was this translation helpful? Give feedback.
All reactions