[FEATURE] Add kvcache migration and memory constraint in simulator#51

Open

Toseic wants to merge 4 commits intoLLMServe:mainfrom

Commits on Nov 28, 2024

[FEATURE] Add kvcache migration and memory contraint
Toseic
committed

Commits on Dec 3, 2024

[FEATURE] Add instance ratio search
Toseic
committed
Update README to include ratio search instructions
Toseic
committed

Commits on Dec 17, 2024

[FEATURE] Add memory constrant in pipeline scenarios, add async migrate loop
Toseic
committed