Pinned Loading

1. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 4.2k 420

2. madsys-dev/sosp-paper19-ae madsys-dev/sosp-paper19-ae Public

   The Artifact Evaluation Version of SOSP Paper #19

   C++ 51 12

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 19.7k 3.3k

4. izumihanako/LightDSA izumihanako/LightDSA Public

   This is the code repository of paper "LightDSA: Enabling Efficient DSA Through Hardware-Aware Transparent Optimization"

   C++ 4

5. MoonshotAI/checkpoint-engine MoonshotAI/checkpoint-engine Public

   Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

   Python 801 61

6. sgl-project/rbg sgl-project/rbg Public

   A workload for deploying LLM inference services on Kubernetes

   Go 95 24