kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

About the project

Mooncake is a serving platform for Kimi, an LLM service from Moonshot AI, built around sharing and transferring the KV cache used during language-model inference. It supports disaggregated serving and data movement between inference, training, and rollout systems. The catalogue add-ons operate or integrate with Mooncake-based serving and transfer workflows.

This repository also configures its own agents. See what Mooncake tells them →

6.8kStars on the repository
9Mods indexed here, across every type
todayLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: