Mooncake GitHub repository (kvcache-ai/Mooncake)

Fields

id

sources/pd-mooncake-repo

URL

https://github.com/kvcache-ai/Mooncake

Publisher

kvcache-ai (Moonshot AI)

Kind

repo

Published

2024-06-25

Accessed

2026-10-03

notes

Apache-2.0, 6.7k stars, repo created 2024-06-25, actively pushed. README: 'Mooncake includes a high-performance Transfer Engine for low-latency data movement across heterogeneous networks and accelerators; Mooncake Store for distributed KV cache and model-weight management'. Transfer Engine described as offering 'a unified interface for batched data movement across diverse storage, network, and accelerator environments' with 'multiple transport protocols, topology-aware routing, multi-NIC bandwidth aggregation, and automatic failover'. Timeline in the README dates first vLLM support to 2024-12-16 and SGLang support to 2025-04-10, which is the adoption evidence. Also carries a 'Known Issues and PRs' tracking issue (#2647).

Notes

Apache-2.0, 6.7k stars, repo created 2024-06-25, actively pushed. README: 'Mooncake includes a high-performance Transfer Engine for low-latency data movement across heterogeneous networks and accelerators; Mooncake Store for distributed KV cache and model-weight management'. Transfer Engine described as offering 'a unified interface for batched data movement across diverse storage, network, and accelerator environments' with 'multiple transport protocols, topology-aware routing, multi-NIC bandwidth aggregation, and automatic failover'. Timeline in the README dates first vLLM support to 2024-12-16 and SGLang support to 2025-04-10, which is the adoption evidence. Also carries a 'Known Issues and PRs' tracking issue (#2647).

Cross-references

This record references no other records.