Mooncake
KVCache.ai's LLM KV-cache infrastructure
Mooncake is KVCache.ai's software product for LLM KV-cache storage and serving, intended for disaggregated inference infrastructure.
Recent stories
0 linked stories
No linked stories yet.
KVCache.ai's LLM KV-cache infrastructure
Mooncake is KVCache.ai's software product for LLM KV-cache storage and serving, intended for disaggregated inference infrastructure.