Mooncake
A KVCache-centric Disaggregated Architecture for LLM Serving
Open-source KVCache-centric disaggregated architecture and serving platform for LLM serving; the project includes Mooncake Transfer Engine and Mooncake Store.
Recent stories
0 linked stories
No linked stories yet.