CloudMatrix-Infer

A comprehensive large-language-model serving solution proposed for Huawei CloudMatrix384, designed to deploy large-scale MoE models such as DeepSeek-R1.