SGLang
High-performance serving framework for large language and multimodal models.
SGLang is an open-source, high-performance serving framework and inference engine for large language and multimodal models, designed for low-latency, high-throughput deployment from single-GPU setups to distributed clusters.
Recent stories
0 linked stories
No linked stories yet.