SGLang
A fast serving framework for large language models and vision language models.
Open-source serving framework and runtime for efficiently serving large language models and vision-language models, including production inference workloads.
Recent stories
0 linked stories
No linked stories yet.