vLLM-Omni
Easy, fast, and cheap omni-modality model serving for everyone
Open-source framework extending vLLM for efficient omni-modality model inference and serving across text, image, audio, video, action, diffusion, TTS, world-model, and multimodal workloads.
Recent stories
0 linked stories
No linked stories yet.