vLLM Factory
Production inference for encoders, poolers, and structured prediction — as vLLM plugins.
Open-source Python package and deployment stack for production inference of encoder, pooler, retrieval, NER, structured-prediction, and multimodal-retrieval models as vLLM plugins.
Recent stories
0 linked stories
No linked stories yet.