GuideLLM

SLO-aware benchmarking and evaluation platform for optimizing real-world LLM inference. GuideLLM simulates real-world traffic, supports OpenAI-compatible and vLLM-based backends, accepts real or synthetic multimodal datasets, and produces detailed benchmark reports.