LiteLLM

Open-source LLM gateway/proxy and SDK from BerriAI that provides an OpenAI-compatible interface for routing requests across many model providers, with fallbacks, retries, and observability.