LiteLLM

Open-source AI gateway, LLM proxy, and Python SDK that provides a single OpenAI-compatible interface for calling 100+ LLM providers, with routing and fallbacks, cost tracking, guardrails, logging/observability, virtual keys, budgets, and an admin UI for self-hosted deployments.