Open-source AI gateway giving dev teams unified access, fallbacks and spend tracking across 100+ LLMs.
What it does
LiteLLM is an open-source AI gateway for platform teams. It provides unified access to 100+ LLM providers in the OpenAI API format, with spend tracking, budgets, rate limits and automatic fallbacks. An enterprise edition adds SSO, audit logs and support.
How to use: Use LiteLLM by calling LLM APIs using the chatGPT format - completion(model, messages). It provides consistent outputs and exceptions for all LLM APIs. You can deploy LiteLLM open source or try LiteLLM Enterprise for more features.
Core features
Unified access to 100+ LLMs in OpenAI format
Cost/spend tracking per key, user and team
Budgets and rate limiting
Automatic provider fallbacks and retries
Virtual keys and team management
Logging and observability integrations
Best for
→Giving developers governed access to many LLMs
→Attributing and controlling LLM spend
→Keeping apps running during provider outages
Pricing
Open Source
$0
Toolspool rankingby monthly traffic
Reviews
Big-picture takes: what it's for and whether it delivers. High-engagement YouTube videos — not sponsored.