Framework
LiteLLM
LiteLLM is an open-source AI framework, launched in 2023, made for developers and businesses.
A proxy server and Python SDK that call over 100 LLM APIs in one OpenAI-compatible format.
Main jobs: LLM API, One API for many models. It is open source and free to use. You can use it on your own server, through an API and in the terminal.
Markdown version of https://godooo.ai/en/framework/litellm. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2023
- Galaxy
- Models & APIs
- Open source
- Yes
- Source code
- github.com/BerriAI/litellm
- GitHub stars
- 59,540
- How you run it
- Self-host · API · Terminal
- Made for
- Developers · Businesses
- Website
- docs.litellm.ai
- Also known as
- LiteLLM Proxy · LiteLLM AI Gateway
What it can do
LLM APImain jobunconfirmed
“Call any LLM in OpenAI format.”— github.com, 2026-09-24
One API for many modelsmain jobunconfirmed
“LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers”— github.com, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- OpenRouterFree plan + paid upgradesAlso does: LLM API, One API for many models
- AI SDKOpen source, freeAlso does: LLM API, One API for many models
- One APIOpen source, freeAlso does: LLM API, One API for many models
- LLMOpen source, freeAlso does: LLM API, One API for many models; runs offline
- Together AIPaidAlso does: LLM API, One API for many models
- ClaudeAlso does: LLM API; no code needed
- GeminiAlso does: LLM API; no code needed
- GPTAlso does: LLM API; no code needed
- GPT-3Also does: LLM API
- GPT-4Also does: LLM API; no code needed
- Hugging FaceFree plan + paid upgradesAlso does: LLM API, One API for many models; runs offline
- LlamaOpen source, freeAlso does: LLM API; runs offline
Questions
What is LiteLLM?
LiteLLM is an open-source AI framework, launched in 2023, made for developers and businesses. A proxy server and Python SDK that call over 100 LLM APIs in one OpenAI-compatible format.
Is LiteLLM free?
Yes. LiteLLM is open source and free to use.
Is LiteLLM open source?
Yes. The source code is at https://github.com/BerriAI/litellm.
Can LiteLLM run locally?
LiteLLM can be self-hosted on your own server.
What can LiteLLM do?
Main jobs: LLM API, One API for many models.
What are open-source alternatives to LiteLLM?
Open-source ones: AI SDK, One API, LLM and Llama. Others: OpenRouter, Together AI, Claude, Gemini, GPT and GPT-3.
Sources
- github.com/BerriAI/litellmchecked 2026-09-24
- docs.litellm.ai/docs