# LiteLLM

Framework · https://godooo.ai/en/framework/litellm

> LiteLLM is an open-source AI framework, launched in 2023, made for developers and businesses.

A proxy server and Python SDK that call over 100 LLM APIs in one OpenAI-compatible format.

Main jobs: LLM API, One API for many models. It is open source and free to use. You can use it on your own server, through an API and in the terminal.

## At a glance

- **Type:** [Framework](https://godooo.ai/en/browse#framework)
- **Launched:** 2023
- **Galaxy:** [Models & APIs](https://godooo.ai/en/galaxy/builders)
- **Open source:** Yes
- **Source code:** [github.com/BerriAI/litellm](https://github.com/BerriAI/litellm)
- **GitHub stars:** 59,540
- **How you run it:** Self-host · API · Terminal
- **Made for:** Developers · Businesses
- **Protocols:** [Model Context Protocol](https://godooo.ai/en/protocol/mcp), [OpenAI-compatible API](https://godooo.ai/en/protocol/openai-compatible-api)
- **Website:** [docs.litellm.ai](https://docs.litellm.ai/docs)
- **Also known as:** LiteLLM Proxy · LiteLLM AI Gateway

## What it can do

- **[LLM API](https://godooo.ai/en/capability/llm-api)** — main job, _proposed by a machine, awaiting calibration_. “Call any LLM in OpenAI format.” (read on [github.com](https://github.com/BerriAI/litellm), 2026-09-24)
- **[One API for many models](https://godooo.ai/en/capability/model-gateway)** — main job, _proposed by a machine, awaiting calibration_. “LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers” (read on [github.com](https://github.com/BerriAI/litellm), 2026-09-24)

## Alternatives

- **[OpenRouter](https://godooo.ai/en/product/openrouter)** (Free plan + paid upgrades): Also does: LLM API, One API for many models
- **[AI SDK](https://godooo.ai/en/framework/ai-sdk)** (Open source, free): Also does: LLM API, One API for many models
- **[One API](https://godooo.ai/en/product/one-api)** (Open source, free): Also does: LLM API, One API for many models
- **[LLM](https://godooo.ai/en/cli/llm)** (Open source, free): Also does: LLM API, One API for many models; runs offline
- **[Together AI](https://godooo.ai/en/product/together)** (Paid): Also does: LLM API, One API for many models
- **[Claude](https://godooo.ai/en/model/claude)**: Also does: LLM API; no code needed
- **[Gemini](https://godooo.ai/en/model/gemini)**: Also does: LLM API; no code needed
- **[GPT](https://godooo.ai/en/model/gpt)**: Also does: LLM API; no code needed
- **[GPT-3](https://godooo.ai/en/model/gpt-3)**: Also does: LLM API
- **[GPT-4](https://godooo.ai/en/model/gpt-4)**: Also does: LLM API; no code needed
- **[Hugging Face](https://godooo.ai/en/product/huggingface)** (Free plan + paid upgrades): Also does: LLM API, One API for many models; runs offline
- **[Llama](https://godooo.ai/en/model/llama)** (Open source, free): Also does: LLM API; runs offline

## Questions

### What is LiteLLM?

LiteLLM is an open-source AI framework, launched in 2023, made for developers and businesses. A proxy server and Python SDK that call over 100 LLM APIs in one OpenAI-compatible format.

### Is LiteLLM free?

Yes. LiteLLM is open source and free to use.

### Is LiteLLM open source?

Yes. The source code is at https://github.com/BerriAI/litellm.

### Can LiteLLM run locally?

LiteLLM can be self-hosted on your own server.

### What can LiteLLM do?

Main jobs: LLM API, One API for many models.

### What are open-source alternatives to LiteLLM?

Open-source ones: AI SDK, One API, LLM and Llama. Others: OpenRouter, Together AI, Claude, Gemini, GPT and GPT-3.

## Sources

- [github.com](https://github.com/BerriAI/litellm) — checked 2026-09-24
- [docs.litellm.ai](https://docs.litellm.ai/docs)

---

Last updated 2026-09-24 · sources checked 2026-09-24 · Markdown version of https://godooo.ai/en/framework/litellm. Every page on this site has one: add .md to its address.