# LLM API

Capability · https://godooo.ai/en/capability/llm-api

> LLM API: 51 AI tools in this graph can do it, including GPT, GPT-3, GPT-4, Claude and Gemini.

Call language models from your own code over an API.

- **Takes in:** Text
- **Gives out:** Text

## Tools that do it

| Tool | Type | How well | Pricing | Open source | How you run it |
| --- | --- | --- | --- | --- | --- |
| [GPT](https://godooo.ai/en/model/gpt) | Model | main job* |  |  | API, Web |
| [GPT-3](https://godooo.ai/en/model/gpt-3) | Model | main job* |  |  | API |
| [GPT-4](https://godooo.ai/en/model/gpt-4) | Model | main job* |  |  | API, Web |
| [Claude](https://godooo.ai/en/model/claude) | Model | main job* |  |  | Web, Desktop, Mobile, API, In the editor, Terminal |
| [Gemini](https://godooo.ai/en/model/gemini) | Model | main job* |  |  | Web, API, Mobile |
| [Llama](https://godooo.ai/en/model/llama) | Model | main job* |  | Yes | API, Runs offline, Self-host |
| [OpenRouter](https://godooo.ai/en/product/openrouter) | Product | main job* | Free plan + paid upgrades |  | API, Web |
| [Google AI Studio](https://godooo.ai/en/product/ai-studio) | Product | main job* | Free |  | Web, API |
| [OpenAI Platform](https://godooo.ai/en/product/openai-platform) | Product | main job* | Paid |  | API |
| [Claude Developer Platform](https://godooo.ai/en/product/claude-platform) | Product | main job* | Paid |  | API |
| [Qwen](https://godooo.ai/en/model/qwen) | Model | main job* |  | Yes | Web, API, Self-host, Runs offline |
| [Mistral](https://godooo.ai/en/model/mistral) | Model | main job* |  | Yes | API, Self-host, Runs offline |
| [Replicate](https://godooo.ai/en/product/replicate) | Product | main job* | Paid |  | API, Web |
| [Groq](https://godooo.ai/en/product/groq) | Product | main job* | Free plan + paid upgrades |  | API |
| [Together AI](https://godooo.ai/en/product/together) | Product | main job* | Paid |  | API, Terminal, Self-host |
| [AI SDK](https://godooo.ai/en/framework/ai-sdk) | Framework | main job* |  | Yes | API, Terminal |
| [Kimi](https://godooo.ai/en/model/kimi) | Model | main job* |  |  | Web, API |
| [Kimi K2](https://godooo.ai/en/model/kimi-k2) | Model | main job* |  | Yes | API, Self-host, Runs offline |
| [GLM](https://godooo.ai/en/model/glm) | Model | main job* |  | Yes | API, Runs offline, Self-host |
| [ERNIE 文心](https://godooo.ai/en/model/ernie) | Model | main job* |  |  | API, Self-host, Runs offline |
| [MiniMax](https://godooo.ai/en/model/minimax) | Model | main job* |  | Yes | API, Self-host, Runs offline |
| [Mixtral](https://godooo.ai/en/model/mixtral) | Model | main job* |  | Yes | API, Runs offline, Self-host |
| [Command](https://godooo.ai/en/model/command) | Model | main job* |  |  | API, Self-host |
| [LLM](https://godooo.ai/en/cli/llm) | CLI | main job* |  | Yes | Terminal, API, Runs offline, Self-host |
| [LocalAI](https://godooo.ai/en/framework/localai) | Framework | main job* |  | Yes | Self-host, Runs offline, API, Terminal |
| [WebLLM](https://godooo.ai/en/framework/webllm) | Framework | main job* |  | Yes | Web, Runs offline |
| [LiteLLM](https://godooo.ai/en/framework/litellm) | Framework | main job* |  | Yes | Self-host, API, Terminal |
| [One API](https://godooo.ai/en/product/one-api) | Product | main job* | Open source, free | Yes | Self-host, API, Terminal |
| [Amazon Nova](https://godooo.ai/en/model/nova) | Model | main job* |  |  | API |
| [LMDeploy](https://godooo.ai/en/framework/lmdeploy) | Framework | main job* |  | Yes | Self-host, Terminal, API |
| [Hugging Face](https://godooo.ai/en/product/huggingface) | Product | supported* | Free plan + paid upgrades |  | Web, API, Self-host, Runs offline |
| [DeepSeek-R1](https://godooo.ai/en/model/deepseek-r1) | Model | supported* |  | Yes | Web, API, Self-host, Runs offline |
| [Ollama](https://godooo.ai/en/product/ollama) | Product | supported* | Open source, free | Yes | Desktop, Terminal, API, Self-host, Runs offline |
| [GPT-5](https://godooo.ai/en/model/gpt-5) | Model | supported* |  |  | API, Web |
| [Gemma](https://godooo.ai/en/model/gemma) | Model | supported* |  | Yes | Web, API, Runs offline, Self-host |
| [DeepSeek-V3](https://godooo.ai/en/model/deepseek-v3) | Model | supported* |  | Yes | API, Runs offline, Self-host |
| [Grok](https://godooo.ai/en/model/grok) | Model | supported* |  |  | Web, Mobile, API |
| [vLLM](https://godooo.ai/en/framework/vllm) | Framework | supported* |  | Yes | Self-host, API, Runs offline |
| [LM Studio](https://godooo.ai/en/product/lm-studio) | Product | supported* | Free |  | Desktop, Runs offline, API, Terminal |
| [o3](https://godooo.ai/en/model/o3) | Model | supported* |  |  | API, Web |
| [gpt-oss](https://godooo.ai/en/model/gpt-oss) | Model | supported* |  | Yes | API, Self-host, Runs offline, Terminal |
| [Phi](https://godooo.ai/en/model/phi) | Model | supported* |  | Yes | API, Runs offline, Self-host |
| [DeepSeek-V2](https://godooo.ai/en/model/deepseek-v2) | Model | supported* |  | Yes | API, Web, Runs offline, Self-host |
| [Semantic Kernel](https://godooo.ai/en/framework/semantic-kernel) | Framework | supported* |  | Yes | API, Self-host |
| [SGLang](https://godooo.ai/en/framework/sglang) | Framework | supported* |  | Yes | Self-host, API, Runs offline |
| [Jan](https://godooo.ai/en/product/jan) | Product | supported* | Open source, free | Yes | Desktop, Runs offline, API, Self-host |
| [TextGen](https://godooo.ai/en/product/textgen) | Product | supported* | Open source, free | Yes | Desktop, Web, Self-host, Runs offline, API |
| [MLC LLM](https://godooo.ai/en/framework/mlc-llm) | Framework | supported* |  | Yes | Web, Desktop, Mobile, Terminal, API, Self-host, Runs offline |
| [TensorRT LLM](https://godooo.ai/en/framework/tensorrt-llm) | Framework | supported* |  | Yes | Self-host, API, Terminal |
| [exo](https://godooo.ai/en/framework/exo) | Framework | supported* |  | Yes | Runs offline, Self-host, Desktop, Terminal, API |
| [PrivateGPT](https://godooo.ai/en/framework/privategpt) | Framework | supported* |  | Yes | Self-host, API, Runs offline |

\* proposed by a machine, awaiting calibration

## Related

- **Kinds of it:** [One API for many models](https://godooo.ai/en/capability/model-gateway)
- **Needed to:** [Build an AI customer support bot](https://godooo.ai/en/goal/customer-support-bot), [Add voice to a website](https://godooo.ai/en/goal/voice-for-website), [Build an AI agent](https://godooo.ai/en/goal/build-ai-agent)

## Questions

### What is LLM API?

Call language models from your own code over an API. LLM API: 51 AI tools in this graph can do it, including GPT, GPT-3, GPT-4, Claude and Gemini.

### Which tools are built for “LLM API”?

GPT, GPT-3, GPT-4, Claude, Gemini, Llama, OpenRouter and Google AI Studio.

### Are there free tools for “LLM API”?

Llama, Google AI Studio, Qwen, Mistral, AI SDK, Kimi K2, GLM and MiniMax.

### Which open-source tools can do “LLM API”?

Llama, Qwen, Mistral, AI SDK, Kimi K2, GLM, MiniMax and Mixtral.

### Which tools for “LLM API” run offline?

Llama, Qwen, Mistral, Kimi K2, GLM, ERNIE 文心, MiniMax and Mixtral.

---

Last updated 2026-09-24 · Markdown version of https://godooo.ai/en/capability/llm-api. Every page on this site has one: add .md to its address.
