Capability
LLM API
LLM API: 51 AI tools in this graph can do it, including GPT, GPT-3, GPT-4, Claude and Gemini.
Call language models from your own code over an API.
Takes in Text → Gives out Text
Markdown version of https://godooo.ai/en/capability/llm-api. Every page on this site has one: add .md to its address.
Tools that do it · 51
| Tool | How well | Pricing | Open source | How you run it |
|---|---|---|---|---|
| GPTModel | main job * | API · Web | ||
| GPT-3Model | main job * | API | ||
| GPT-4Model | main job * | API · Web | ||
| ClaudeModel | main job * | Web · Desktop · Mobile · API · In the editor · Terminal | ||
| GeminiModel | main job * | Web · API · Mobile | ||
| LlamaModel | main job * | Yes | API · Runs offline · Self-host | |
| OpenRouterProduct | main job * | Free plan + paid upgrades | API · Web | |
| Google AI StudioProduct | main job * | Free | Web · API | |
| OpenAI PlatformProduct | main job * | Paid | API | |
| Claude Developer PlatformProduct | main job * | Paid | API | |
| QwenModel | main job * | Yes | Web · API · Self-host · Runs offline | |
| MistralModel | main job * | Yes | API · Self-host · Runs offline | |
| ReplicateProduct | main job * | Paid | API · Web | |
| GroqProduct | main job * | Free plan + paid upgrades | API | |
| Together AIProduct | main job * | Paid | API · Terminal · Self-host | |
| AI SDKFramework | main job * | Yes | API · Terminal | |
| KimiModel | main job * | Web · API | ||
| Kimi K2Model | main job * | Yes | API · Self-host · Runs offline | |
| GLMModel | main job * | Yes | API · Runs offline · Self-host | |
| ERNIE 文心Model | main job * | API · Self-host · Runs offline | ||
| MiniMaxModel | main job * | Yes | API · Self-host · Runs offline | |
| MixtralModel | main job * | Yes | API · Runs offline · Self-host | |
| CommandModel | main job * | API · Self-host | ||
| LLMCLI | main job * | Yes | Terminal · API · Runs offline · Self-host | |
| LocalAIFramework | main job * | Yes | Self-host · Runs offline · API · Terminal | |
| WebLLMFramework | main job * | Yes | Web · Runs offline | |
| LiteLLMFramework | main job * | Yes | Self-host · API · Terminal | |
| One APIProduct | main job * | Open source, free | Yes | Self-host · API · Terminal |
| Amazon NovaModel | main job * | API | ||
| LMDeployFramework | main job * | Yes | Self-host · Terminal · API | |
| Hugging FaceProduct | supported * | Free plan + paid upgrades | Web · API · Self-host · Runs offline | |
| DeepSeek-R1Model | supported * | Yes | Web · API · Self-host · Runs offline | |
| OllamaProduct | supported * | Open source, free | Yes | Desktop · Terminal · API · Self-host · Runs offline |
| GPT-5Model | supported * | API · Web | ||
| GemmaModel | supported * | Yes | Web · API · Runs offline · Self-host | |
| DeepSeek-V3Model | supported * | Yes | API · Runs offline · Self-host | |
| GrokModel | supported * | Web · Mobile · API | ||
| vLLMFramework | supported * | Yes | Self-host · API · Runs offline | |
| LM StudioProduct | supported * | Free | Desktop · Runs offline · API · Terminal | |
| o3Model | supported * | API · Web | ||
| gpt-ossModel | supported * | Yes | API · Self-host · Runs offline · Terminal | |
| PhiModel | supported * | Yes | API · Runs offline · Self-host | |
| DeepSeek-V2Model | supported * | Yes | API · Web · Runs offline · Self-host | |
| Semantic KernelFramework | supported * | Yes | API · Self-host | |
| SGLangFramework | supported * | Yes | Self-host · API · Runs offline | |
| JanProduct | supported * | Open source, free | Yes | Desktop · Runs offline · API · Self-host |
| TextGenProduct | supported * | Open source, free | Yes | Desktop · Web · Self-host · Runs offline · API |
| MLC LLMFramework | supported * | Yes | Web · Desktop · Mobile · Terminal · API · Self-host · Runs offline | |
| TensorRT LLMFramework | supported * | Yes | Self-host · API · Terminal | |
| exoFramework | supported * | Yes | Runs offline · Self-host · Desktop · Terminal · API | |
| PrivateGPTFramework | supported * | Yes | Self-host · API · Runs offline |
* proposed by a machine, awaiting calibration
Questions
What is LLM API?
Call language models from your own code over an API. LLM API: 51 AI tools in this graph can do it, including GPT, GPT-3, GPT-4, Claude and Gemini.
Which tools are built for “LLM API”?
GPT, GPT-3, GPT-4, Claude, Gemini, Llama, OpenRouter and Google AI Studio.
Are there free tools for “LLM API”?
Llama, Google AI Studio, Qwen, Mistral, AI SDK, Kimi K2, GLM and MiniMax.
Which open-source tools can do “LLM API”?
Llama, Qwen, Mistral, AI SDK, Kimi K2, GLM, MiniMax and Mixtral.
Which tools for “LLM API” run offline?
Llama, Qwen, Mistral, Kimi K2, GLM, ERNIE 文心, MiniMax and Mixtral.