Capability
Run models locally
Run models locally: 41 AI tools in this graph can do it, including Ollama, Gemma, llama.cpp, LM Studio and gpt-oss.
Download open models and run them on your own computer, offline and private.
Takes in Text → Gives out Text
Markdown version of https://godooo.ai/en/capability/local-inference. Every page on this site has one: add .md to its address.
Tools that do it · 41
| Tool | How well | Pricing | Open source | How you run it |
|---|---|---|---|---|
| OllamaProduct | main job * | Open source, free | Yes | Desktop · Terminal · API · Self-host · Runs offline |
| GemmaModel | main job * | Yes | Web · API · Runs offline · Self-host | |
| llama.cppFramework | main job * | Yes | Terminal · API · Self-host · Runs offline | |
| LM StudioProduct | main job * | Free | Desktop · Runs offline · API · Terminal | |
| gpt-ossModel | main job * | Yes | API · Self-host · Runs offline · Terminal | |
| PhiModel | main job * | Yes | API · Runs offline · Self-host | |
| MLXFramework | main job * | Yes | Runs offline · API · Terminal · Self-host | |
| JanProduct | main job * | Open source, free | Yes | Desktop · Runs offline · API · Self-host |
| LocalAIFramework | main job * | Yes | Self-host · Runs offline · API · Terminal | |
| TextGenProduct | main job * | Open source, free | Yes | Desktop · Web · Self-host · Runs offline · API |
| MLC LLMFramework | main job * | Yes | Web · Desktop · Mobile · Terminal · API · Self-host · Runs offline | |
| WebLLMFramework | main job * | Yes | Web · Runs offline | |
| exoFramework | main job * | Yes | Runs offline · Self-host · Desktop · Terminal · API | |
| llamafileFramework | main job * | Yes | Runs offline · Terminal · API · Self-host | |
| Apple Foundation ModelsModel | main job * | API · Runs offline | ||
| LlamaModel | supported | Yes | API · Runs offline · Self-host | |
| DeepSeek-R1Model | supported * | Yes | Web · API · Self-host · Runs offline | |
| TransformersFramework | supported * | Yes | Runs offline · Self-host · Terminal · API | |
| Stable DiffusionModel | supported * | Yes | Self-host · Runs offline · API · Terminal | |
| ComfyUIProduct | supported | Open source, free | Yes | Desktop · Web · API · Self-host · Runs offline · Terminal |
| GPT-2Model | supported * | Yes | Self-host · Runs offline · API | |
| WhisperModel | supported * | Yes | Terminal · API · Self-host · Runs offline | |
| QwenModel | supported | Yes | Web · API · Self-host · Runs offline | |
| DeepSeek-V3Model | supported * | Yes | API · Runs offline · Self-host | |
| MistralModel | supported | Yes | API · Self-host · Runs offline | |
| Open WebUIProduct | supported * | Open source, free | Yes | Web · Self-host · Runs offline · API |
| DeepSeek-V2Model | supported * | Yes | API · Web · Runs offline · Self-host | |
| GLMModel | supported * | Yes | API · Runs offline · Self-host | |
| MixtralModel | supported * | Yes | API · Runs offline · Self-host | |
| OLMoModel | supported * | Yes | Web · API · Runs offline · Self-host | |
| GPT-JModel | supported * | Yes | Runs offline · API · Self-host | |
| LLMCLI | supported * | Yes | Terminal · API · Runs offline · Self-host | |
| AnythingLLMProduct | supported * | Open source, free | Yes | Web · Desktop · Self-host · API · Runs offline |
| ChatboxProduct | supported * | Open source, free | Yes | Desktop · Web · Mobile · Runs offline |
| Cherry StudioProduct | supported * | Open source, free | Yes | Desktop · Runs offline · Self-host |
| Langchain-ChatchatProduct | supported * | Open source, free | Yes | Self-host · Runs offline · API |
| whisper.cppFramework | supported * | Yes | Runs offline · Self-host · Terminal · API | |
| UnslothFramework | supported * | Yes | Runs offline · Desktop · Terminal · API · Self-host | |
| YiModel | supported * | Yes | API · Self-host · Runs offline · Terminal | |
| FalconModel | supported * | Yes | API · Self-host · Runs offline | |
| Kimi K2Model | workaround * | Yes | API · Self-host · Runs offline |
* proposed by a machine, awaiting calibration
Questions
What is Run models locally?
Download open models and run them on your own computer, offline and private. Run models locally: 41 AI tools in this graph can do it, including Ollama, Gemma, llama.cpp, LM Studio and gpt-oss.
Which tools are built for “Run models locally”?
Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan.
Are there free tools for “Run models locally”?
Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan.
Which open-source tools can do “Run models locally”?
Ollama, Gemma, llama.cpp, gpt-oss, Phi, MLX, Jan and LocalAI.
Which tools for “Run models locally” run offline?
Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan.