# Run models locally Capability · https://godooo.ai/en/capability/local-inference > Run models locally: 41 AI tools in this graph can do it, including Ollama, Gemma, llama.cpp, LM Studio and gpt-oss. Download open models and run them on your own computer, offline and private. - **Takes in:** Text - **Gives out:** Text ## Tools that do it | Tool | Type | How well | Pricing | Open source | How you run it | | --- | --- | --- | --- | --- | --- | | [Ollama](https://godooo.ai/en/product/ollama) | Product | main job* | Open source, free | Yes | Desktop, Terminal, API, Self-host, Runs offline | | [Gemma](https://godooo.ai/en/model/gemma) | Model | main job* | | Yes | Web, API, Runs offline, Self-host | | [llama.cpp](https://godooo.ai/en/framework/llama-cpp) | Framework | main job* | | Yes | Terminal, API, Self-host, Runs offline | | [LM Studio](https://godooo.ai/en/product/lm-studio) | Product | main job* | Free | | Desktop, Runs offline, API, Terminal | | [gpt-oss](https://godooo.ai/en/model/gpt-oss) | Model | main job* | | Yes | API, Self-host, Runs offline, Terminal | | [Phi](https://godooo.ai/en/model/phi) | Model | main job* | | Yes | API, Runs offline, Self-host | | [MLX](https://godooo.ai/en/framework/mlx) | Framework | main job* | | Yes | Runs offline, API, Terminal, Self-host | | [Jan](https://godooo.ai/en/product/jan) | Product | main job* | Open source, free | Yes | Desktop, Runs offline, API, Self-host | | [LocalAI](https://godooo.ai/en/framework/localai) | Framework | main job* | | Yes | Self-host, Runs offline, API, Terminal | | [TextGen](https://godooo.ai/en/product/textgen) | Product | main job* | Open source, free | Yes | Desktop, Web, Self-host, Runs offline, API | | [MLC LLM](https://godooo.ai/en/framework/mlc-llm) | Framework | main job* | | Yes | Web, Desktop, Mobile, Terminal, API, Self-host, Runs offline | | [WebLLM](https://godooo.ai/en/framework/webllm) | Framework | main job* | | Yes | Web, Runs offline | | [exo](https://godooo.ai/en/framework/exo) | Framework | main job* | | Yes | Runs offline, Self-host, Desktop, Terminal, API | | [llamafile](https://godooo.ai/en/framework/llamafile) | Framework | main job* | | Yes | Runs offline, Terminal, API, Self-host | | [Apple Foundation Models](https://godooo.ai/en/model/apple-foundation-models) | Model | main job* | | | API, Runs offline | | [Llama](https://godooo.ai/en/model/llama) | Model | supported | | Yes | API, Runs offline, Self-host | | [DeepSeek-R1](https://godooo.ai/en/model/deepseek-r1) | Model | supported* | | Yes | Web, API, Self-host, Runs offline | | [Transformers](https://godooo.ai/en/framework/transformers) | Framework | supported* | | Yes | Runs offline, Self-host, Terminal, API | | [Stable Diffusion](https://godooo.ai/en/model/stable-diffusion) | Model | supported* | | Yes | Self-host, Runs offline, API, Terminal | | [ComfyUI](https://godooo.ai/en/product/comfyui) | Product | supported | Open source, free | Yes | Desktop, Web, API, Self-host, Runs offline, Terminal | | [GPT-2](https://godooo.ai/en/model/gpt-2) | Model | supported* | | Yes | Self-host, Runs offline, API | | [Whisper](https://godooo.ai/en/model/whisper) | Model | supported* | | Yes | Terminal, API, Self-host, Runs offline | | [Qwen](https://godooo.ai/en/model/qwen) | Model | supported | | Yes | Web, API, Self-host, Runs offline | | [DeepSeek-V3](https://godooo.ai/en/model/deepseek-v3) | Model | supported* | | Yes | API, Runs offline, Self-host | | [Mistral](https://godooo.ai/en/model/mistral) | Model | supported | | Yes | API, Self-host, Runs offline | | [Open WebUI](https://godooo.ai/en/product/open-webui) | Product | supported* | Open source, free | Yes | Web, Self-host, Runs offline, API | | [DeepSeek-V2](https://godooo.ai/en/model/deepseek-v2) | Model | supported* | | Yes | API, Web, Runs offline, Self-host | | [GLM](https://godooo.ai/en/model/glm) | Model | supported* | | Yes | API, Runs offline, Self-host | | [Mixtral](https://godooo.ai/en/model/mixtral) | Model | supported* | | Yes | API, Runs offline, Self-host | | [OLMo](https://godooo.ai/en/model/olmo) | Model | supported* | | Yes | Web, API, Runs offline, Self-host | | [GPT-J](https://godooo.ai/en/model/gpt-j) | Model | supported* | | Yes | Runs offline, API, Self-host | | [LLM](https://godooo.ai/en/cli/llm) | CLI | supported* | | Yes | Terminal, API, Runs offline, Self-host | | [AnythingLLM](https://godooo.ai/en/product/anythingllm) | Product | supported* | Open source, free | Yes | Web, Desktop, Self-host, API, Runs offline | | [Chatbox](https://godooo.ai/en/product/chatbox) | Product | supported* | Open source, free | Yes | Desktop, Web, Mobile, Runs offline | | [Cherry Studio](https://godooo.ai/en/product/cherry-studio) | Product | supported* | Open source, free | Yes | Desktop, Runs offline, Self-host | | [Langchain-Chatchat](https://godooo.ai/en/product/langchain-chatchat) | Product | supported* | Open source, free | Yes | Self-host, Runs offline, API | | [whisper.cpp](https://godooo.ai/en/framework/whisper-cpp) | Framework | supported* | | Yes | Runs offline, Self-host, Terminal, API | | [Unsloth](https://godooo.ai/en/framework/unsloth) | Framework | supported* | | Yes | Runs offline, Desktop, Terminal, API, Self-host | | [Yi](https://godooo.ai/en/model/yi) | Model | supported* | | Yes | API, Self-host, Runs offline, Terminal | | [Falcon](https://godooo.ai/en/model/falcon) | Model | supported* | | Yes | API, Self-host, Runs offline | | [Kimi K2](https://godooo.ai/en/model/kimi-k2) | Model | workaround* | | Yes | API, Self-host, Runs offline | \* proposed by a machine, awaiting calibration ## Related - **Needed to:** [Run LLMs on your own computer](https://godooo.ai/en/goal/run-llm-locally) - **Proven recipes:** [Run AI privately on your laptop](https://godooo.ai/en/recipe/local-ai) ## Questions ### What is Run models locally? Download open models and run them on your own computer, offline and private. Run models locally: 41 AI tools in this graph can do it, including Ollama, Gemma, llama.cpp, LM Studio and gpt-oss. ### Which tools are built for “Run models locally”? Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan. ### Are there free tools for “Run models locally”? Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan. ### Which open-source tools can do “Run models locally”? Ollama, Gemma, llama.cpp, gpt-oss, Phi, MLX, Jan and LocalAI. ### Which tools for “Run models locally” run offline? Ollama, Gemma, llama.cpp, LM Studio, gpt-oss, Phi, MLX and Jan. --- Last updated 2026-09-24 · Markdown version of https://godooo.ai/en/capability/local-inference. Every page on this site has one: add .md to its address.