Framework
llamafile
llamafile is an open-source AI framework, launched in 2023, made for developers and people who don't write code.
A way to ship an open model as a single executable file that runs locally without installing anything.
Main jobs: Run models locally. It is open source and free to use. You can use it offline on your own machine, in the terminal, through an API and on your own server.
Markdown version of https://godooo.ai/en/framework/llamafile. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2023
- Galaxy
- Models & APIs
- Open source
- Yes
- Source code
- github.com/mozilla-ai/llamafile
- GitHub stars
- 26,049
- How you run it
- Runs offline · Terminal · API · Self-host
- Made for
- Developers · No-code users
- Website
- docs.mozilla.ai
What it can do
Run models locallymain jobunconfirmed
Speech to textsupportedunconfirmed
“llamafile also includes whisperfile , a single-file speech-to-text tool built on whisper.cpp and the same Cosmopolitan packaging. It supports transcription and translation of audio files”— docs.mozilla.ai, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- OllamaOpen source, freeAlso does: Run models locally
- LocalAIOpen source, freeAlso does: Run models locally, Speech to text
- GemmaOpen source, freeAlso does: Run models locally
- llama.cppOpen source, freeAlso does: Run models locally
- WhisperOpen source, freeAlso does: Speech to text, Run models locally
- exoOpen source, freeAlso does: Run models locally
- gpt-ossOpen source, freeAlso does: Run models locally
- JanOpen source, freeAlso does: Run models locally
- LM StudioFreeAlso does: Run models locally
- MLC LLMOpen source, freeAlso does: Run models locally
- MLXOpen source, freeAlso does: Run models locally
- PhiOpen source, freeAlso does: Run models locally
Connections
- Built with
- llama.cpp
Questions
What is llamafile?
llamafile is an open-source AI framework, launched in 2023, made for developers and people who don't write code. A way to ship an open model as a single executable file that runs locally without installing anything.
Is llamafile free?
Yes. llamafile is open source and free to use.
Is llamafile open source?
Yes. The source code is at https://github.com/mozilla-ai/llamafile.
Can llamafile run locally?
Yes. llamafile can run offline on your own machine. It can also be self-hosted on your own server.
What can llamafile do?
Main jobs: Run models locally. It can also do: Speech to text.
What are open-source alternatives to llamafile?
Open-source ones: Ollama, LocalAI, Gemma, llama.cpp, Whisper, exo, gpt-oss and Jan. Others: LM Studio.
Sources
- docs.mozilla.ai/llamafilechecked 2026-09-24
- github.com/mozilla-ai/llamafile