Framework
WebLLM
WebLLM is an open-source AI framework, launched in 2023, made for developers.
A JavaScript engine that runs LLMs entirely in the browser with WebGPU.
Main jobs: LLM API, Run models locally. It is open source and free to use. You can use it in the browser and offline on your own machine.
Markdown version of https://godooo.ai/en/framework/webllm. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2023
- Galaxy
- Models & APIs
- Open source
- Yes · Apache-2.0
- Source code
- github.com/mlc-ai/web-llm
- GitHub stars
- 19,183
- How you run it
- Web · Runs offline
- Made for
- Developers
- Protocols
- OpenAI-compatible API
- Website
- webllm.mlc.ai
- Also known as
- Web LLM
What it can do
LLM APImain jobunconfirmed
“WebLLM is fully compatible with OpenAI API.”— github.com, 2026-09-24
Run models locallymain jobunconfirmed
“WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration.”— github.com, 2026-09-24
Chat and Q&Asupportedunconfirmed
“Supports streaming chat completions, allowing real-time output generation which enhances interactive applications like chatbots and virtual assistants.”— webllm.mlc.ai, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- LlamaOpen source, freeAlso does: Chat and Q&A, LLM API, Run models locally
- QwenOpen source, freeAlso does: Chat and Q&A, LLM API, Run models locally; no code needed
- GLMOpen source, freeAlso does: Chat and Q&A, LLM API, Run models locally
- JanOpen source, freeAlso does: Chat and Q&A, Run models locally, LLM API; no code needed
- LocalAIOpen source, freeAlso does: LLM API, Run models locally
- MixtralOpen source, freeAlso does: Chat and Q&A, LLM API, Run models locally
- PhiOpen source, freeAlso does: Chat and Q&A, Run models locally, LLM API
- TextGenOpen source, freeAlso does: Chat and Q&A, Run models locally, LLM API; no code needed
- gpt-ossOpen source, freeAlso does: Run models locally, Chat and Q&A, LLM API
- Kimi K2Open source, freeAlso does: LLM API, Chat and Q&A, Run models locally
- LLMOpen source, freeAlso does: LLM API, Chat and Q&A, Run models locally
- LM StudioFreeAlso does: Run models locally, Chat and Q&A, LLM API; no code needed
Connections
- Built with
- MLC LLM
Questions
What is WebLLM?
WebLLM is an open-source AI framework, launched in 2023, made for developers. A JavaScript engine that runs LLMs entirely in the browser with WebGPU.
Is WebLLM free?
Yes. WebLLM is open source (Apache-2.0) and free to use.
Is WebLLM open source?
Yes, under the Apache-2.0 license. The source code is at https://github.com/mlc-ai/web-llm.
Can WebLLM run locally?
Yes. WebLLM can run offline on your own machine.
What can WebLLM do?
Main jobs: LLM API, Run models locally. It can also do: Chat and Q&A.
What are open-source alternatives to WebLLM?
Open-source ones: Llama, Qwen, GLM, Jan, LocalAI, Mixtral, Phi and TextGen. Others: LM Studio.
Sources
- github.com/mlc-ai/web-llmchecked 2026-09-24
- webllm.mlc.ai/checked 2026-09-24