Framework
PrivateGPT
PrivateGPT is an open-source AI framework, launched in 2023, made for developers and businesses.
An API layer for building private AI apps, such as document Q&A, on local models.
Main jobs: Ask your documents, Knowledge base (RAG). It is open source and free to use. You can use it on your own server, through an API and offline on your own machine.
Markdown version of https://godooo.ai/en/framework/privategpt. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2023
- Galaxy
- Models & APIs
- Open source
- Yes · Apache-2.0
- Source code
- github.com/zylon-ai/private-gpt
- GitHub stars
- 57,530
- How you run it
- Self-host · API · Runs offline
- Made for
- Developers · Businesses
- Protocols
- OpenAI-compatible API
- Website
- zylon.ai
- Also known as
- private-gpt
What it can do
Ask your documentsmain jobunconfirmed
“a script that let you chat with your documents, fully offline, with no data leaving your machine”— github.com, 2026-09-24
Knowledge base (RAG)main jobunconfirmed
“Retrieval with citations and agentic RAG”— github.com, 2026-09-24
Document parsingsupportedunconfirmed
“PDF and document ingestion”— github.com, 2026-09-24
LLM APIsupportedunconfirmed
“PrivateGPT is the open-source API layer that turns local models into production AI applications”— github.com, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- RAGFlowOpen source, freeAlso does: Ask your documents, Document parsing, Knowledge base (RAG)
- kotaemonOpen source, freeAlso does: Ask your documents, Knowledge base (RAG), Document parsing; no code needed
- QAnythingOpen source, freeAlso does: Ask your documents, Knowledge base (RAG), Document parsing
- AnythingLLMOpen source, freeAlso does: Ask your documents, Knowledge base (RAG); no code needed
- KhojOpen source, freeAlso does: Ask your documents, Knowledge base (RAG); no code needed
- Langchain-ChatchatOpen source, freeAlso does: Ask your documents, Knowledge base (RAG)
- LlamaIndexOpen source, freeAlso does: Knowledge base (RAG), Ask your documents, Document parsing
- NotebookLMFree plan + paid upgradesAlso does: Ask your documents, Knowledge base (RAG); no code needed
- GraphRAGOpen source, freeAlso does: Knowledge base (RAG), Ask your documents
- LightRAGOpen source, freeAlso does: Knowledge base (RAG), Ask your documents
- MaxKBOpen source, freeAlso does: Knowledge base (RAG), Ask your documents; no code needed
- FastGPTOpen source, freeAlso does: Knowledge base (RAG), Document parsing; no code needed
Connections
Questions
What is PrivateGPT?
PrivateGPT is an open-source AI framework, launched in 2023, made for developers and businesses. An API layer for building private AI apps, such as document Q&A, on local models.
Is PrivateGPT free?
Yes. PrivateGPT is open source (Apache-2.0) and free to use.
Is PrivateGPT open source?
Yes, under the Apache-2.0 license. The source code is at https://github.com/zylon-ai/private-gpt.
Can PrivateGPT run locally?
Yes. PrivateGPT can run offline on your own machine. It can also be self-hosted on your own server.
What can PrivateGPT do?
Main jobs: Ask your documents, Knowledge base (RAG). It can also do: Document parsing, LLM API.
What are open-source alternatives to PrivateGPT?
Open-source ones: RAGFlow, kotaemon, QAnything, AnythingLLM, Khoj, Langchain-Chatchat, LlamaIndex and GraphRAG. Others: NotebookLM.
Sources
- github.com/zylon-ai/private-gptchecked 2026-09-24
- www.zylon.ai/private-gpt