Framework
Crawl4AI
Crawl4AI is an open-source AI framework, launched in 2024, made for developers.
An open-source web crawler that turns pages into clean, LLM-ready Markdown.
Main jobs: Web scraping. It is open source and free to use. You can use it on your own server, offline on your own machine, in the terminal and through an API.
Markdown version of https://godooo.ai/en/framework/crawl4ai. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2024
- Galaxy
- Agents & Automation
- Open source
- Yes · Apache-2.0
- Source code
- github.com/unclecode/crawl4ai
- GitHub stars
- 84,195
- How you run it
- Self-host · Runs offline · Terminal · API
- Made for
- Developers
- Website
- crawl4ai.com
What it can do
Web scrapingmain jobunconfirmed
“Crawl4AI turns the web into clean, LLM ready Markdown for RAG, agents, and data pipelines.”— github.com, 2026-09-24
Browser automationsupportedunconfirmed
“Advanced Browser Control : Hooks, proxies, stealth modes, session re-use—fine-grained control.”— docs.crawl4ai.com, 2026-09-24
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- FirecrawlOpen source, freeAlso does: Web scraping, Browser automation
- Firecrawl MCP ServerOpen source, freeAlso does: Web scraping, Browser automation
- Apify MCP ServerOpen source, freeAlso does: Web scraping, Browser automation
- Browser UseOpen source, freeAlso does: Browser automation, Web scraping
- Fetch MCP ServerOpen source, freeAlso does: Web scraping
- Jina ReaderOpen source, freeAlso does: Web scraping
- ScrapeGraphAIOpen source, freeAlso does: Web scraping
- SkyvernOpen source, freeAlso does: Browser automation, Web scraping
- Browserbase MCP ServerAlso does: Browser automation, Web scraping
- AnythingLLMOpen source, freeAlso does: Web scraping; no code needed
- Cloudflare MCP ServersOpen source, freeAlso does: Web scraping
- Exa MCP ServerOpen source, freeAlso does: Web scraping
Questions
What is Crawl4AI?
Crawl4AI is an open-source AI framework, launched in 2024, made for developers. An open-source web crawler that turns pages into clean, LLM-ready Markdown.
Is Crawl4AI free?
Yes. Crawl4AI is open source (Apache-2.0) and free to use.
Is Crawl4AI open source?
Yes, under the Apache-2.0 license. The source code is at https://github.com/unclecode/crawl4ai.
Can Crawl4AI run locally?
Yes. Crawl4AI can run offline on your own machine. It can also be self-hosted on your own server.
What can Crawl4AI do?
Main jobs: Web scraping. It can also do: Browser automation.
What are open-source alternatives to Crawl4AI?
Open-source ones: Firecrawl, Firecrawl MCP Server, Apify MCP Server, Browser Use, Fetch MCP Server, Jina Reader, ScrapeGraphAI and Skyvern. Others: Browserbase MCP Server.
Sources
- github.com/unclecode/crawl4aichecked 2026-09-24
- docs.crawl4ai.com/checked 2026-09-24
- crawl4ai.com