unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8m
- Stars
- 86k
- Forks
- 8.9k
- Open issues
- 44
- Last push
- today
About crawl4ai
crawl4ai is a free, open-source AI agent tool by unclecode, written mainly in Python. Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8m. It has 86k GitHub stars and 8.9k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license. People use it as a free alternative to Context.dev, Firecrawl, MrScraper.
- License
- Apache-2.0
- Language
- Python
- Stars
- 86,065
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
firecrawl194k stars · Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
hermes-agent256k stars · The agent that grows with you
Agent-Reach101k stars · Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
paperclip106k stars · The open-source app everyone uses to manage agents at work
browser-use119k stars · Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
anything-llm67k stars · Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
crawl4ai FAQ
Is crawl4ai free?
Yes. crawl4ai is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does crawl4ai run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does crawl4ai need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is crawl4ai still maintained?
Yes. It was last updated today and has 44 open issues on GitHub.
What are alternatives to crawl4ai?
Similar free, open-source tools include firecrawl, hermes-agent, Agent-Reach, paperclip. crawl4ai itself is a free alternative to Context.dev, Firecrawl, MrScraper.