any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
- Stars
- 3.5k
- Forks
- 369
- Open issues
- 6
- Last push
- 23d ago
About AnyCrawl
AnyCrawl is a free, open-source AI developer tool by any4ai, written mainly in TypeScript. AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing. It has 3.5k GitHub stars and 369 forks, and was last updated 23d ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- TypeScript
- Stars
- 3,482
- Last update
- 23d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
Scrapegraph-ai32k stars · Python scraper based on AI
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
langchain148k stars · The agent engineering platform.
coze-studio22k stars · An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coze your way to AI Agent creation.
airflow47k stars · Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
giskard-oss5.9k stars · 🐢 Open-Source Evaluation & Testing library for LLM Agents
AnyCrawl FAQ
Is AnyCrawl free?
Yes. AnyCrawl is open source and free to use. It's released under the MIT license, a standard open-source license.
Does AnyCrawl run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does AnyCrawl need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is AnyCrawl still maintained?
Yes. It was last updated 23d ago and has 6 open issues on GitHub.
What are alternatives to AnyCrawl?
Similar free, open-source tools include Scrapegraph-ai, RagaAI-Catalyst, langchain, coze-studio.