spronta/crawlie
Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.
- Stars
- 116
- Forks
- 16
- Open issues
- 2
- Last push
- 3d ago
crawlie star history
+1 this week
Can I sell what I build with it?
Check first
A guide, not legal advice.
About crawlie
crawlie is a free, open-source AI agent tool by spronta, written mainly in Rust. Fast, free, open-source technical SEO + GEO crawler: built for humans and agents. It has 116 GitHub stars and 16 forks, and was last updated 3d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it works on macOS.
- License
- Not detected
- Commercial use
- No license
- Language
- Rust
- Stars
- 116
- Last update
- 3d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
claude-seo24k stars · Universal SEO skill for Claude Code. 26 sub-skills + 19 sub-agents covering technical SEO, E-E-A-T, schema, GEO/AEO, agent readiness (Lighthouse Agentic Browsing, WebMCP, llms.txt), backlinks, local S
marketingskills57k stars · Provides marketing skills for AI agents to optimize conversion, copywriting, and SEO.
mcp9.9k stars · Open source MCP Servers for AWS
open-seo26k stars · AI-driven SEO tool with customizable workflows and MCP server.
xerj18k stars · Local search engine and MCP server for AI agents to index and search code, docs, and logs.
open-seo-mcp-skills8.0k stars · Free SEO and GEO skills for Claude AI agent.
crawlie FAQ
Can I use crawlie commercially?
Unclear. No license was detected, which legally means all rights are reserved. Ask the author before using it commercially. This is a plain-English summary, not legal advice.
Is crawlie free?
Yes. crawlie is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does crawlie run on a Mac?
Yes. According to the project, crawlie works on macOS.
Does crawlie need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is crawlie still maintained?
Yes. It was last updated 3d ago and has 2 open issues on GitHub.
What are alternatives to crawlie?
Similar free, open-source tools include claude-seo, marketingskills, mcp, open-seo.
Maintain crawlie?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/spronta/crawlie)