YOLOW92/pagesift
Rust web crawler for AI agents and RAG pipelines.
- Stars
- 185
- Forks
- 19
- Open issues
- 0
- Last push
- 2d ago
pagesift star history
+72 this week
Get pagesift running
Setup: Medium · Docker, typically about 30 min
docker run -d -p 3002:3002 -v pagesift-data:/data -e PAGESIFT_API_KEYS=sk-test ghcr.io/yolow92/pagesift:0.81.5Can I sell what I build with it?
Yes, with conditions
A guide, not legal advice.
About pagesift
pagesift is a free, open-source AI coding tool by YOLOW92, written mainly in Rust. Rust web crawler for AI agents and RAG pipelines. It has 185 GitHub stars and 19 forks, and was last updated 2d ago. It's released under the AGPL-3.0 license, a standard open-source license. According to the project, it runs on a regular CPU without a GPU.
- License
- AGPL-3.0
- Commercial use
- Copyleft
- Language
- Rust
- Stars
- 185
- Last update
- 2d ago
- Runs on Mac
- Not stated
- GPU
- Not needed (runs on CPU)
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
crawl4ai87k stars · Converts websites into LLM-ready Markdown for AI agents and data pipelines.
Scrapling92k stars · A Python web scraping framework for efficient data extraction.
Scrapegraph-ai32k stars · AI-powered web scraping library for extracting data with minimal code.
orca113k stars · Orchestrate multiple AI agents in one interface.
browser-harness19k stars · Automate browser tasks with AI agents like Claude Code, Codex, or Cursor.
OmniRoute84k stars · Free AI gateway with 375 providers and 1,400+ models for cost-effective AI inference.
pagesift FAQ
Can I use pagesift commercially?
With conditions. AGPL-3.0 allows commercial use, but if you modify it or build on it, even as a web service, your code must also be released under AGPL. This is a plain-English summary, not legal advice.
Is pagesift free?
Yes. pagesift is open source and free to use. It's released under the AGPL-3.0 license, a standard open-source license.
Does pagesift run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does pagesift need a GPU?
No. According to the project, pagesift runs on a regular CPU.
Is pagesift still maintained?
Yes. It was last updated 2d ago and has 0 open issues on GitHub.
How hard is pagesift to set up?
Medium: typically about 30 min, using Docker. The project's install command is: docker run -d -p 3002:3002 -v pagesift-data:/data -e PAGESIFT_API_KEYS=sk-test ghcr.io/yolow92/pagesift:0.81.5
What are alternatives to pagesift?
Similar free, open-source tools include crawl4ai, Scrapling, Scrapegraph-ai, orca.
Maintain pagesift?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/YOLOW92/pagesift)