adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- Stars
- 7.0k
- Forks
- 462
- Open issues
- 57
- Last push
- today
About trafilatura
trafilatura is a free, open-source AI developer tool by adbar, written mainly in Python. Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML. It has 7.0k GitHub stars and 462 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 7,010
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
Scrapegraph-ai32k stars · Python scraper based on AI
Scrapling89k stars · 🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: http
crawlee26k stars · Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o
promptfoo26k stars · Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line
humanize-text3.4k stars · Open-source pipeline for rewriting AI-generated text into natural human prose. Need it in your app? Try the Lynote Humanizer API → lynote.ai/ai-humanizer-api
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
trafilatura FAQ
Is trafilatura free?
Yes. trafilatura is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does trafilatura run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does trafilatura need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is trafilatura still maintained?
Yes. It was last updated today and has 57 open issues on GitHub.
What are alternatives to trafilatura?
Similar free, open-source tools include Scrapegraph-ai, Scrapling, crawlee, promptfoo.