oxylabs/web-scraper-api
All-in-one web scraping API for real-time, large-scale data extraction – proxies, CAPTCHA management, JS rendering, and parsing in a single request returning HTML or structured JSON.
- Stars
- 494
- Forks
- 3
- Open issues
- 0
- Last push
- 22d ago
About web-scraper-api
web-scraper-api is a free, open-source AI developer tool by oxylabs. All-in-one web scraping API for real-time, large-scale data extraction – proxies, CAPTCHA management, JS rendering, and parsing in a single request returning HTML or structured JSON. It has 494 GitHub stars and 3 forks, and was last updated 22d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially.
- License
- Not detected
- Language
- –
- Stars
- 494
- Last update
- 22d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
Scrapegraph-ai32k stars · Python scraper based on AI
Scrapling89k stars · 🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: http
langchain148k stars · The agent engineering platform.
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
crawlee26k stars · Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o
google-ai-mode-scraper3.6k stars · Scrape Google AI Mode responses without blocks on a large scale.
web-scraper-api FAQ
Is web-scraper-api free?
Yes. web-scraper-api is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does web-scraper-api run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does web-scraper-api need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is web-scraper-api still maintained?
Yes. It was last updated 22d ago and has 0 open issues on GitHub.
What are alternatives to web-scraper-api?
Similar free, open-source tools include Scrapegraph-ai, Scrapling, langchain, RagaAI-Catalyst.