Chaitya44/AI-WebScraper
An intelligent, universal web scraper powered by Google Gemini AI. Features intent-based data extraction (E-commerce, Leads, News), anti-bot bypass (DrissionPage), and a secure, human-in-the-loop Streamlit interface.
Stars
4
Forks
—
Language
TypeScript
License
MIT
Category
Last pushed
Mar 01, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/Chaitya44/AI-WebScraper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
vakra-dev/reader
Open-source, production-grade web scraping engine built for LLMs. Scrape and crawl the entire...
joaobenedetmachado/scrapit
A (really) easy way to web scrape
firecrawl/open-scouts
🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email...
BrowserCash/teracrawl
High-performance web crawler API optimized for LLMs. Turn any search or website into clean...
memvid/maw
Crawl any website into a single searchable file. Query it forever, offline.