apify/rag-web-browser
RAG Web Browser is an Apify Actor to feed your LLM applications and RAG pipelines with up-to-date text content scraped from the web.
Combines Google Search with headless browser rendering and anti-scraping circumvention (proxies, fingerprinting) to extract Markdown/plain text from result pages. Designed for parallel handling via Standby mode's persistent HTTP server, enabling sub-second responses for LLM integrations. Exposes OpenAPI schemas for direct integration with OpenAI GPTs, Assistants, and Anthropic's Model Context Protocol, allowing LLMs to invoke web search as a function call within agent workflows.
Stars
72
Forks
14
Language
TypeScript
License
Apache-2.0
Category
Last pushed
Nov 26, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/apify/rag-web-browser"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts...
kreuzberg-dev/html-to-markdown
High performance and CommonMark compliant HTML to Markdown converter. Maintained by the...
lightfeed/extractor
Using LLMs and AI browser automation to robustly extract web data
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
paulpierre/markdown-crawler
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file...