Pyx-Corp/spectrawl
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
Combines Gemini Grounded Search with automatic browser escalation (Playwright → Camoufox engine) and block detection across 8 anti-bot services, returning full page content plus structured extraction for agent processing. Includes 24 platform adapters for authentication and posting, network request capturing, multi-page crawling with sitemap discovery, and CAPTCHA solving via Gemini Vision — all self-hosted with fallback APIs for locked sites (Reddit, Amazon, X, LinkedIn).
Stars
19
Forks
4
Language
JavaScript
License
MIT
Category
Last pushed
Mar 14, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mcp/Pyx-Corp/spectrawl"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and...
bartholomej/node-csfd-api
ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz. Now with MCP server
apify/apify-mcp-server
The Apify MCP server enables your AI agents to extract data from social media, search engines,...
ScrapeGraphAI/scrapegraph-mcp
ScapeGraph MCP Server
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public...