reader and just-scrape
These are competitors offering similar core functionality—both provide LLM-optimized web scraping with markdown output and crawling capabilities—though vakra-dev/reader is a self-hosted engine while ScrapeGraphAI/just-scrape is an API client wrapper, making them alternative architectural approaches to the same problem.
About reader
vakra-dev/reader
Open-source, production-grade web scraping engine built for LLMs. Scrape and crawl the entire web, clean markdown, ready for your agents.
Leverages [Ulixee Hero](https://ulixee.org/), a headless browser with built-in anti-bot defenses (TLS fingerprinting, Cloudflare bypass, DNS-over-TLS), managed through a pooled architecture with automatic recycling and health monitoring. Provides two core primitives—`scrape()` for converting URLs to cleaned markdown/HTML, and `crawl()` for breadth-first site discovery—with configurable browser pooling, proxy rotation strategies, batch concurrency, and graceful degradation handling all abstracted away.
About just-scrape
ScrapeGraphAI/just-scrape
CLI for AI-powered web scraping, data extraction, search, and crawling powered by the ScrapeGraph AI API. Supports smart scraping, agentic browser automation, markdownify, sitemap discovery, and JSON mode for piping to AI agents.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work