rahulsamant37/AI-Scraper

Universal Web Scraping AI Processing Pipeline: A dynamic, AI-powered web scraping and data extraction system with multi-model support, advanced text processing, and flexible output options for efficient data analysis.

11
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 0 / 25
Maturity 11 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Python

License

GPL-3.0

Category

web-to-markdown-rag

Last pushed

Dec 27, 2024

Commits (30d)

0

GitHub
Web-to-Markdown RAG · 99 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/rag/rahulsamant37/AI-Scraper"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts...

66

kreuzberg-dev/html-to-markdown

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the...

64

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

62

adbar/trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping,...

60

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file...

53

Explore RAG Tools

All categories Trending RAG directory Insights