Karthick-840/Crawl4ai-RAG-with-Local-LLM

A tool for scraping web documentation using Crawl4AI, converting it to Markdown, and preparing it for integration with local LLMs (like Ollama) to enhance their knowledge for learning and "vibe coding" workflows.

25
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 4 / 25
Maturity 9 / 25
Community 10 / 25

How are scores calculated?

Stars

6

Forks

1

Language

Python

License

MIT

Category

web-to-markdown-rag

Last pushed

Jul 18, 2025

Commits (30d)

0

GitHub
Web-to-Markdown RAG · 101 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/rag/Karthick-840/Crawl4ai-RAG-with-Local-LLM"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts...

69

kreuzberg-dev/html-to-markdown

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the...

67

lightfeed/extractor

Using LLMs and AI browser automation to robustly extract web data

62

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

62

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file...

60

Explore RAG Tools

All categories Trending RAG directory Insights