Local RAG Stacks Vector Databases

Complete, self-contained RAG systems designed to run entirely on local machines using open-source components (Ollama, Chroma, Qdrant) with minimal external dependencies. Includes modular frameworks, orchestration patterns, and full-stack implementations. Does NOT include vector database tools alone, hosted RAG services, domain-specific applications, or single-component libraries.

There are 123 local rag stacks tools tracked. 1 score above 70 (verified tier). The highest-rated is yichuan-w/LEANN at 73/100 with 10,303 stars. 1 of the top 10 are actively maintained.

Get all 123 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=vector-db&subcategory=local-rag-stacks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	yichuan-w/LEANN [MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while...	73	Verified	10,303	Python
2	byerlikaya/SmartRAG Multi-Modal RAG for .NET — query databases, documents, images and audio in...	44	Emerging	21	C#
3	mrutunjay-kinagi/ragsearch This project aims to build a Retrieval-Augmented Generation (RAG) engine to...	40	Emerging	3	Python
4	aws-samples/layout-aware-document-processing-and-retrieval-augmented-generation Advanced document extraction and chunking techniques for retrieval augmented...	39	Emerging	115	Jupyter Notebook
5	Omkar-Wagholikar/adora Python package that makes it easy to spin up a custom Retrieval-Augmented...	36	Emerging	5	Python
6	leewaay/ragcar RAGCAR: Retrieval-Augmented Generative Companion for Advanced Research	35	Emerging	2	Python
7	sourangshupal/simple-rag-langchain Exploring the Basics of Langchain	34	Emerging	14	Jupyter Notebook
8	ZeusDB/llama-index-vector-stores-zeusdb ZeusDB vector database integration for LlamaIndex. Connect LlamaIndex's RAG...	31	Emerging	4	Python
9	Maverick0351a/neuralcache NeuralCache is a drop-in reranker for Retrieval-Augmented Generation (RAG)...	30	Emerging	12	Python
10	sion42x/llama-index-milvus-example Open AI APIs with Llama Index and Milvus Vector DB for Retrieval Augmented...	29	Experimental	12	Python
11	vteam27/RagXOllama A Node.js RESTful server for a Retrieval-Augmented Generation (RAG) system...	28	Experimental	13	JavaScript
12	dhivyeshrk/Retrieval-Augmented-Generation-for-news RAG system with real-time news scraping built using mixtral-8x7b, ChromaDB,...	27	Experimental	18	Python
13	wittyicon29/PWC-RAG A RAG application to search through the recent ML research without going...	26	Experimental	5	Python
14	Aavache/LLMWebCrawler A Web Crawler based on LLMs implemented with Ray and Huggingface. The...	25	Experimental	98	Python
15	darkzard05/rag-system-ollama Advanced local-first RAG system powered by Ollama and LangGraph. Optimized...	25	Experimental	3	Python
16	madhavmadupu/loco-rag-engine LOCO (Local-Only Contextual Orchestration) is designed for organizations and...	25	Experimental	2	TypeScript
17	mowael07/Awesome-RAG-Production 🚀 Build and scale reliable Retrieval-Augmented Generation (RAG) systems with...	24	Experimental	2	Python
18	noorjotk/local-rag-engine Local RAG app with zero-config Docker setup. FastAPI + Streamlit + Qdrant +...	24	Experimental	9	Python
19	vivy-yi/rag-tutorial 完整的RAG技术教程 - 从基础概念到生产部署，系统化掌握检索增强生成技术。包含4个模块、20章内容、17个Jupyter Notebooks、6个企业级实战案例	23	Experimental	7	Jupyter Notebook
20	huangsam/ragchain Your local RAG stack 🏠	23	Experimental	1	Python
21	SriRammSS/rag-local-app Privacy-first local RAG system — FastAPI + React + pgvector + Ollama. Ingest...	23	Experimental	1	—
22	heziqiang/ai-rag A minimal RAG app with local embeddings, retrieval, reranking, and OpenAI...	23	Experimental	1	Python
23	devenes/ocp-rag-stack A complete Retrieval-Augmented Generation (RAG) stack designed to run...	23	Experimental	1	Go
24	Corerishi/ReviewMind Fully local RAG chatbot that answers questions about restaurant reviews...	23	Experimental	1	Python
25	OceanPresentChao/llm-corpus 从零搭建大模型知识库(Build LLM RAG Corpus from scratch)	22	Experimental	86	Python
26	rizalsimb1/knowledge-graph-ai A production-grade Retrieval-Augmented Generation (RAG) system built with...	22	Experimental	—	Python
27	raykavin/gorag gorag is a Go library for building Retrieval-Augmented Generation (RAG)...	22	Experimental	—	Go
28	rizalsimb1/lora-finetune A production-grade Retrieval-Augmented Generation (RAG) system built with...	22	Experimental	—	Python
29	kolhesamiksha/Hybrid-Search-RAG This repository contains hybrid-rag a LLMOPS python package	22	Experimental	21	Jupyter Notebook
30	demstalferez/rag-builder Visual RAG Project Generator - Create customized Retrieval-Augmented...	22	Experimental	4	TypeScript
31	yuliu625/Yu-RAG-Toolkit Modular RAG framework built with LangChain & LangGraph: supporting...	22	Experimental	—	Python
32	Carricacha/local-rag-system 🤖 Build your own local Retrieval-Augmented Generation system for private,...	22	Experimental	—	Python
33	arpan10000/simple-rag-pipeline-demo 🌌 Build a simple RAG pipeline to generate AI-driven answers using Chroma DB...	22	Experimental	—	Jupyter Notebook
34	deepakarjunk-dak/End-to-End-RAG-Pipeline End-to-End RAG Pipeline from Document Ingestion to Agentic Retrieval using LangGraph	22	Experimental	—	Jupyter Notebook
35	omni-front/rag-from-scratch Building RAG (Retrieval-Augmented Generation) pipelines from scratch	22	Experimental	—	—
36	our-never-ending-job/awesome-rag-debugging A curated list of tools, frameworks, failure maps, observability platforms,...	22	Experimental	—	—
37	elifyagmurduran/LLMvectoRAG-product-classifier RAG assisted LLM tool and vector embeddings creator for AI enrichment...	22	Experimental	—	Python
38	HalkPapa/LocalDBKit 🗄️ Complete local database development kit with PostgreSQL, MongoDB, Redis,...	22	Experimental	—	Python
39	awesome-ai-tools/curated-rag-tools A curated list of RAG frameworks, vector databases, embedding models, and...	22	Experimental	—	—
40	leodeveloper/OllamaRAGLocalLargeLanguage how to create a local RAG (Retrieval Augmented Generation) pipeline that...	22	Experimental	1	Jupyter Notebook
41	ajeetsk/openai-elasticsearch-rag Retrieval Augmented Generation (RAG) Application to offer Q&A like...	21	Experimental	23	Python
42	romilandc/llama-index-RAG A RAG implementation on Llama Index using Qdrant vector stores as storage. ...	20	Experimental	15	Python
43	charanpool/rag-news-summarizer A local-first RAG pipeline that fetches news from RSS feeds, indexes them in...	20	Experimental	1	Python
44	pattabhia/dataset-generator A flexible, template-based dataset generator for creating high-quality...	20	Experimental	1	Python
45	hsleonis/rag_langchain_gradio A basic "retrieval augmented generation" (RAG) app with Langchain and OpenAI...	20	Experimental	7	Python
46	prsdm/rag-recipes This repository contains various techniques for Retrieval-Augmented...	20	Experimental	6	Jupyter Notebook
47	LauraAva/rag-ollama-set-up Local RAG on Windows: Ollama + PostgreSQL/pgvector + Python ingest/ask scripts.	20	Experimental	1	Python
48	rodrigoleitesouza/lore-master-tolkien Aplicação de RAG construída com LangChain, ChromaDB e Ollama, focada na...	20	Experimental	1	Python
49	ayushrajput8252-dev/Rag-Lanchain A hands-on RAG + LangChain learning repository containing multiple working...	20	Experimental	1	JavaScript
50	hnextits/NextitsLM_RAG RAG	19	Experimental	—	Python
51	tonypeng1/llamaindex High-performance Hybrid RAG pipeline using LlamaIndex, MinerU, GLiNER, and...	19	Experimental	—	Python
52	valinsogna/free-rag-document-search 💰 Zero-cost RAG system for intelligent document search using Ollama local...	19	Experimental	—	Python
53	Caua1705/DocRAG Production-style RAG system using LangChain, FAISS, OpenAI embeddings, and...	19	Experimental	—	Python
54	vroomfondel/arley Experimental RAG assistant for legal Q&A powered by LLMs (Llama, Mixtral)....	19	Experimental	—	Python
55	jacobmarks/fiftyone-multimodal-rag-plugin Testbed for multimodal retrieval augmented generation techniques with...	18	Experimental	21	Python
56	Dude775/local-rag-system Building Private AI Memory with Ollama, LangChain & Chroma - 100% Local RAG System	18	Experimental	4	Python
57	NisugaJ/rag-test An Advanced RAG Pipeline	18	Experimental	7	Jupyter Notebook
58	NebeyouMusie/RAG-Pipeline In this project I have built a RAG pipeline to showcase how we can augment...	17	Experimental	5	Jupyter Notebook
59	KhaledSharif/openrag openrag = ollama + dspy + chroma	17	Experimental	3	Python
60	serkanyasr/Vec2SFT Automatically generates high-quality instruction-response pairs for...	17	Experimental	2	Python
61	lloydmeta/huggingface_elasticsearch_rag Cookbook for building an Elasticsearch and Gemma-powered RAG via Huggingface...	17	Experimental	2	Jupyter Notebook
62	rukaiah-edhah/RateMyProf In this project we learned how to use Retrieval-Augmented Generation (RAG)...	17	Experimental	2	JavaScript
63	SCIFER99/Retrieval-Augmented-Generation-RAG This is a foundational RAG for accurate Natural Language Processing	16	Experimental	1	Jupyter Notebook
64	nbathreya/Mini-RAG-System RAG System with Vector Database	16	Experimental	1	Python
65	Travis-ML/rag-llm-system A complete self-hosted AI research platform running on Docker with GPU...	16	Experimental	1	Python
66	Abeshith/RAG-FundaMentals 🔰 A Comprehensive RAG repository covering basic vanilla RAG techniques,...	16	Experimental	7	Jupyter Notebook
67	AyaFergany/RAG-App-Using-a-LLM In this project, we leverage Weaviate, a vector database, to power our...	15	Experimental	1	Jupyter Notebook
68	nicholasid7/rag-system-prototype RAG-system prototype	15	Experimental	—	Jupyter Notebook
69	NDDimension/simple-rag-pipeline-demo A simple, modular RAG pipeline using Chroma DB for vector storage and Grok...	15	Experimental	—	Jupyter Notebook
70	shreyavijayjadhav3/rag-pipeline Modular RAG pipeline using LangChain + FAISS + Groq Llama3 — context-aware...	15	Experimental	1	Python
71	laolarou726/RAG_Demo This is a minimal demo project to show the capabilities of a RAG system...	15	Experimental	8	Python
72	husaynirfan1/simple-rag Simple RAG system powered by Milvus.	15	Experimental	20	Python
73	NDDimension/llm-rag-vault 📚 Complete vault for Learning, Building, and Deploying RAG Systems Step by Step	15	Experimental	—	—
74	shrutikakapade/RAG-From-Scratch-Complete-RAG-Pipeline-Langchain A comprehensive repository to learn and implement Retrieval-Augmented...	15	Experimental	1	Jupyter Notebook
75	d-kleine/Advent_of_HayStack Solutions from the Advent of Haystack 2024 event, exploring Haystack...	15	Experimental	2	Jupyter Notebook
76	immohitsen/RAG-Pipeline Basic RAG pipeline for understanding how AI agents work with vector DB and...	14	Experimental	—	Jupyter Notebook
77	Asymmetric-OG/rag-qa A LangChain powered RAG pipeline to retrieve context accurate answers to queries	14	Experimental	—	Python
78	Li-Zou/Retrieval-Augmented-Generation Architected and deployed a Retrieval-Augmented Generation (RAG) system	14	Experimental	—	Jupyter Notebook
79	YomnaWaleed/egyptian-rag-translator Hybrid RAG system for translating Ancient Egyptian transliterations using...	14	Experimental	3	Jupyter Notebook
80	Naniyarram/rag-cold-email-generator Retrieval-Augmented Generation (RAG) application that generates personalized...	14	Experimental	—	Python
81	jsfaulkner86/clinical-rag-agent LangChain + Chroma: Clinical guidelines at point of care	14	Experimental	—	Python
82	JianHanTey/Orion-RAG-Architect Enterprise-scale Retrieval Augmented Generation (RAG) architecture...	14	Experimental	—	—
83	rizalsimb1/embed-server A production-grade Retrieval-Augmented Generation (RAG) system built with...	14	Experimental	—	—
84	jerrygeorge360/SpotRAG A RAG system for spotify	14	Experimental	3	Python
85	boemer00/luthor A RAG system designed for law firms to enable lawyers to efficiently "talk...	14	Experimental	7	Jupyter Notebook
86	rizalsimb1/training-pipeline A production-grade Retrieval-Augmented Generation (RAG) system built with...	14	Experimental	—	—
87	cornellebivalved856/example-multimodal-rag Search and retrieve information from text, images, and video using unified...	14	Experimental	—	Python
88	sheamusmcg/RAG-Explainer A hands-on, no-code interactive walkthrough of Retrieval-Augmented...	14	Experimental	—	Python
89	AndreaMoschetto/WeaviateSG Just a step by step guide on how to use Weaviate to create your first RAG project	14	Experimental	—	Python
90	robmurphy-systems/rag-system-openai-vector-db End-to-end RAG system using LLMs and vector databases for retrieval,...	14	Experimental	—	—
91	romilandc/langchain-RAG A RAG implementation on LangChain using Chroma vector db as storage. Take...	13	Experimental	8	Python
92	jonathanfavorite/RAGamuffin A lightweight, cross-platform .NET library for building RAG...	13	Experimental	2	C#
93	manishdwibedy/chroma-rag-ollama A complete Retrieval-Augmented Generation (RAG) system running entirely...	12	Experimental	1	Python
94	Nukaze/menu-helper-rag Firecrawl and Pinecone utilization with Gradio interface	12	Experimental	1	Jupyter Notebook
95	Abdelrahman-Elshahed/News_Summerization_Using_RAG--Graduation_Project_DEPI News Summerization RAG system developed with Meta-Llama-3-8B-Instruct (LLM),...	12	Experimental	1	Jupyter Notebook
96	Shraddha22710/The-RAG-Playbook The RAG Playbook is a practical guide and starter kit for...	12	Experimental	1	Python
97	kwame-mintah/python-rag-qdrant-chainlit-playground 🛝 \ ˈplā-ˌgrau̇nd \ an area known or suited for activity of a specified sort.	12	Experimental	1	Python
98	SharvenRane/visual-rag Retrieval-augmented generation pipeline using image embeddings and visual context	11	Experimental	—	Python
99	om-gupta-30/RagLab Experimentation lab for building and testing RAG pipelines	11	Experimental	—	Python
100	mark-veres/ragdoll Implementing Retrieval Augmented Generation (not quite) from scratch.	11	Experimental	—	Python
101	Himanshu0508Raturi/RAG-Learning A comprehensive RAG (Retrieval-Augmented Generation) learning project with...	11	Experimental	—	Jupyter Notebook
102	marcoswastaken/erdos_paware Pawsitive Retrieval RAG Project - Erdos Institute Deep Learning Boot Camp -...	11	Experimental	—	Jupyter Notebook
103	mdh266/rag-jfk Retrieval Augmented Generation on John F. Kennedy Speeches	11	Experimental	—	Jupyter Notebook
104	jairamshegde/My-Awesome-RAG-Reads This is my curated repo regarding Retrieval Augmented Generation(RAG).	11	Experimental	—	—
105	SuyashBhavalkar3/On-The-Fly-Rag-Extension-For-Chrome-Using-Ollama Private RAG Assistant – A Chrome extension that brings intelligent Q&A to...	11	Experimental	—	HTML
106	235471/advanced-rag-orchestrator Production-grade RAG (Retrieval-Augmented Generation) pipeline built with...	11	Experimental	—	Python
107	jastfkjg/simple-rag-system Simple RAG system with LangChain	11	Experimental	—	Python
108	lu-cattai/advanced-rag-orchestrator Modular RAG (Retrieval-Augmented Generation) pipeline using Python,...	11	Experimental	—	Python
109	D-techno/Multimodal-RAG-API A scalable Multimodal Retrieval-Augmented Generation (RAG) API that...	11	Experimental	—	Python
110	monsara/rag-python-rag Local-first RAG system with Ollama, ChromaDB, and Gradio	11	Experimental	—	Python
111	mohsinraza2999/Simple-RAG-Context-Retrieval A simple context retrieval RAG (Retrieval-Augmented Generation) pipeline...	11	Experimental	—	Jupyter Notebook
112	joshuapowell/quick-start-creating-a-vector-database-for-RAG A playground for vector database exploration using Chroma	11	Experimental	—	Jupyter Notebook
113	Fatma-elzahra-Mo/Mini-RAG Mini-RAG is a lightweight implementation of the RAG (Retrieval-Augmented...	11	Experimental	—	Python
114	reynaldineo/explore-rag Notes, experiments, and progress while learning about Retrieval-Augmented...	11	Experimental	—	Python
115	SeyedRumaiz/restuarant-review-rag RAG-based system that generates insights from restaurant reviews using...	11	Experimental	—	Python
116	sbj1198/local-llm-rag-chromadb A local Retrieval-Augmented Generation (RAG) application using Ollama,...	11	Experimental	—	Python
117	ai-deep-learning/doc-rag-harness Document Retrieval Augmented Generation (RAG) Harness	11	Experimental	2	—
118	Shreyas2409/book-rag Built a secure multi-modal retrieval system for document ingestion using...	11	Experimental	—	Python
119	yusupwinata/Naive-RAG An insurance company RAG built using Vector DB (Chroma and FAISS), LLM...	11	Experimental	—	Jupyter Notebook
120	HansikaGunasekara/Orchestrate-a-RAG-prototype This contains my learnings following a DeepLearning.AI course. There I...	11	Experimental	—	Jupyter Notebook
121	Cyanex1702/Retrieval-Augmented-Generation-RAG-Using-Hugging-Face-Embeddings This project demonstrates how to implement a Retrieval-Augmented Generation...	10	Experimental	1	Jupyter Notebook
122	Farhaj499/RAG_with_ChromaDB This project implements an Extractive Question Answering (EQA) system that...	10	Experimental	1	Jupyter Notebook
123	ketanip/rag-qna A implementation of a simple RAG application using a vector database (Chroma...	10	Experimental	1	Jupyter Notebook

Comparisons in this category

LEANN and rag-system-ollama (73 vs 25) LEANN and loco-rag-engine (73 vs 25) ragsearch and ragcar (40 vs 35) ragsearch and Awesome-RAG-Production (40 vs 24)