Modular RAG Frameworks RAG Tools

Tools and frameworks for building customizable RAG chatbots with pluggable components, multiple interfaces/adapters, and reusable architecture patterns. Does NOT include single-purpose domain applications, pre-built solutions for specific platforms, or frameworks primarily optimized for a particular vector database or LLM provider.

There are 56 modular rag frameworks tools tracked. The highest-rated is cohere-ai/quick-start-connectors at 38/100 with 154 stars.

Get all 56 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=rag&subcategory=modular-rag-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	cohere-ai/quick-start-connectors This open-source repository offers reference code for integrating workplace...	38	Emerging	154	Python
2	Niez-Gharbi/PDF-RAG-with-Llama2-and-Gradio Build your own Custom RAG Chatbot using Gradio, Langchain and Llama2	37	Emerging	80	Python
3	ricard1406/Little_Agent_Chatbot Simple AI agent RAG chatbot based on Python, Ollama, Langchain, Gradio....	37	Emerging	3	Python
4	GURPREETKAURJETHRA/RAG-Based-LLM-Chatbot RAG Based LLM Chatbot Built using Open Source Stack (Llama 3.2 Model, BGE...	32	Emerging	17	Python
5	tedzhao226/ato_chatbot Australian Tax Office (ATO) chatbot using LlamaIndex RAG and OpenAI....	30	Emerging	22	Python
6	alexander-zuev/kollektiv-rag The open source chat powered by LLMs with RAG. Kollektiv makes it easy to...	26	Experimental	88	Python
7	dev-kanika/llm-chatbot-multimodal-rag-bioasq Multimodal chatbot project using five LLM-based approaches including RAG,...	26	Experimental	3	Jupyter Notebook
8	libraryofcelsus/Hierarchical_RAG_Chatbot RAG with branching search based on knowledge domains. Uses Qdrant or Marqo...	25	Experimental	5	Python
9	Abhidroid87/chatbot A chatbot capable of performing tasks like search, document parsing, and...	25	Experimental	1	TypeScript
10	CsabaConsulting/ThruThinkCohereWeaviateChat Cohere and Weaviate powered ThruThink support chat on Streamlit	24	Experimental	1	Python
11	soniawmeyer/WanderChat A Comparison of LLM Chat Bot Implementation Methods with Travel Use Case	24	Experimental	3	Jupyter Notebook
12	mitjafelicijan/lobotomizer RAG Chatbot for World of Warcraft with REST API and Discord bot.	24	Experimental	1	Lua
13	quoctata2911/RAG-based-ChatBot-System RAG-based chatbot system using open-source models and context-aware...	23	Experimental	2	Python
14	nlink-jp/sai A context-aware Slack bot with RAG memory and natural language command...	22	Experimental	—	Python
15	nur-zaman/LLM-RAG-Bot A Discord bot that seamlessly executes bleeding-edge Retrieval-Augmented...	21	Experimental	13	Python
16	yas-sim/openvino-llm-chatbot-rag LLM chatbot example using OpenVINO with RAG (Retrieval Augmented Generation).	21	Experimental	7	Python
17	OpenRL-Lab/ChatAgent A Python-based agent framework for large language models.	20	Experimental	14	Python
18	NinoRisteski/HubermanAnswers Ask Dr. Andrew Huberman questions and receive answers directly from his...	20	Experimental	17	Python
19	adityamkk/crawler-chatbot LLM RAG powered chatbot paired with a webscraper	19	Experimental	—	TypeScript
20	Samashi47/FSTT-LLM-Chat-Bot A chat bot for the Faculty of Sciences and Technologies of Tangier. Using...	18	Experimental	5	TypeScript
21	urooj-akmal/Onboarding-Chatbot A Flask-based onboarding chatbot utilizing Retrieval-Augmented Generation...	18	Experimental	6	Python
22	Smit1400/EcoMed-Expert-llama-RAG-chainlit-FAISS An advanced environmental science chatbot powered by cutting-edge...	18	Experimental	6	Python
23	mindfiredigital/OpenRecap Transforming meeting discussions into actionable recaps.	16	Experimental	14	Python
24	mahdjourOussama/Chatbot This repository contains a modular, scalable chatbot system leveraging LLMs...	16	Experimental	4	Python
25	torhaa1/LLM_RAG_Chatbots Exploring LLM RAG applications.	15	Experimental	2	Jupyter Notebook
26	selimcavas/LLM-SEC-Report-Analyzer LLM Supported SEC Report Analyzer Chat Assistant	15	Experimental	2	Python
27	sar-dul/RAG-Chatbot RAG-powered document chatbot using Llama 3.2 with hybrid retrieval,...	15	Experimental	2	Jupyter Notebook
28	fltb/bot-the-defect Modular role‑playing chatbot framework built on LlamaIndex & Melobot —...	15	Experimental	6	Python
29	itsjavi/llama3-rag-chatbot Chatbot UI that can answer questions about any webpage. Built with...	15	Experimental	1	Python
30	hordiales/llm-rag-assistant-localhost Local chatbot (no API) designed to answer questions in Spanish using your...	15	Experimental	—	Python
31	iamvisheshsrivastava/geniebot GenAI Telegram Bot with RAG-based Q&A and Image Captioning using local LLMs...	14	Experimental	—	Python
32	batoutou/Local_RAG_LLM I built a chatbot based on LLaMA 3 and stable diffusion. You can ask him...	14	Experimental	7	Python
33	sortphy/chatGPDUNE Dune themed RAG based LLM ChatBot \| Using Ollama, DeepSeek, Neo4J and LangChain	14	Experimental	3	Python
34	happyche/ChatBot---RAG-Llama2 RAG + Llama2 + LangChain Chatbot	14	Experimental	—	Python
35	anirbanbasu/tldrlc Too Long, Didn't Read, Let's Chat	12	Experimental	3	Python
36	sayujshah/DeepSeekExcelAnalyzer An LLM-based chatbot for analyzing Excel documents using DeepSeek R1 reasoning model	12	Experimental	4	Python
37	engichang1467/RAG-chatbot-cohere Retrieval Augmented Generation Chatbot with Cohere and HuggingFace 🤗	12	Experimental	3	Python
38	chaba-victor/LLama2-chatbot A chatbot implementation of RAG, that runs locally on a CPU, using Langchain...	12	Experimental	3	Python
39	vykhovanets/RAG-playground Local-first web app for experimentation with LLMs	12	Experimental	3	Python
40	Koldim2001/RAG_LLM Чат-бот с LLL + RAG	12	Experimental	10	Python
41	JHansiduYapa/RAG-Powered-Customer-Support-for-E-commerce A RAG-powered customer support chatbot using LlamaIndex, Ollama, and...	11	Experimental	2	Jupyter Notebook
42	TomSOWI/PoliticsToYou RAG based chatbot on the speeches of the German Parliament	11	Experimental	—	Python
43	kavindukalinga/Opensource-LLM-RAG-Chatbot This repository hosts an NLP project aimed at crafting a chatbot capable of...	11	Experimental	2	Jupyter Notebook
44	wandb/wandb-content-navigator LLM-powered RAG slackbot and endpoint to suggest Weights & Biases content	11	Experimental	2	Python
45	yash9439/Qdrant-DeepsetHaystack-Llama3-QnA-ChatBot Question-Answering ChatBot leveraging Qdrant for vector search, Deepset...	11	Experimental	2	Jupyter Notebook
46	Rahul2991/PaperLens_Multimodal_RAG PaperLens Multimodal RAG Bot is an AI-powered chatbot utilizing Llama 3.2 vision	11	Experimental	—	Python
47	jvscursulim/rag_project_llm_zoomcamp_2024 A Gamedev Chatbot created for the LLM Zoomcamp 2024 project	11	Experimental	—	Python
48	bjukic2/Python-RAG-Chatbot Local RAG Chatbot using Llama3.1 model	11	Experimental	—	TypeScript
49	SalmaElFathi/FSTS-Mobile-App FSTS Mobile App with intelligent chatbot (RAG/LLM), real-time news feed, and...	11	Experimental	—	Dart
50	MRX760/Personal-chatbot Personal chatbot using LLMs currently supporting huggingface API and Nvidia...	11	Experimental	—	Python
51	ziweek/two-armies-chat-once 💼 Work Project - 🤖🪖 A Korean-English bilingual RAG Chatbot for Regulations...	11	Experimental	—	Python
52	daniau23/medical_chatbot Use of LLMs for the retrieval of relevant documents and texts when queried.	11	Experimental	—	Jupyter Notebook
53	barwojcik/local_chatbots A collection of Flask-based chatbot applications powered by Large Language...	11	Experimental	—	Python
54	dcarpintero/create-cohere-connector Bootstrap a custom Cohere Connector to enhance Cohere's LLMs with dynamic,...	10	Experimental	1	Jinja
55	soumyadeepbose/Jessup-Cellar-RAG-App Jessup's Helper is a Retrieval Based Chatbot that uses a pre-trained...	10	Experimental	1	Python
56	nick-konovalchuk/christian-compass This is a Christian Apologetic chatbot prototype.	10	Experimental	1	Python

Comparisons in this category

PDF-RAG-with-Llama2-and-Gradio and RAG-Based-LLM-Chatbot (37 vs 32) RAG-Based-LLM-Chatbot and LLM-RAG-Bot (32 vs 21) RAG-Based-LLM-Chatbot and openvino-llm-chatbot-rag (32 vs 21) RAG-Based-LLM-Chatbot and llm-chatbot-multimodal-rag-bioasq (32 vs 26) RAG-Based-LLM-Chatbot and RAG-based-ChatBot-System (32 vs 23)