Modular RAG Frameworks RAG Tools

Tools and frameworks for building customizable RAG chatbots with pluggable components, multiple interfaces/adapters, and reusable architecture patterns. Does NOT include single-purpose domain applications, pre-built solutions for specific platforms, or frameworks primarily optimized for a particular vector database or LLM provider.

There are 66 modular rag frameworks tools tracked. The highest-rated is cohere-ai/quick-start-connectors at 45/100 with 154 stars.

Get all 66 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=rag&subcategory=modular-rag-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	cohere-ai/quick-start-connectors This open-source repository offers reference code for integrating workplace...	45	Emerging	154	Python
2	Niez-Gharbi/PDF-RAG-with-Llama2-and-Gradio Build your own Custom RAG Chatbot using Gradio, Langchain and Llama2	44	Emerging	80	Python
3	ricard1406/Little_Agent_Chatbot Simple AI agent RAG chatbot based on Python, Ollama, Langchain, Gradio....	40	Emerging	3	Python
4	GURPREETKAURJETHRA/RAG-Based-LLM-Chatbot RAG Based LLM Chatbot Built using Open Source Stack (Llama 3.2 Model, BGE...	39	Emerging	17	Python
5	tedzhao226/ato_chatbot Australian Tax Office (ATO) chatbot using LlamaIndex RAG and OpenAI....	37	Emerging	22	Python
6	alexander-zuev/kollektiv-rag The open source chat powered by LLMs with RAG. Kollektiv makes it easy to...	33	Emerging	88	Python
7	libraryofcelsus/Hierarchical_RAG_Chatbot RAG with branching search based on knowledge domains. Uses Qdrant or Marqo...	32	Emerging	5	Python
8	dev-kanika/llm-chatbot-multimodal-rag-bioasq Multimodal chatbot project using five LLM-based approaches including RAG,...	32	Emerging	3	Jupyter Notebook
9	CsabaConsulting/ThruThinkCohereWeaviateChat Cohere and Weaviate powered ThruThink support chat on Streamlit	31	Emerging	1	Python
10	soniawmeyer/WanderChat A Comparison of LLM Chat Bot Implementation Methods with Travel Use Case	31	Emerging	3	Jupyter Notebook
11	quoctata2911/RAG-based-ChatBot-System RAG-based chatbot system using open-source models and context-aware...	30	Emerging	2	Python
12	mitjafelicijan/lobotomizer RAG Chatbot for World of Warcraft with REST API and Discord bot.	30	Emerging	1	Lua
13	nur-zaman/LLM-RAG-Bot A Discord bot that seamlessly executes bleeding-edge Retrieval-Augmented...	28	Experimental	13	Python
14	yas-sim/openvino-llm-chatbot-rag LLM chatbot example using OpenVINO with RAG (Retrieval Augmented Generation).	28	Experimental	7	Python
15	NinoRisteski/HubermanAnswers Ask Dr. Andrew Huberman questions and receive answers directly from his...	27	Experimental	17	Python
16	Abhidroid87/chatbot A chatbot capable of performing tasks like search, document parsing, and...	27	Experimental	1	TypeScript
17	OpenRL-Lab/ChatAgent A Python-based agent framework for large language models.	27	Experimental	14	Python
18	Smit1400/EcoMed-Expert-llama-RAG-chainlit-FAISS An advanced environmental science chatbot powered by cutting-edge...	25	Experimental	6	Python
19	urooj-akmal/Onboarding-Chatbot A Flask-based onboarding chatbot utilizing Retrieval-Augmented Generation...	25	Experimental	6	Python
20	Samashi47/FSTT-LLM-Chat-Bot A chat bot for the Faculty of Sciences and Technologies of Tangier. Using...	25	Experimental	5	TypeScript
21	mahdjourOussama/Chatbot This repository contains a modular, scalable chatbot system leveraging LLMs...	23	Experimental	4	Python
22	nlink-jp/sai A context-aware Slack bot with RAG memory and natural language command...	22	Experimental	—	Python
23	sar-dul/RAG-Chatbot RAG-powered document chatbot using Llama 3.2 with hybrid retrieval,...	22	Experimental	2	Jupyter Notebook
24	torhaa1/LLM_RAG_Chatbots Exploring LLM RAG applications.	22	Experimental	2	Jupyter Notebook
25	selimcavas/LLM-SEC-Report-Analyzer LLM Supported SEC Report Analyzer Chat Assistant	22	Experimental	2	Python
26	itsjavi/llama3-rag-chatbot Chatbot UI that can answer questions about any webpage. Built with...	22	Experimental	1	Python
27	adityamkk/crawler-chatbot LLM RAG powered chatbot paired with a webscraper	21	Experimental	—	TypeScript
28	fltb/bot-the-defect Modular role‑playing chatbot framework built on LlamaIndex & Melobot —...	21	Experimental	6	Python
29	batoutou/Local_RAG_LLM I built a chatbot based on LLaMA 3 and stable diffusion. You can ask him...	21	Experimental	7	Python
30	mindfiredigital/OpenRecap Transforming meeting discussions into actionable recaps.	21	Experimental	14	Python
31	sortphy/chatGPDUNE Dune themed RAG based LLM ChatBot \| Using Ollama, DeepSeek, Neo4J and LangChain	20	Experimental	3	Python
32	Koldim2001/RAG_LLM Чат-бот с LLL + RAG	19	Experimental	10	Python
33	sayujshah/DeepSeekExcelAnalyzer An LLM-based chatbot for analyzing Excel documents using DeepSeek R1 reasoning model	19	Experimental	4	Python
34	engichang1467/RAG-chatbot-cohere Retrieval Augmented Generation Chatbot with Cohere and HuggingFace 🤗	19	Experimental	3	Python
35	chaba-victor/LLama2-chatbot A chatbot implementation of RAG, that runs locally on a CPU, using Langchain...	19	Experimental	3	Python
36	wandb/wandb-content-navigator LLM-powered RAG slackbot and endpoint to suggest Weights & Biases content	18	Experimental	2	Python
37	JHansiduYapa/RAG-Powered-Customer-Support-for-E-commerce A RAG-powered customer support chatbot using LlamaIndex, Ollama, and...	18	Experimental	2	Jupyter Notebook
38	yash9439/Qdrant-DeepsetHaystack-Llama3-QnA-ChatBot Question-Answering ChatBot leveraging Qdrant for vector search, Deepset...	18	Experimental	2	Jupyter Notebook
39	kavindukalinga/Opensource-LLM-RAG-Chatbot This repository hosts an NLP project aimed at crafting a chatbot capable of...	18	Experimental	2	Jupyter Notebook
40	unnatii14/Smart-Chatbot A smart LLM chatbot powered by Retrieval-Augmented Generation (RAG) and...	15	Experimental	2	Jupyter Notebook
41	MatthieuGillieron/chatbot AI chatbot with multiple trending LLMs and a RAG option to chat with your...	14	Experimental	8	Python
42	iamvisheshsrivastava/geniebot GenAI Telegram Bot with RAG-based Q&A and Image Captioning using local LLMs...	14	Experimental	—	Python
43	anirbanbasu/tldrlc Too Long, Didn't Read, Let's Chat	14	Experimental	3	Python
44	happyche/ChatBot---RAG-Llama2 RAG + Llama2 + LangChain Chatbot	14	Experimental	—	Python
45	vykhovanets/RAG-playground Local-first web app for experimentation with LLMs	14	Experimental	3	Python
46	daniau23/medical_chatbot Use of LLMs for the retrieval of relevant documents and texts when queried.	13	Experimental	—	Jupyter Notebook
47	ziweek/two-armies-chat-once 💼 Work Project - 🤖🪖 A Korean-English bilingual RAG Chatbot for Regulations...	13	Experimental	—	Python
48	MRX760/Personal-chatbot Personal chatbot using LLMs currently supporting huggingface API and Nvidia...	13	Experimental	—	Python
49	Rahul2991/PaperLens_Multimodal_RAG PaperLens Multimodal RAG Bot is an AI-powered chatbot utilizing Llama 3.2 vision	13	Experimental	—	Python
50	TomSOWI/PoliticsToYou RAG based chatbot on the speeches of the German Parliament	13	Experimental	—	Python
51	SalmaElFathi/FSTS-Mobile-App FSTS Mobile App with intelligent chatbot (RAG/LLM), real-time news feed, and...	13	Experimental	—	Dart
52	jvscursulim/rag_project_llm_zoomcamp_2024 A Gamedev Chatbot created for the LLM Zoomcamp 2024 project	13	Experimental	—	Python
53	bjukic2/Python-RAG-Chatbot Local RAG Chatbot using Llama3.1 model	13	Experimental	—	TypeScript
54	dcarpintero/create-cohere-connector Bootstrap a custom Cohere Connector to enhance Cohere's LLMs with dynamic,...	12	Experimental	1	Jinja
55	sjy-dv/VPHO VPHO is a RAG methodology that allows LLMs to be context-aware and easily...	12	Experimental	5	Python
56	nick-konovalchuk/christian-compass This is a Christian Apologetic chatbot prototype.	12	Experimental	1	Python
57	anishchapagain/OpenLLM-Langchain_RAG LLM tests	12	Experimental	2	Jupyter Notebook
58	soumyadeepbose/Jessup-Cellar-RAG-App Jessup's Helper is a Retrieval Based Chatbot that uses a pre-trained...	12	Experimental	1	Python
59	quickSilverShanks/DataWhiz-Chat A RAG-based language model enabling intelligent conversations with...	11	Experimental	—	Jupyter Notebook
60	jacKlinc/newspaper-chatbot Uses newspaper articles and an LLM give a human-readable response.	11	Experimental	—	Jupyter Notebook
61	rishisim/Chitti-Chatbot Chitti is a retrieval-augmented-generation (RAG) application which utilizes...	11	Experimental	—	Python
62	barwojcik/local_chatbots A collection of Flask-based chatbot applications powered by Large Language...	11	Experimental	—	Python
63	DragomirBozoki/kalliope-dual-llm-chatbot Multilingual voice assistant powered by a dual-LLM architecture using...	11	Experimental	2	Python
64	hordiales/llm-rag-assistant-localhost Local chatbot (no API) designed to answer questions in Spanish using your...	11	Experimental	—	Python
65	SathvikNayak123/Agentic-RAG Agentic RAG with Llama-3.1-8b model Fine-tuned on medical conversational dataset	11	Experimental	3	Jupyter Notebook
66	KianoushAmirpour/RAG_Chatbot Leveraged advanced RAG techniques and a quantized version of LLaMA-3 with...	10	Experimental	2	Python

Comparisons in this category

PDF-RAG-with-Llama2-and-Gradio and RAG-Based-LLM-Chatbot (44 vs 39) RAG-Based-LLM-Chatbot and LLM-RAG-Bot (39 vs 28) RAG-Based-LLM-Chatbot and openvino-llm-chatbot-rag (39 vs 28) RAG-Based-LLM-Chatbot and llm-chatbot-multimodal-rag-bioasq (39 vs 32) RAG-Based-LLM-Chatbot and RAG-based-ChatBot-System (39 vs 30) llm-chatbot-multimodal-rag-bioasq and RAG-based-ChatBot-System (32 vs 30)