Local RAG Stacks Vector Databases

Complete, self-contained RAG systems designed to run entirely on local machines using open-source components (Ollama, Chroma, Qdrant) with minimal external dependencies. Includes modular frameworks, orchestration patterns, and full-stack implementations. Does NOT include vector database tools alone, hosted RAG services, domain-specific applications, or single-component libraries.

There are 83 local rag stacks tools tracked. 1 score above 70 (verified tier). The highest-rated is yichuan-w/LEANN at 70/100 with 10,303 stars. 1 of the top 10 are actively maintained.

Get all 83 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=vector-db&subcategory=local-rag-stacks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	yichuan-w/LEANN [MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while...	70	Verified	10,303	Python
2	byerlikaya/SmartRAG Multi-Modal RAG for .NET — query databases, documents, images and audio in...	47	Emerging	21	C#
3	aws-samples/layout-aware-document-processing-and-retrieval-augmented-generation Advanced document extraction and chunking techniques for retrieval augmented...	46	Emerging	115	Jupyter Notebook
4	sourangshupal/simple-rag-langchain Exploring the Basics of Langchain	38	Emerging	14	Jupyter Notebook
5	sion42x/llama-index-milvus-example Open AI APIs with Llama Index and Milvus Vector DB for Retrieval Augmented...	36	Emerging	12	Python
6	Maverick0351a/neuralcache NeuralCache is a drop-in reranker for Retrieval-Augmented Generation (RAG)...	36	Emerging	12	Python
7	vteam27/RagXOllama A Node.js RESTful server for a Retrieval-Augmented Generation (RAG) system...	35	Emerging	13	JavaScript
8	dhivyeshrk/Retrieval-Augmented-Generation-for-news RAG system with real-time news scraping built using mixtral-8x7b, ChromaDB,...	34	Emerging	18	Python
9	ZeusDB/llama-index-vector-stores-zeusdb ZeusDB vector database integration for LlamaIndex. Connect LlamaIndex's RAG...	33	Emerging	4	Python
10	wittyicon29/PWC-RAG A RAG application to search through the recent ML research without going...	33	Emerging	5	Python
11	Aavache/LLMWebCrawler A Web Crawler based on LLMs implemented with Ray and Huggingface. The...	32	Emerging	98	Python
12	noorjotk/local-rag-engine Local RAG app with zero-config Docker setup. FastAPI + Streamlit + Qdrant +...	30	Emerging	9	Python
13	leodeveloper/OllamaRAGLocalLargeLanguage how to create a local RAG (Retrieval Augmented Generation) pipeline that...	29	Experimental	1	Jupyter Notebook
14	kolhesamiksha/Hybrid-Search-RAG This repository contains hybrid-rag a LLMOPS python package	29	Experimental	21	Jupyter Notebook
15	OceanPresentChao/llm-corpus 从零搭建大模型知识库(Build LLM RAG Corpus from scratch)	29	Experimental	86	Python
16	ajeetsk/openai-elasticsearch-rag Retrieval Augmented Generation (RAG) Application to offer Q&A like...	28	Experimental	23	Python
17	prsdm/rag-recipes This repository contains various techniques for Retrieval-Augmented...	27	Experimental	6	Jupyter Notebook
18	hsleonis/rag_langchain_gradio A basic "retrieval augmented generation" (RAG) app with Langchain and OpenAI...	27	Experimental	7	Python
19	romilandc/llama-index-RAG A RAG implementation on Llama Index using Qdrant vector stores as storage. ...	27	Experimental	15	Python
20	jacobmarks/fiftyone-multimodal-rag-plugin Testbed for multimodal retrieval augmented generation techniques with...	25	Experimental	21	Python
21	NisugaJ/rag-test An Advanced RAG Pipeline	25	Experimental	7	Jupyter Notebook
22	rukaiah-edhah/RateMyProf In this project we learned how to use Retrieval-Augmented Generation (RAG)...	24	Experimental	2	JavaScript
23	demstalferez/rag-builder Visual RAG Project Generator - Create customized Retrieval-Augmented...	24	Experimental	4	TypeScript
24	KhaledSharif/openrag openrag = ollama + dspy + chroma	24	Experimental	3	Python
25	huangsam/ragchain Your local RAG stack 🏠	24	Experimental	1	Python
26	NebeyouMusie/RAG-Pipeline In this project I have built a RAG pipeline to showcase how we can augment...	24	Experimental	5	Jupyter Notebook
27	heziqiang/ai-rag A minimal RAG app with local embeddings, retrieval, reranking, and OpenAI...	23	Experimental	1	Python
28	Abeshith/RAG-FundaMentals 🔰 A Comprehensive RAG repository covering basic vanilla RAG techniques,...	22	Experimental	7	Jupyter Notebook
29	d-kleine/Advent_of_HayStack Solutions from the Advent of Haystack 2024 event, exploring Haystack...	22	Experimental	2	Jupyter Notebook
30	SriRammSS/rag-local-app Privacy-first local RAG system — FastAPI + React + pgvector + Ollama. Ingest...	22	Experimental	1	—
31	elifyagmurduran/LLMvectoRAG-product-classifier RAG assisted LLM tool and vector embeddings creator for AI enrichment...	22	Experimental	—	Python
32	rodrigoleitesouza/lore-master-tolkien Aplicação de RAG construída com LangChain, ChromaDB e Ollama, focada na...	22	Experimental	1	Python
33	HalkPapa/LocalDBKit 🗄️ Complete local database development kit with PostgreSQL, MongoDB, Redis,...	22	Experimental	—	Python
34	awesome-ai-tools/curated-rag-tools A curated list of RAG frameworks, vector databases, embedding models, and...	22	Experimental	—	—
35	husaynirfan1/simple-rag Simple RAG system powered by Milvus.	22	Experimental	20	Python
36	boemer00/luthor A RAG system designed for law firms to enable lawyers to efficiently "talk...	21	Experimental	7	Jupyter Notebook
37	raykavin/gorag gorag is a Go library for building Retrieval-Augmented Generation (RAG)...	21	Experimental	—	Go
38	rizalsimb1/lora-finetune A production-grade Retrieval-Augmented Generation (RAG) system built with...	21	Experimental	—	Python
39	serkanyasr/Vec2SFT Automatically generates high-quality instruction-response pairs for...	21	Experimental	2	Python
40	romilandc/langchain-RAG A RAG implementation on LangChain using Chroma vector db as storage. Take...	20	Experimental	8	Python
41	jerrygeorge360/SpotRAG A RAG system for spotify	20	Experimental	3	Python
42	laolarou726/RAG_Demo This is a minimal demo project to show the capabilities of a RAG system...	20	Experimental	8	Python
43	jonathanfavorite/RAGamuffin A lightweight, cross-platform .NET library for building RAG...	19	Experimental	2	C#
44	kwame-mintah/python-rag-qdrant-chainlit-playground 🛝 \ ˈplā-ˌgrau̇nd \ an area known or suited for activity of a specified sort.	19	Experimental	1	Python
45	manishdwibedy/chroma-rag-ollama A complete Retrieval-Augmented Generation (RAG) system running entirely...	18	Experimental	1	Python
46	Nukaze/menu-helper-rag Firecrawl and Pinecone utilization with Gradio interface	18	Experimental	1	Jupyter Notebook
47	nbathreya/Mini-RAG-System RAG System with Vector Database	18	Experimental	1	Python
48	NDDimension/llm-rag-vault 📚 Complete vault for Learning, Building, and Deploying RAG Systems Step by Step	17	Experimental	—	—
49	valinsogna/free-rag-document-search 💰 Zero-cost RAG system for intelligent document search using Ollama local...	17	Experimental	—	Python
50	ketanip/rag-qna A implementation of a simple RAG application using a vector database (Chroma...	17	Experimental	1	Jupyter Notebook
51	Farhaj499/RAG_with_ChromaDB This project implements an Extractive Question Answering (EQA) system that...	17	Experimental	1	Jupyter Notebook
52	Cyanex1702/Retrieval-Augmented-Generation-RAG-Using-Hugging-Face-Embeddings This project demonstrates how to implement a Retrieval-Augmented Generation...	17	Experimental	1	Jupyter Notebook
53	robmurphy-systems/rag-system-openai-vector-db End-to-end RAG system using LLMs and vector databases for retrieval,...	14	Experimental	—	—
54	immohitsen/RAG-Pipeline Basic RAG pipeline for understanding how AI agents work with vector DB and...	14	Experimental	—	Jupyter Notebook
55	Li-Zou/Retrieval-Augmented-Generation Architected and deployed a Retrieval-Augmented Generation (RAG) system	14	Experimental	—	Jupyter Notebook
56	cornellebivalved856/example-multimodal-rag Search and retrieve information from text, images, and video using unified...	14	Experimental	—	Python
57	SharvenRane/visual-rag Retrieval-augmented generation pipeline using image embeddings and visual context	13	Experimental	—	Python
58	235471/advanced-rag-orchestrator Production-grade RAG (Retrieval-Augmented Generation) pipeline built with...	13	Experimental	—	Python
59	jairamshegde/My-Awesome-RAG-Reads This is my curated repo regarding Retrieval Augmented Generation(RAG).	13	Experimental	—	—
60	yusupwinata/Naive-RAG An insurance company RAG built using Vector DB (Chroma and FAISS), LLM...	13	Experimental	—	Jupyter Notebook
61	rizalsimb1/training-pipeline A production-grade Retrieval-Augmented Generation (RAG) system built with...	13	Experimental	—	—
62	lu-cattai/advanced-rag-orchestrator Modular RAG (Retrieval-Augmented Generation) pipeline using Python,...	13	Experimental	—	Python
63	jastfkjg/simple-rag-system Simple RAG system with LangChain	13	Experimental	—	Python
64	marcosotomac/Retrieval-Augmented-Generation A modular RAG pipeline that ingests docs from data/raw, chunks them, embeds...	13	Experimental	2	Python
65	sbj1198/local-llm-rag-chromadb A local Retrieval-Augmented Generation (RAG) application using Ollama,...	13	Experimental	—	Python
66	marcoswastaken/erdos_paware Pawsitive Retrieval RAG Project - Erdos Institute Deep Learning Boot Camp -...	13	Experimental	—	Jupyter Notebook
67	reynaldineo/explore-rag Notes, experiments, and progress while learning about Retrieval-Augmented...	13	Experimental	—	Python
68	joshuapowell/quick-start-creating-a-vector-database-for-RAG A playground for vector database exploration using Chroma	13	Experimental	—	Jupyter Notebook
69	mohsinraza2999/Simple-RAG-Context-Retrieval A simple context retrieval RAG (Retrieval-Augmented Generation) pipeline...	13	Experimental	—	Jupyter Notebook
70	rizalsimb1/embed-server A production-grade Retrieval-Augmented Generation (RAG) system built with...	13	Experimental	—	—
71	swastikmaiti/Intro-to-RAG-with-CODEGEMMA-7B LLM is a very powerful tool. It often performs more than required...	12	Experimental	5	Jupyter Notebook
72	KomangAndika/Improved-RAG-Architecture Improved RAG Architecture using semantic chunker, query input rewriter, and...	11	Experimental	4	Jupyter Notebook
73	joeywhelan/es-rag Elasticsearch demo of naive RAG	11	Experimental	—	Python
74	satendrakumar/simple-rag-example simple rag example	11	Experimental	2	Jupyter Notebook
75	mashhurs/rag-with-elk-and-llama A flask RAG boilerplate to use Elasticsearch as a vector store and connect...	11	Experimental	—	Python
76	nuric/ragchat Retrieval Augmented Generation Example with SemaDB	11	Experimental	—	Python
77	jayita13/Fact_Checked Vectara HHEM model to reduce Hallucination in RAG models	11	Experimental	3	Jupyter Notebook
78	faizanshah14/Basic-RAG-With-OpenAI This project implements a Retrieval-Augmented Generation (RAG) system that...	11	Experimental	4	TypeScript
79	yeukfei02/sanguozhi-llm sanguozhi-llm	11	Experimental	—	Python
80	MarkCodering/rag-cookbook The open-sourced all-in-one cookbook for Retrieval Augmented Generation (RAG)	11	Experimental	—	MDX
81	kottoization/RAG-LLM-for-Education Agentic RAG LLM system for personalized education - master thesis app....	11	Experimental	1	Python
82	mjoudy/RAG_DSPy This repository implements a Retrieval-Augmented Generation (RAG) pipeline...	11	Experimental	1	Python
83	ashvardanian/usearch-langchain-js Using USearch vector-search engine for RAG with LangChain	10	Experimental	2	JavaScript

Comparisons in this category

LEANN and llama-index-RAG (70 vs 27)