Rayato159/rust-llm-rag
To implement LLM as a services.
This project helps developers integrate Large Language Models (LLMs) with custom knowledge bases. It takes user queries, retrieves relevant information from a vector database (like a company's internal documents), and uses that information to generate more accurate and context-aware responses from an LLM. Developers building AI-powered applications or services that require models to 'remember' specific historical or proprietary data would use this.
No commits in the last 6 months.
Use this if you are a developer looking to build or host a custom LLM service that can reference specific, external knowledge bases for generating responses.
Not ideal if you are an end-user simply looking to chat with an off-the-shelf LLM or if you don't have programming experience.
Stars
38
Forks
6
Language
Rust
License
—
Category
Last pushed
Apr 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/Rayato159/rust-llm-rag"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
copilot-extensions/rag-extension
An example extension in go using retrevial-augmented generation
wangle201210/go-rag
基于eino+gf+vue实现知识库的rag
LlamaEdge/rag-api-server
A RAG API server written in Rust following OpenAI specs
timescale/pgai
A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL
ca-srg/ragent
RAGent - A CLI tool for building RAG systems with hybrid search (BM25 + vector) using Amazon S3...