oztrkoguz/RAG-Framework-Evaluation
This project aims to compare different Retrieval-Augmented Generation (RAG) frameworks in terms of speed and performance.
This project helps developers compare the effectiveness and speed of various Retrieval-Augmented Generation (RAG) frameworks. By taking a document and a large language model as input, it outputs benchmark results for different frameworks like LlamaIndex, Autogen, and Langchain. A developer building RAG applications would use this to choose the most suitable framework.
No commits in the last 6 months.
Use this if you are a developer needing to decide which RAG framework will offer the best speed and performance for your specific application.
Not ideal if you are an end-user looking for a ready-to-use RAG application rather than a tool for framework evaluation.
Stars
14
Forks
1
Language
Python
License
Apache-2.0
Category
Last pushed
Jul 28, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/oztrkoguz/RAG-Framework-Evaluation"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
vectara/open-rag-eval
RAG evaluation without the need for "golden answers"
DocAILab/XRAG
XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced...
HZYAI/RagScore
⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or...
AIAnytime/rag-evaluator
A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).
microsoft/benchmark-qed
Automated benchmarking of Retrieval-Augmented Generation (RAG) systems