FareedKhan-dev/best-llm-finder-pipeline
Agentic RAG, Multi-Agent Systems, and Vision Reasoning are three pipelines to find the perfect LLM
This project helps AI architects and engineers select the most effective Large Language Models (LLMs) for specific roles within complex AI systems. It takes various LLMs and evaluates their real-world performance in three distinct application scenarios, providing metrics like cost, latency, faithfulness, and relevance. The end result helps you confidently choose the right LLM for each component of your multi-LLM application.
132 stars. No commits in the last 6 months.
Use this if you are building sophisticated AI applications that combine multiple LLMs and need to rigorously test and select the best model for each specialized task.
Not ideal if you are looking for a simple, single-LLM solution or abstract, generalized LLM benchmarks that don't reflect specific application contexts.
Stars
132
Forks
26
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Aug 20, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/FareedKhan-dev/best-llm-finder-pipeline"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
xerrors/Yuxi
结合知识库管理的 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and...
pipeshub-ai/pipeshub-ai
PipesHub is a fully extensible and explainable workplace AI platform for enterprise search and...
xerrors/Yuxi-Know
结合LightRAG 知识库的知识图谱智能体平台。 An agent platform that integrates a LightRAG knowledge base and...
daxa-ai/pebblo
Pebblo enables developers to safely load data and promote their Gen AI app to deployment
gca-americas/way-back-home
🚀 Way Back Home