Leeroo-AI/leeroo_orchestrator
The implementation of "Leeroo Orchestrator: Elevating LLMs Performance Through Model Integration"
This system helps AI developers and researchers integrate and manage multiple large language models (LLMs) to solve complex tasks more effectively and affordably. It takes various LLMs as input and intelligently routes user prompts to the best-suited expert model, producing more accurate and cost-efficient responses. An AI architect or MLOps engineer would use this to build sophisticated AI applications.
No commits in the last 6 months.
Use this if you need to achieve state-of-the-art AI performance by combining the strengths of different LLMs, rather than relying on a single general-purpose model.
Not ideal if you are a casual user looking for a simple, off-the-shelf AI assistant without needing to manage underlying models or infrastructure.
Stars
56
Forks
4
Language
Python
License
MIT
Category
Last pushed
May 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Leeroo-AI/leeroo_orchestrator"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Maximilian-Winter/llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models...
mozilla-ai/any-llm
Communicate with an LLM provider using a single interface
CliDyn/climsight
A next-generation climate information system that uses large language models (LLMs) alongside...
ShishirPatil/gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
OoriData/OgbujiPT
Client-side toolkit for using large language models, including where self-hosted