verifai/multiLLM
🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐
This tool helps technical professionals like engineers or researchers compare responses from different large language models (LLMs) side-by-side. You provide a prompt and API keys for the LLMs you want to use, and it returns each model's answer, along with an explanation of which response is better and why. This is useful for quickly evaluating and choosing the best LLM for a specific coding task, content generation, or problem-solving.
No commits in the last 6 months. Available on PyPI.
Use this if you need to quickly get and compare responses from multiple large language models for a single prompt and want an automated ranking of the best answer.
Not ideal if you need a complex, production-ready system for routing requests to LLMs or for sophisticated A/B testing with detailed metrics.
Stars
83
Forks
9
Language
Python
License
MIT
Category
Last pushed
Nov 06, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/verifai/multiLLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NX-AI/xlstm
Official repository of the xLSTM.
sinanuozdemir/oreilly-hands-on-gpt-llm
Mastering the Art of Scalable and Efficient AI Model Deployment
DashyDashOrg/pandas-llm
Pandas-LLM
wxhcore/bumblecore
An LLM training framework built from the ground up, featuring a custom BumbleBee architecture...
MiniMax-AI/MiniMax-01
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model &...