LudwigStumpp/llm-leaderboard
A joint community effort to create one central leaderboard for LLMs.
Trying to pick the best Large Language Model (LLM) for your project? This resource lets you compare different LLMs based on their performance across various benchmarks like reasoning, common sense, and knowledge recall. You provide your criteria and get a ranked list of models and their capabilities. This is for AI researchers, data scientists, and anyone evaluating LLMs for deployment or research.
307 stars. No commits in the last 6 months.
Use this if you need to quickly assess and compare the performance of various open LLMs across standardized benchmarks to make an informed selection.
Not ideal if you need a deep dive into the technical architecture or training methodology of specific LLMs rather than their benchmarked performance.
Stars
307
Forks
35
Language
Python
License
Apache-2.0
Category
Last pushed
Aug 23, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/LudwigStumpp/llm-leaderboard"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
open-compass/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral,...
IBM/unitxt
🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the...
lean-dojo/LeanDojo
Tool for data extraction and interacting with Lean programmatically.
GoodStartLabs/AI_Diplomacy
Frontier Models playing the board game Diplomacy.
google/litmus
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application...