benchopt/benchopt
A framework for reproducible, comparable benchmarks
This tool helps machine learning researchers and practitioners rigorously compare different optimization algorithms or machine learning models. You provide the problem definition, datasets, and various solution methods, and it outputs reproducible performance metrics and plots. It is used by those who need to evaluate and select the best algorithm for a specific machine learning task, ensuring fairness and transparency in comparisons.
294 stars. Available on PyPI.
Use this if you need to objectively benchmark and compare the performance of multiple machine learning algorithms or optimization solvers across different datasets and programming languages.
Not ideal if you are looking for a tool to develop or train individual machine learning models rather than comparing existing ones.
Stars
294
Forks
66
Language
Python
License
BSD-3-Clause
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Dependencies
13
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/benchopt/benchopt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
opentensor/bittensor
Internet-scale Neural Networks
trailofbits/fickling
A Python pickling decompiler and static analyzer
BiomedSciAI/fuse-med-ml
A python framework accelerating ML based discovery in the medical field by encouraging code...
mosaicml/streaming
A Data Streaming Library for Efficient Neural Network Training
taoshidev/vanta-network
Vanta Network built on Bittensor