machinelearningnuremberg/HPO-B
[NeurIPS DBT 2021] HPO-B
This is a benchmark for machine learning researchers and practitioners to systematically compare and evaluate the effectiveness of different hyperparameter optimization (HPO) algorithms. It provides a standardized collection of past machine learning model evaluations, allowing you to test how well a new HPO method selects optimal model settings. You feed in your new HPO algorithm, and it returns a list of maximum accuracies achieved over a series of trials, showing how your algorithm performs against established benchmarks.
Use this if you are developing new hyperparameter optimization algorithms and need a reliable, standardized way to compare their performance against a diverse set of real-world machine learning tasks and datasets.
Not ideal if you are looking for a tool to perform hyperparameter optimization for your own machine learning models; this is for benchmarking HPO algorithms themselves.
Stars
41
Forks
12
Language
Python
License
MIT
Category
Last pushed
Nov 08, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/machinelearningnuremberg/HPO-B"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
SimonBlanke/Gradient-Free-Optimizers
Lightweight optimization with local, global, population-based and sequential techniques across...
Gurobi/gurobi-machinelearning
Formulate trained predictors in Gurobi models
emdgroup/baybe
Bayesian Optimization and Design of Experiments
heal-research/pyoperon
Python bindings and scikit-learn interface for the Operon library for symbolic regression.
simon-hirsch/ondil
A package for online distributional learning.