Kaleidophon/deep-significance
Enabling easy statistical significance testing for deep neural networks.
This tool helps machine learning practitioners confidently compare the performance of different deep neural network models. By analyzing multiple runs of your models, it determines if one model truly performs better than another, rather than relying on single-score comparisons that can be misleading due to random chance. This is crucial for anyone developing or evaluating deep learning models in fields like NLP, computer vision, or reinforcement learning.
339 stars. No commits in the last 6 months.
Use this if you need to rigorously prove that a new deep learning model or algorithm is statistically better than an existing one, especially when model performance can be variable.
Not ideal if you are looking for tools to improve model training speed, explore new architectures, or visualize model internals, as its focus is solely on statistical comparison of trained models.
Stars
339
Forks
20
Language
Python
License
GPL-3.0
Category
Last pushed
Jul 01, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Kaleidophon/deep-significance"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GAA-UAM/scikit-fda
Functional Data Analysis Python package
mlr-org/mlr3
mlr3: Machine Learning in R - next generation
mlr-org/mlr3extralearners
Extra learners for use in mlr3.
mlr-org/mlr3book
Online version of Bischl, B., Sonabend, R., Kotthoff, L., & Lang, M. (Eds.). (2024). "Applied...
mlr-org/mlr3learners
Recommended learners for mlr3