rasbt/b3-basic-batchsize-benchmark
Experiments for the blog post "No, We Don't Have to Choose Batch Sizes As Powers Of 2"
This project helps machine learning engineers and researchers quickly benchmark how different batch sizes impact the training speed of neural networks. You provide a deep learning model and training parameters, and it outputs the training time for various batch sizes. This allows practitioners to choose an optimal batch size for their GPU hardware.
No commits in the last 6 months.
Use this if you are a machine learning practitioner looking to optimize the training speed of your deep learning models by understanding the performance impact of different batch sizes on your specific GPU.
Not ideal if you are looking for a comprehensive deep learning optimization suite or if you are not directly involved in neural network training and performance tuning.
Stars
20
Forks
4
Language
Python
License
—
Category
Last pushed
Jul 05, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/rasbt/b3-basic-batchsize-benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference...
helmholtz-analytics/heat
Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
horovod/horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
bsc-wdc/dislib
The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.