podgorskiy/DareBlopy
Data Reading Blocks for Python
This tool helps deep learning practitioners efficiently load image and other data for training models. It takes collections of files, often small images, stored in ZIP archives or TFRecords, and outputs them as high-performance arrays ready for model training. Machine learning engineers and data scientists working with large datasets will find this useful for accelerating their data pipelines.
104 stars. No commits in the last 6 months. Available on PyPI.
Use this if you are a deep learning engineer or data scientist struggling with slow data loading, especially from archives or network-attached storage, during model training.
Not ideal if your primary concern is traditional file system operations or if your datasets are not primarily composed of many small files like images.
Stars
104
Forks
6
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Dec 07, 2020
Commits (30d)
0
Dependencies
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/podgorskiy/DareBlopy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mrdbourke/pytorch-deep-learning
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
xl0/lovely-tensors
Tensors, for human consumption
stared/livelossplot
Live training loss plot in Jupyter Notebook for Keras, PyTorch and others
dataflowr/notebooks
code for deep learning courses
dvgodoy/PyTorchStepByStep
Official repository of my book: "Deep Learning with PyTorch Step-by-Step: A Beginner's Guide"