google/sedpack
Sedpack - Scalable and efficient data packing
Sedpack helps machine learning engineers and data scientists efficiently package large datasets for training models. It takes your raw or preprocessed data and transforms it into a highly optimized, compact format, ready for use with TensorFlow. This improves data loading speed and overall training performance for your ML workflows.
Available on PyPI.
Use this if you are a machine learning practitioner struggling with slow data loading, large dataset sizes, or inefficient data pipelines during model training with TensorFlow.
Not ideal if you are not working with large datasets, TensorFlow, or if your primary bottleneck is not data loading and packaging efficiency.
Stars
34
Forks
10
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Dependencies
12
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/google/sedpack"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference...
helmholtz-analytics/heat
Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
horovod/horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
bsc-wdc/dislib
The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.