yahoo/TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
This project helps data scientists and machine learning engineers run their TensorFlow deep learning models on large Apache Spark and Hadoop clusters. You can take your existing TensorFlow code and run it in a distributed fashion, processing vast datasets managed by Spark. It's designed for professionals building and deploying machine learning solutions at scale.
3,859 stars. No commits in the last 6 months. Available on PyPI.
Use this if you need to scale your TensorFlow deep learning training or inference tasks across a distributed cluster using Apache Spark and Hadoop, leveraging existing TensorFlow models.
Not ideal if you are developing small-scale models on a single machine or prefer deep learning frameworks other than TensorFlow.
Stars
3,859
Forks
941
Language
Python
License
Apache-2.0
Category
Last pushed
Jul 10, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/yahoo/TensorFlowOnSpark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
tensorflow/tfx
TFX is an end-to-end platform for deploying production ML pipelines
VowpalWabbit/vowpal_wabbit
Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with...
projectglow/glow
An open-source toolkit for large-scale genomic analysis
Wei-1/Scala-Machine-Learning
No Dependency Scala Machine Learning Algorithm Gallery
yoshoku/rumale
Rumale is a machine learning library in Ruby