radiantone/entangle
A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.
This project helps Python developers efficiently execute complex computational tasks by distributing them across multiple CPUs and GPUs, even across different machines. You input your Python functions, decorate them with Entangle's syntax, and it handles the parallel execution and data flow, returning the final computed result. This is ideal for data scientists, machine learning engineers, and researchers who need to speed up computationally intensive Python code.
103 stars. No commits in the last 6 months.
Use this if you need to run multiple Python functions in parallel or distribute complex computational workflows across various compute resources, including GPUs and remote machines, without managing a central scheduler.
Not ideal if your project is not Python-based, or if you require a fully mature, production-ready framework with extensive monitoring and enterprise support, as Entangle is currently in pre-alpha development.
Stars
103
Forks
7
Language
Python
License
MIT
Category
Last pushed
Aug 24, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/radiantone/entangle"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
treeverse/dvc
🦉 Data Versioning and ML Experiments
runpod/runpod-python
🐍 | Python library for RunPod API and serverless worker SDK.
microsoft/vscode-jupyter
VS Code Jupyter extension
4paradigm/OpenMLDB
OpenMLDB is an open-source machine learning database that provides a feature platform computing...
uber/petastorm
Petastorm library enables single machine or distributed training and evaluation of deep learning...