fugue-project/fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
This helps data professionals and scientists scale their data processing tasks without rewriting code. It takes existing Python, Pandas, or SQL code and runs it efficiently on large datasets using powerful distributed systems like Spark, Dask, or Ray. This is ideal for data engineers and data scientists working with big data who need to switch between local and distributed environments seamlessly.
2,142 stars. Used by 3 other packages. Available on PyPI.
Use this if you need to run your data processing code on large datasets or in a distributed environment, but want to keep your code in Python, Pandas, or SQL without extensive rewrites for each system.
Not ideal if your data processing needs are small-scale and can be handled entirely within a single machine using standard Pandas or Python.
Stars
2,142
Forks
101
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Dependencies
3
Reverse dependents
3
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/fugue-project/fugue"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
heavyai/heavydb
HeavyDB (formerly MapD/OmniSciDB)
BlazingDB/blazingsql
BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
intel/hdk
A low-level execution library for analytic data processing.
PatrickPontes44/tiny-panda
tiny-panda is a lightweight JavaScript library inspired by Python’s pandas. It provides a...