apache/wayang
Apache Wayang is the first cross-platform data processing system.
This project helps data engineers and software developers process data across various platforms like Spark, Flink, and Postgres, all through a single interface. You provide your data processing logic using Wayang's APIs (Java, Scala, or SQL), and it automatically selects and orchestrates the best platform(s) for the task. This frees you from needing to learn the specifics of each underlying data system.
262 stars.
Use this if you need to run complex data processing jobs that could benefit from different execution engines, but you want to avoid manually integrating and managing multiple distinct systems.
Not ideal if your data processing needs are simple and consistently confined to a single, well-understood platform, as the overhead of cross-platform orchestration might not be necessary.
Stars
262
Forks
126
Language
Java
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/apache/wayang"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
knime/knime-core
KNIME Analytics Platform
sparklyr/sparklyr
R interface for Apache Spark
quixio/quix-streams
Python Streaming DataFrames for Kafka
jtablesaw/tablesaw
Java dataframe and visualization library
RumbleDB/rumble
Quick start: pip install jsoniq ⛈️ RumbleDB 2.0.0 "Lemon Ironwood" 🌳 for Apache Spark | Run...