DataSQRL/sqrl
Data Pipeline Automation Framework to build MCP servers, data APIs, and data lakes with SQL.
DataSQRL helps data engineers and architects automate the creation of data pipelines, data APIs, and data lakes. You define your data processing logic using SQL, and DataSQRL takes those instructions to automatically generate the necessary deployment artifacts, like database schemas and data stream definitions. This allows you to easily build reliable systems for real-time data access and analysis.
207 stars.
Use this if you need to build robust, scalable data pipelines and APIs with strong data consistency guarantees, and prefer to define your processing logic using SQL.
Not ideal if you're looking for a simple data scripting tool for one-off analyses or don't need automated deployment of complex data infrastructure.
Stars
207
Forks
23
Language
Java
License
Apache-2.0
Category
Last pushed
Mar 18, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/DataSQRL/sqrl"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
growthbook/growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
koopjs/koop
Transform, query, and download geospatial data on the web.
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.