PrefectHQ/prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

95
/ 100
Verified

Prefect helps data engineers and developers build reliable, automated data pipelines. You define a series of steps in Python, and Prefect ensures they run smoothly, even handling errors, retries, and scheduled execution. It takes your Python scripts and turns them into robust, observable data workflows, providing monitoring and tracking of their activity.

21,898 stars and 9,593,004 monthly downloads. Used by 5 other packages. Actively maintained with 282 commits in the last 30 days. Available on PyPI.

Use this if you need to automate complex data processing tasks, ensuring they run consistently and recover from failures without manual intervention.

Not ideal if you are looking for a low-code or no-code solution for simple task scheduling without needing robust error handling or complex workflow logic.

data-engineering workflow-automation data-pipelines ETL data-orchestration
Maintenance 25 / 25
Adoption 25 / 25
Maturity 25 / 25
Community 20 / 25

How are scores calculated?

Stars

21,898

Forks

2,174

Language

Python

License

Apache-2.0

Last pushed

Mar 19, 2026

Monthly downloads

9,593,004

Commits (30d)

282

Dependencies

56

Reverse dependents

5

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/PrefectHQ/prefect"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.