Develop-Packt/Introduction-to-Workflow-Management-Platform-Airflow

In this module, you will look at creating a pipeline by breaking down a job into multiple executable stages. You will implement a simple linear pipeline and then move further by implementing a multi-stage data pipeline, then automate the multi-stage pipeline using Bash. Further to this you will improve the efficiency by running the pipeline as an asynchronous process using the ETL workflow and then create DAG for the pipeline and implement it using Airflow.