Build DAGs Using the Taskflow API in Apache Airflow

What you'll learn

Managing and optimizing workflows in Airflow can be challenging without a clear understanding of how to use operators and the Taskflow API effectively. In this course, Build DAGs Using the Taskflow API in Apache Airflow, you’ll gain the ability to create directed acyclic graphs (DAGs) for streamlined data validation, filtering, and passing. First, you’ll set up a simple DAG, with no conditional operations, using Airflow operators for data processing and validation and pass data using XComs. Next, you’ll convert the same DAG to use the Taskflow API using the @task and @dag decorators. You’ll learn how to perform data passing using the “return” keyword, and collect and access the data passed using input arguments. Finally you'll build a more complex DAG which includes conditional branching workflows first using operators and then using the Taskflow API. When you’re finished with this course, you’ll have the skills and knowledge needed to use the Taskflow API to enhance and optimize your workflows efficiently.

Table of contents