Congratulations!

Introduction to Apache Airflow in Python

Mike Metzger

Data Engineer

What we've learned

• Workflows / DAGs
• Operators (BashOperator, PythonOperator, EmailOperator)
• Tasks
• Dependencies / Bitshift operators
• Sensors
• Scheduling

• SLAs / Alerting
• Templates
• Branching
• Airflow command line / UI
• Airflow executors
• Debugging / Troubleshooting

Next steps

• Setup your own environment for practice
• Look into other operators / sensors
• Experiment with dependencies
• Look into parts of Airflow we didn't cover
  • XCom
  • Connections
  • Refer to docs for more
• Keep building workflows!

References

• Airflow Documentation
  • https://airflow.apache.org/docs/
• Airflow Community Slack channel
• Countless blogs / newsletters
• Future DataCamp courses

Thank you!

Introduction to Apache Airflow in Python