Airflow web interface

Introduction to Apache Airflow in Python

Mike Metzger

Data Engineer

Home View

Airflow web UI home dashboard with the left-hand navigation menu

Introduction to Apache Airflow in Python

Dags view

Airflow Dags view page listing all available Dags

Introduction to Apache Airflow in Python

Dags view Dags

Airflow Dags view with the Dag name column highlighted

Introduction to Apache Airflow in Python

Dags view Latest Run

Airflow Dags view with the Latest Run column highlighted

Introduction to Apache Airflow in Python

Dags view runs

Airflow Dags view with the Recent Runs column highlighted

Introduction to Apache Airflow in Python

Dag detail navigation

Airflow Dags view with the update_state Dag link highlighted

Introduction to Apache Airflow in Python

Dags view update_state (Grid)

Airflow Dag detail grid view for the update_state Dag with Grid, Graph, and Code tabs

Introduction to Apache Airflow in Python

Dags view update_state tasks

Airflow Dag grid view showing the three named tasks of update_state

Introduction to Apache Airflow in Python

Dags view update_state (Graph)

Airflow Dag graph view showing tasks and dependencies as a flow chart

Introduction to Apache Airflow in Python

Dags view update_state (Code)

Airflow Dag code view showing the read-only Python source that defines the Dag

Introduction to Apache Airflow in Python

Dag Runs view

Airflow Dag Runs page listing recent runs across all Dags

Introduction to Apache Airflow in Python

Task instances

Airflow Task Instances page listing task runs across all Dags

Introduction to Apache Airflow in Python

Dag Import Errors

Airflow Dags view showing the import error notification button

Introduction to Apache Airflow in Python

Dag Import Errors Detail

Airflow import error detail showing the Dag traceback message

Introduction to Apache Airflow in Python

Audit Log

Airflow UI with the Browse menu open showing the audit log option

Introduction to Apache Airflow in Python

Audit Log

Airflow audit log page listing system events by type

Introduction to Apache Airflow in Python

Web UI vs command line

  • Equally powerful depending on needs
  • Both communicate with the Airflow API-Server
  • Web UI is often easier
  • Command line tool may be easier to access depending on settings

Airflow web UI and command line tool shown side by side

Introduction to Apache Airflow in Python

Let's practice!

Introduction to Apache Airflow in Python

Preparing Video For Download...