Introduction to Apache Airflow in Python
Mike Metzger
Data Engineer
To run a specific task from command-line:
airflow tasks test <dag_id> <task_id> <date>
To run a full DAG:
airflow dags trigger -e <date> <dag_id>
bash_command
python_callable
python_callable
and provide_context=True
. The callable must accept **kwargs
.filepath
argument and might need mode
or poke_interval
attributesfrom airflow.operators.bash import BashOperator
)help(<Airflow object>)
, ie, help(BashOperator)
Introduction to Apache Airflow in Python