How to add trigger for run dag into another dag (with decorators) in Airflow?
I got 2 dags in same dags folder:
How to add trigger for run dag into another dag (with decorators) in Airflow?
I got 2 dags in same dags folder:
importing airflow automatically creates airflow directory
I’ve noticed that whenever I import airflow in Python, it automatically creates an airflow directory in my home directory. Literally just this
How to get requirements from my Airflow python environment
How to perform pip freeze > requirements.txt for Airflow environment?
Or get list of packages by another way.
Fetch and Store Airflow Logs
Is there any way to fetch the airflow logs programmatically and store it in some variable ? (in the form of strings)
I want to use the logs stored inside that variable to use all the messages present inside the ERROR logging level in airflow.
How to avoid error (‘cannot mix list and non-list, non-null values’, ‘Conversion failed for column position with type object’) in Airflow?
I got this task in my dag:
How to use class in Airflow dag?
I make custom library for working with API.
But I get error then trying to use it in my dag.
Airflow task_group with list from previous task
Based on the following answer to a similar question, I’m trying to create an airflow task_group
based of an output from a previous task.
More precisely, my first task uses the ExecuteSQLQueryOperator
which returns a list. And I want to use this list to map it to a task group. However I always end up with a TypeError: 'XComArg' object is not iterable
.
A task won’t trigger after a BranchPythonOperator calls it
I’m trying to achieve max performance in the case I’m working on.
I’m parsing jsons and when the first three tasks:
How to use TriggerDagRunOperator dynamically in Airflow
I want to trigger dags dynamically in Airflow using TriggerDugRunOperator, but I have a PythonOperator
that I want to run before triggering a dag. For example, it can be a config like below,