Airflow Dynamic task mapping failing when expand list is empty
I had this airflow DAG which uses airflow’s dynamic task mapping. The DAG is getting the sources for the tasks from a configuration file and some tasks may or may not be executed depending on the run’s time. I am facing an issue that when the task’s config isn’t due after it was previously executed the scheduler isn’t catching up and it’s failing rather than getting skipped. When the scheduler is updated and identifies that the list is empty, it gets skipped.