MWAA missing packages
I am trying to add a task using the SqlToS3Operator and running into trouble running it. I get:
Airflow Clearing Tasks
I am running structured spark streaming job and using EmrContainerOperator to trigger the spark job.
My requirement is to re-trigger airflow task which has been created using EmrContainerOperator every time the task fails. This needs to be achieved programmatically.