I’m building an ETL for fetching data from an API, transforming it and uploading it in mongodb.
I use pyspark to distribute this process and I’m trying to use airflow to automate it.