I am fetching ad accounts, campaigns, adsets and ads from meta business suite using graph api. I now have a pipeline to fetch it totally and it runs every week. But now i want to make a new pipeline which basically adds additional data on top of what was fetched earlier.
I am using the last fetch timestamp for each component and then extracting data from there till current and then leave a timestamp for each when the job is complete.
But when i try this, i am not able to get the additional instead i get the entire data from scratch. Is there any way i can complete this task by any other method?