I am a business analyst with not much exposure to this type of programming work, but I am working with two vendor systems with the following requirements/steps:
(forgive me for my lack of knowledge in hosting and infrastructure here)
-
System 1 (Source): Download a nightly Report with Appointment Data in CSV file
-
Transform CSV File to JSON Format for uploading to Target System
-
System 2 (Target): Use Vendor (Target) Provided POST Call to Send Appointment Data to Target System
How Far I’ve Gotten:
I’ve been able to test part of Step 3, all the way up to authentication and getting a hold of a token.
My question is… how do I download and call upon the Source Data on a nightly basis and how do I point to specific reports each night? Do I use python to retrieve the components nightly and write a script that transforms it into JSON format?
Where do I host a job like this if I want it running nightly?
In my previous role we used Informatica – but don’t have a tool like that at my current organization to facilitate ETL
efefef is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.