An ADF copy job fails with the following error:

I’ve got a 3.6 billion row fact table in Azure SQL which I am trying to create a copy of. Initially I setup a simple copy activity in Azure Data Factory to copy from table 1 to table 2. The throughput of this was very poor, under 2MB per second, and this is without any indexing applied.

I have an Azure SQL server and my ADF has contributor access to it. But still when I tried to truncate the table using the pre-copy script in the copy activity it throwed me error stating that you might not have access.

I have an Azure SQL server and my ADF has contributor access to it. But still when I tried to truncate the table using the pre-copy script in the copy activity it throwed me error stating that you might not have access.

One of the DB load job in Azure data factory failed with the message error:

I have a storage container where a source file is published on a daily basis. I need to compare the contents of this file with that of a table in SQL DB, and copy the rows from the source file to the DB only if they do not exist in the DB.

I am using Azure Data Factory pipeline.