Azure Data Factory pipeline keeps failing randomly using Self-Hosted IR on Azure VM, but works perfectly fine on my laptop with Windows 11
I have ADF pipeline that pulls data from AWS RDS(SQL Server) tables to ADLS gen2 in parquet format. It uses one copy data activity and parameter that contains table, schema and db names and do the ingestion for each of them.
Azure Data Factory pipeline keeps failing randomly using Self-Hosted IR on Azure VM, but works perfectly fine on my laptop with Windows 11
I have ADF pipeline that pulls data from AWS RDS(SQL Server) tables to ADLS gen2 in parquet format. It uses one copy data activity and parameter that contains table, schema and db names and do the ingestion for each of them.