Relative Content

Tag Archive for amazon-s3snowflake-cloud-data-platformamazon-sns

Snowflake – get notified of any task errors when copy is set to “on_error = continue”

I have a task on Snowflake that runs a copy command with “on_error = continue” so that if one the files in my S3 bucket that I am trying to copy into a table fails the copy will not abort immediately. However, I have also created a “error integration” for this task with AWS / SNS so SNS will send emails whenever an error occurs with this task. The issue here is that by setting “on_error = continue” to the copy command the task will eventually succeed and no emails will be sent, even if one of the files in my S3 fails to copy into the destination table. Is there any workaround for this so that a task doesn’t abort immediately when one of the files I am trying to copy fails and am still notified of any errors?