How do I enable 'SKIP_FILE' or 'CONTINUE' for the ON_ERROR option in RDBMS Query Component for Snowflake. Is there any way in Matillion or do I need to this in Snowflake?

Matillion ETL
1

We have some bad data coming in Snowflake which has caused the data load to fail. I know Snowflake has the option to skip the file or continue on error, but not sure if it is in Matillion.

Can anyone please point this out

 

Thanks.

Neelam

2

Can anyone look into this please?

Thanks in advance.

 

Regards,

Neelam Macwan

3

Surely this should be configurable on the "Load Options" property of a DBQuery... Please Matillion devops... you're our only hope.

4

@NeelamMacwan​ one work around I can see is to not use the Matillion managed stage option, but to create your own custom stage object with whatever configurations you would want and then use that in your load process.

CREATE STAGE my_int_stage

COPY_OPTIONS = (ON_ERROR='skip_file');

https://docs.snowflake.com/en/sql-reference/sql/create-stage#examples