We are having an ingestion fail intermittently with a Snowflake S3 load component.
We receive a few files per day from third party and most of the time the ingestion processes fine, but sometimes we see this error
"
Parameter Validation Failure:
Authentication - Input required.
Stage - Unrecognised options: {stage_name}
"
I am using a place holder for the stage name for this post. I've verified that the stage name is already created in the expected location in Snowflake. I don't believe stage name is the issue because there were ingestion before and after this one that processed successfully.
The authentication is also configured correctly, the weird thing is that like 20 minutes prior to this failure, the same ingestion for a different file processed successfully.
Were seeing this issue about 2-3 times per week, the fix is simply rerun the ingestion for the same file.
Has anyone else encountered this issue before with Matillion and Snowflake?