In METL, I could create an external stage directly from the Environment. It would generate the stage area in Snowflake based on AWS credentials for the environment.
How can I do this in Maia? I cannot get the S3 Load component to point at a named Snowflake stage. I can only ever see the [Custom] option. Even if I manually key in the fully-qualified stage name the component is not working.
And that’s another thing. The s3 Load component has literally NO output. The logs indicate it was “successful” but nothing happened and no output to let me know that it even attempted anything.
Do you have any tips for getting the external stage setup and working with the S3 Load component?
Thanks!
Hi @SB699925,
I worked on a similar case recently. I created an external stage in snowflake and provided the full path (DB.SCHEMA.STAGE) in the component, and the S3 Load component was able to load successfully.
If you’re comfortable, we can review it together — just send me a DM.
Thanks Hemanth,
We are using “hybrid” mode so I wonder if the context of our runner doesn’t have certain permissions. Are you using hybrid or full-saas?
Cheers,
Steve
I’m using full SaaS.
From my understanding, on the Snowflake side we mostly need to grant USAGE on the stage to the Matillion role. Also, based on your screenshot, it looks like the pipeline is running without any validation errors, which means runner does already have access to the stage.
One thing I’m wondering is whether there might be a mismatch between the file pattern configured in the component and the S3 path defined while creating the stage, which could be causing the load no records.
