Hi, we are currently using Matiilion ETL , and are trying to connect to an Azure Blob Storage to unload tables in it.
In order to do so, we configured a Snowflake Storage Intergration for Azure by following these documentations:
- https://documentation.matillion.com/docs/2044580
- https://docs.snowflake.com/en/sql-reference/sql/create-storage-integration
We followed all the steps required to create the storage intergation for Azure. But the Azure Storage never appears in the Matillion ETL instance on the Authentification properties.
We also tried to integrate the Azure security credentials, but it does not seem to work either.
Is there someghing that we have skipped in order to connect to the Azure Blob? Or is there any other way to connect and acces to the Azure Blob Storage without passing by the creation of a Storage Integration?
Hello Syrine
I'd like to get the obvious questions out of the way first:
- Currently, environment credentials and Cloud Data Platform account credentials are tied together, i.e. the credentials in your Matillion environment are the ones being used to access your Blob Storage Container. I'm assuming you want to use a Blob Storage Container not associated with the environment credentials being used in your Matillion instance?
- Is your Matillion project using the Snowflake account credentials in the environment setup as the Snowflake account where the storage integration resides,?
- Were the above credentials also used to configured the storage integration?
Like I said, these are very obvious questions, but I'd like to start from a good understanding.
Also, I have spoken to Matillion Support about walking through these steps to see if there is something simple you have missed in the setup?
Regards
Ben Smiles
Matillion Product Team
Hello Ben,
- Yes we want to use a blob storage Container that is not currenlty associated with the environement credentials that are being used in our Matillion Instance. We are trying to connect throught the storage integration.
- Yes
- No the credentials used to configure the storage integration are the Azure ones. Here is the configuration used on snowflake:
CREATE STORAGE INTEGRATION EP_AZURE
TYPE = EXTERNAL_STAGE
STORAGE_PROVIDER = AZURE
AZURE_TENANT_ID = 'xx0x000-00x0-0x0x-x00-00x0000x0xx0'
ENABLED = TRUE
STORAGE_ALLOWED_LOCATIONS = ('azure://xxxxxxxxxxmatillion.blob.core.windows.net/matillion/'
I have also insterted below a screen shot of our IAM Access control panel on Azure:
I do not have a direct acces to the azure blob configuration panel. Would it be possible to schedule a meeting with a matillion support member, our backend dev that is in charge of the azure portal and me?
Thank you
Hello Syrine
The storage integration can use credentials from another Azure tenant within it, but must be configured in the Snowflake account you are using for your Matillion instance. Otherwise it will not be visible.
I believe you should be able to get access to our support team via https://support.matillion.com/s/ to help you run through the configuration step by step to troubleshoot.
I hope that helps.
Regards
Ben Smiles
Matillion Product Team
Hello Ben,
I am not sure to unsterstand how we could use another Azure tenant. We have followed all the steps shown in the documentation linked below in order to configur the storage integration:
https://documentation.matillion.com/docs/2044580
Is it possible to schedule a quick meeting with someone from the support team? The link you have send only shows the general support page for matillion, it does not really help. The acces to the azure storage is becoming more an urgent priority for our business needs. Having a meeting would really help.
Thank you,
Syrine Tahar
