Hi
Does Matillion support the migration of data from Azure Sql Server Managed Instance to Snowflake on Azure Platform?
If YES !!,then please provide the migration steps or you can also share the Matillion Documentation Link if any.
Regards
Anu
Hi @AS111985 , If your question is to do a one time migration data in one or more tables from Azure SQL to Snowflake then the answer is yes. You can use the Azure SQL Script component to do that. That can be done by creating an orchestration, dropping the Azure SQL Script component on the canvas and configuring it. You will need to place and configure this component per table unless you want to join data from multiple tables in Azure and ingest that into a single Snowflake table. Here is a reference to the SQL Script component I am referring to: https://documentation.matillion.com/v148/docs/2959707
If you are looking to do a sync between tables in Azure SQL and Snowflake tables that's a very different animal. I would argue that Matillion is not the best tool for this scenario even though it can be done with quite a bit of work.
I hope this helps. If you need more help and have more details please feel free to post back.
Thanks Bryan for your guidance. Based on our advice i tried to draw a high level pictorial representation of the solution to my requirement of one time data migration from Azure Sql to Snowflake.
Appreciate if you can validate the attached diagram.
Regards
Anu
Hi @AS111985, this may be simpler than you or I was originally thinking. What if you were to use the Database Query Component? That allows you to specify the query you want to execute and specify the Snowflake Table destination in 1 component. Under the hood what is happening is that Matillion is querying the Azure database, creating a CSV file, dropping that in an Azure container or using the Snowflake storage. From there the component issuing the COPY INTO statement in Snowflake to load that file into a Snowflake table. The very simplified diagram of that would be this:
Let me know if this still isn't clear and I will see if I can clarify.