Switch from Redshift to Snowflake

Matillion ETL
1

Hi, there.

 

We are using Amazon Redshift, and Matillion ETL for Redshift, and planing to switch data warehouse Redshift to Snowflake.

 

I want to switch Matillion ETL for Redshift to Snowflake.

I don't want to rewrite matillion job.

Is there an easy way to migrate?

 

2

That's a great question Yuki. I suspect it's a fairly complex answer because although the versions (Snowflake and Redshift) of Matillion are similar not all components area identical and therefore would like pose issues during a simple migration. Have you tried exporting from the Redshift instance and importing into the Snowflake instance of Matillion?

 

I could see how this may fail depending on the components used in the orchestrations. There are some components in the Redshift product that simply do not exist in the Snowflake product and vice versa.

 

If you have a Matillion rep, I would reach out and see if you can speak to a solutions architect. I don't know how much help this answer is but I hope it helped somewhat.

3

Hi @Yuki​

I am aware that Matillion have some capability to convert code between platforms so it may be worth reaching out to see if that is appropriate for your use case.

@JoeCommunityManager​ - can you get in touch with @Yuki​ ?

Thanks!

4

Hello,

 

Good Evening Yuki,

 

Thank you for asking this question, I am very happy to answer :)

If you want to switch from Redshift to Snowflake, please go through this link: https://community.snowflake.com/s/article/Migrating-from-Redshift-to-Snowflake

This link will guide you a lot and if anyone interested to do Snowflake Online Certification, please feel free to contact me.

 

Thanks & Regards,

Anita

 

 

5

Hi,

 

One thing I have used before to migrate my DDL is https://sqldbm.com which got me thinking.

 

You could use the Matillon create table component and run the DDL and data at the same time, though personally, I would recommend managing the data model separately.

 

Though this may just be my need for control! 😅 Finally, you could then use Matillion to unload the data from Redshift to S3 and Load that into Snowflake.

 

Just an idea, but could answer your issue.

6

Thanks for the heads up @ELTuser77​

Hello @Yuki​ and welcome to the community! This is something we can support you with, I would be more than happy to arrange for your account manager to contact you with regards to this if you would like?

Thanks again, Joe 😀

7

Hello Joe and thank you for quick response! 

It is still under consideration. 

I will contact account manager as we make progress.

8

You are welcome @Yuki​

Keep me posted and I can be on hand to assist you with this 👍

Kind regards, Joe