Currently we are using the Matillion for Redshift version 1.51.5.
We have recently resized our redshift, upgraded from 'dc2.large' to 'ra3.xlplus'. After this resize, our jobs are running much slower than before. For example, one of our scheduled jobs which was running 20 mins is taking 40 - 50 mins after this resizing process.
Is there any configuration or settings we need to work on ? Can anyone please help us to troubleshoot this issue?
Hi @jeberson_david (Customer) ,
When you say that you resized Redshift, I am assuming you upsized Redshift and the Matillion product. Since the one thing you did was upsize Redshift, I suspect you are experiencing performance issues in Redshift which unfortunately has nothing to do with Matillion. Matillion is simply executing statements against Redshift. If Redshift takes longer than usual to return results, Matillion doesn’t know any better. I would focus your efforts on the Redshift side. It may require opening a support case with AWS and asking them about why you are seeing a performance degradation after sizing up Redshift. Redshift is a specialized beast and really requires a DBA that is well versed in it’s inner workings to understand performance implications when configuration changes are made. This becomes even more critical when you get large amounts of data in it. In my opinion this is why other low maintenance data warehouse systems (like Snowflake, Databricks, etc.) have really taken off.
I hope this helps in some way.
Bryan
@Bryan thank you