Slowness issue in ETL jobs

Matillion ETL
1

Hi Everyone,

 

I am using Matillion ETL for Redshift running with 1.42.7 version in my production environment. I have started facing issue since last week of utter slowness specifically in transformation jobs. At a given point of time, only 1 transformation job runs even though that is totally different than other jobs, which makes the job runs 4-5 times slower than earlier.

 

Any help would be appreciated to resolve this issue.

2

There are various factors to consider for slowness in the jobs. Below are few you may need to check:

 

1.Matillion VM size (No of vCPUs)

2. Redshift cluster size ( not sure if that is what defines the performance, for Snowflake its the warehouse sizes )

3. Matillion concurrency (No of possible connections to the database )

 

3

Hi Anudeep,

 

Thanks for your reply on this.

 

To answer on the points you have mentioned, issues started appearing suddenly from 26th-May onwards and before that things were working perfectly fine in Matillion.

 

Thanks,

Mithil Prajapati.