Slowness in ETL jobs with AWS Redshift after upgrade METL from 1.72 to 1.78

Matillion ETL
,
1

Hello,
I’m experiencing noticeable slowness when running jobs after upgrading from version 1.72 to 1.78. While I understand that performance issues could be related to the database side, I’ve observed that the same jobs consistently run faster in 1.72 compared to 1.78 — particularly during the query compilation and planning stages. Additionally, job validation appears to be quicker in 1.72. Want to check if there have been any changes between these two versions?

Thanks

2

Hi @helen.zhang and thanks for your post.

I’ll check in with the team about your issue and see if they have any suggestions. In the meantime, have you had a chance to look at the release notes? You can find them here.

Many thanks,
Claire

3

Thanks Claire, i had a look the release notes…no breaking changes.
Also, i have run the same job in both 1.72 and 1.78, for 1.72.4, it takes 3 mins 13s, for 1.78.0, it takes 6 mins. I run it after working hours, no other query was running at the time. It is the same job, running against same tables, in the same database.
Thanks

1 Like
4

Thanks for the extra information @helen.zhang, I’ll pass this back to the team as well and see if they have any suggestions for you.

Many thanks,
Claire

5

Hi @helen.zhang, I’ve spoken to the team and I noticed that you’ve put a support ticket in as well. If you’ve not done so already, would you be able to send the support team an export of the job in question and the logs for running it on 1.72 and 1.78? That way they’ll be able to take a closer look.

Let me know if you need anything else,
Many thanks,
Claire

6

Thanks Claire, yes, have logged a service call too :grinning_face:

1 Like
7

That’s great to hear! Let us know how you get on. If you have any other challenges or questions, don’t hesitate to ask!

Thanks so much,
Claire

1 Like