"Use Accelerated Endpoint" in the Salesforce Query Component

Matillion ETL
1

There is an option for "Use Accelerated Endpoint" in the Salesforce Query component. I am not able to find any documentation for it. What does this option do?

2

Hi @saqib​,

Do you mean the Amazon S3 Transfer Acceleration option? It was added very recently, in Matillion ETL v1.55.5, and is documented here.

Best regards,

Ian

3

Hello Ian,

 

Thanks for the link. I am curious if enabling this option help if both the Matillion EC2 instance and the S3 staging bucket is in the same region? Any thoughts?

 

Thanks,

Saqib

4

Hi Saqib,

 

My first opinion is that S3 Transfer Acceleration probably won't make any speed improvement if your S3 bucket is already in the same Region and same Availability Zone as your Matillion instance. The reasoning is that S3 Transfer Acceleration takes advantage of CloudFront's Global Edge Network, so AWS transfers data from region-to-region (using their own dedicated network) rather than you having to do that over the more unpredictable internet.

 

But I would recommend you try it out for yourself to check, in case there are other factors too.

 

While you are performance-tuning, I would recommend you also take a look at the compression setting in the Load Options. The default is to gzip the files, but you might experiment with switching that off.

 

0694G00000GIZSqQAP_0D74G000007jnhvSAA
0694G00000GIZSqQAP_0D74G000007jnhvSAA400×382 10.5 KB

 

The tradeoff is as follows:

 

  • Compression type gzip (the default) - higher CPU usage: lower network usage
  • Compression type none - lower CPU usage: higher network usage

 

Best regards,

Ian