I need to download file from a https URL to google storage using an access token? Is there a way to set this in data transfer component

Matillion ETL
1

I have an https URL from where I need to download files, The server looks for an access token in the request header. I finally need to load this to snowflake. i was planning to load data first to Google storage and then to snowflake using the load component. The data transfer component is fine for https, but does not allow me to set the header. Please let me know how to do this.

2

@Varada​ do you get an answer of this? if yes please share it here

3

Use Python component :-)

4

Hello VA631499

 

Could I ask that you add this as an idea to our Ideas Portal, as I have heard of this issue come up a few times before, and I think it might be useful for a number of users. However, I can't be sure until we have more people "liking" it.

 

Regards

Ben Smiles

Matillion Product Team

5

@priyanka.chaudhari, I was unable to do this within matillion, I used python scripts to load it and integrated with matillion.

6

Thank you @BenSmilesMatillionProductOwner​ I have raised this request in Ideas Portal. I believe this will be a good time saver.