Hello, I would like to know if it is possible on Matillion to load the openSSL encrypted files

Matillion ETL
1

Hello,

I would like to know if it is possible on Matillion to load the openSSL encrypted files.

These files are deposited in Google Storage.

Thanks

 

2

Hi @tatus_parker​,

I hope you're doing well. You don't mention what you want to do with the files or contents of the files if you could open them. Are you loading them into a table? If so, are you trying to load them into Snowflake, BigQuery, or some other platform?

I have not done this before but I don't see why you couldn't do this fairly easily using Python and/or a bash script. If you can let us know more about your end goal we can probably give you some suggestions.

3

Hi @Bryan​ ,

I would like to import the zipped and unzipped files I use data transfer but it does not take the variables

my database is BigQuery

4

Hi @tatus_parker​,

It sounds like you might have solved this issue using a bash script based on another question you posed. If the Bash script doesn't work I like to lean on Python scripts. I prefer Python scripts over Bash scripts as they are bit more portable in the fact that if you move that script to another cloud platform or provider, you may or may not have access to Bash which makes your scripts unusable in their current state and would require you to rewrite them. I also prefer to use Python as it becomes very portable to things like Azure Functions, AWS Lambdas, GCP Cloud Functions, etc...

Let me know if this is still an issue and I will take a stab at this. Thanks for posting!

5

Hi @Bryan​

that's another problem

I have zipped files which are also dropped into a bucket in Google storage, now I want to use the data transfer component to copy and unzip them to another bucket.

I have several files and when I create a variable to load all the files I have an error as you can see on the capture

Thanks