In Matillion ETL pipeline we are using Azure Blob Storage Unload component to create a csv file from snowflake table. We are able to load the file into the Azure blob successfully but we are not able to see the data inside the file (Data is encrypted)

Matillion ETL
1

I would appreciate any help in determining the cause of this problem from anyone who has previously worked on the Azure Blob Storage Unload component.

2

Hi Hima,

 

The compression type (encryption) is specified in the File Format used during the unload. You can specify the File Format through the Create File Format component, or you can use a custom format specifically for this unload by selecting [Custom] in the Unload component's "Format" property. This is what happens by default, and its usually OK to leave it with that default.

 

To make sure there is no compression on your file, you just need to set the "Compression" property to NONE.

 

Let us know if this resolves your issue. Good luck!

 

Brendan

3

Hima, I can expand on this to mention that Matillion will attempt to unload the data into many small files. To unload the whole table/view into a single file, you will also need to set the "Single File" property to True.

Brendan

4

It worked when I set "Compression" property to NONE.

Thank you!