S3 Unload component adding _0_0_0 to filename

Matillion ETL
1

I have an s3 unload object that dumps a snowflake table as a csv to an s3 bucket. The file prefix im using is

TestFile_${dt.now().format("yyyy-MM-dd")}

 

However the filename comes out as TestFile_2023-06-07_0_0_0.csv

 

I need to get rid of the _0_0_0

2

This must be the due to parallel unloading of file in S3. The digits represent the no. of the node using which the data is unloaded from.

 

You can set the option for Single File as "True" , which may slower the extraction, but will create a single file with no extension.

3

Thanks Anudeep!!! Single file as true did the trick.

4

I do not find a Single File option for the S3 unload component. Where do I find it?

 

069Tm000001C8dxIAC_0D7Tm000000DWi1KAG
069Tm000001C8dxIAC_0D7Tm000000DWi1KAG301×624 18.1 KB

5

it's the "parallel" setting - turning that to No does the trick. same problem in Matillion for redshift and this fixed it