Different table loaded from Blob to Snowflake

Matillion ETL
1

I have an xlsx downloaded from PowerBI and loaded into the Blob storage account. I use the Excel Query job to load the table from Blob to Snowflake. Matillion brings the correct number of columns and rows to Snowflake.

Nonetheless, there is a data mismatch between the 2 tables. In the file from Blob, there are some values that did not get into Snowflake. Also, the Snowflake table has the column count of some fields added as a value in these fields. For instance, I have the field "BU" which is the 16th field in the Snwoflake table. I see the value 16 added many times in the column "BU".

How can I fix this issue?

2

I am guessing the missing records might be an issue due to Type Detection. Try passing the connection option "Type Detection Scheme" as "Row Scan" and add another option "Row Scan Depth" till the max record no. This might avoid type conversion issues.