I have multiple parquet files which are non urf data , need to load into snowflake. Can you please advise
Hi @nitingarg70,
I have not personally loaded non UTF-8 parquet files but I believe this can be handled. I think you might have found a missing option in the S3 Load component. When you select parquet as the file time it's missing the BINARY_AS_TEXT option. My suggestion would be create file format in snowflake that is configured for parquet with the binary_as_text option set to true and then in the S3 load component just use the file format you created. I typically try hand writing the copy into statement in snowflake to ensure it will work in Snowflake. If you can make it work in snowflake itself then you can make it work in Matillion either by leveraging the S3 Load component or by using the SQL Script component. I hope this helps get you started!