I'm trying to load a CSV file to Snowflake using the Azure Blob Storage Load component. The file has fields enclosed with the Unicode character string terminator (U+009C) but I can't find a way to enter this in the Field Optionally Enclosed property without it either not validating or failing to run.
The character information separator one (U+001F) works fine as a delimiter, so I'm not sure what's different anout the enclosing character.
Hi @Jack, I think the first place to start is with the Snowflake documentation around File Formats. Fundamentally, Matillion is simply creating a SQL statement to be executed in Snowflake based on the information you enter to configure the component. There is no magic that Matillion is performing. Matillion is simply making the creation of the SQL statement a bit easier by way of a nice UI.
In the Snowflake documentation that I just read for Record and Field Delimiters (https://docs.snowflake.com/en/sql-reference/sql/create-file-format.html#format-type-options-formattypeoptions), it looks like it needs to be a valid UTF-8 character for Snowflake to use it. The UTF-8 equivalent of \u001F appears to be \0x1F, which is in the link you provided under encodings. The UTF-8 equivalent for \u009C looks to be: \0xC2\0x9C. I think this will get you past the issue you are facing.
I hope this helps and report back if you can on if this fixed the issue or not. Thanks for posting!
