Is it possible to remove all the rows from a table in Snowflake before uploading new content using Azure Load SF?

Matillion ETL
1

I have a csv file stored in Azure Blob, and I need to upload it to Snowflake every day. The main difference is that I need to apply some transformations to it before I can load it to the main table. How can I do so?

I wanted to upload this file into a buffer table in Snowflake, then load it back to Matillion. Do the transformations and append it to the principal table. But then I always need to clear the buffer.

Thus, I want something similar to "Recreate Target Table: ON" in the Excel Query component, but for the Azure Load SF. Thank you.

2

Would using the Delete Tables and Create Tables components in the Orchestration job solve this?

Create Table (buffer), Azure Blob Storage Load, Run Transformation (moving from buffer to update master table), Delete Table (buffer).

3

You could achieve this by using Azure Blob storage load component. One of the options does have Recreate Target table ON. ​