Noticed two new issues when creating a Snowflake table in Matillion DPC:
-
There is a new version of the ”Create Table”-component. A message about it appeared in an Orchestration pipeline. Problem is that I cannot find any release note or documentation about what has changed? I saw that a Transient table type is now supported, but is there something else changed? The message: ”New version available. This component will continue to work in your existing pipelines. A new improved version is now available. Simply search for the same component, then add it into your pipelines to configure and execute.”
-
Another new issue is that now when I use method ”Create if not exist” the log shows ”Created table” although the table already exists. Earlier it showed message ”Table already exists” or something similar. If the table already existed is an essential information, and needs to be showed properly in the logs. The logs tabs is even more concerning, since it implies that the table has been replaced (fortunately that is not the case and the data was not lost in the database), which creates confusion.
Logs for the 2nd issue below, the component has method ”Create if not exist” and the table already exists in the database:
|Create Table|19|[2025-04-04, 13:04:35]|Creating table: "STAG_EDW"."DATASTORE”.”SUBS”|
=> Create or replace?! => |Create Table|20|[2025-04-04, 13:04:35]|Invoking external service: snowflake, create or replace table|
|Create Table|21|[2025-04-04, 13:04:35]|Creating new connection to the warehouse.|
|Create Table|22|[2025-04-04, 13:04:35]|Invoking external service: snowflake, execute action|
|Create Table|23|[2025-04-04, 13:04:35]|Finished invoking external service: snowflake, execute action in 241ms|
=> Create or replace?! => |Create Table|24|[2025-04-04, 13:04:35]|Finished invoking external service: snowflake, create or replace table in 242ms|
|Create Table|25|[2025-04-04, 13:04:36]|Created table ["STAG_EDW"."DATASTORE”.”SUBS”]|
I’m using Matillion DPC for Snowflake.