Hello Community,
I am new to Matillion and one thing that bugs me: when I change an object in Snowflake using DDL e.g., I add a column, the IDE does not recognize that and even after validating again, it still thinks the column does not exist. Only after around a minute or so it does realize the column is there now. Is this normal?
Thank you and kind regards,
Benjamin
It is - Matillion cache certain values to avoid requesting them repeatedly from the remote DB, and schema alterations aren't something that expect to change very often. Disabling cache makes the product incredibly slow, and causes platform issues - metadata requests are quite expensive, and eg. Snowflake will limit the number of them that you can make in a given period.
Hope this answers your question.
Cheers!
Chika