I'm trying to have a better understanding of how matillion works.
Is the matillion transform transaction entirely executed on snowflake compute and storage or does matillions instance do any of the work?
I'm trying to have a better understanding of how matillion works.
Is the matillion transform transaction entirely executed on snowflake compute and storage or does matillions instance do any of the work?
Most of the lift is done in snowflake. There are a few examples of tasks performed on the instance such as importing excel files. We ended up writing our own excel file extract in lambda though because we kept crashing matillion running the JRE out of memory. (large excel files)