Matillion Architecture. Will matillion bring the data from source and target into matillion memory and process the data like most other ETL tools do?

Matillion ETL
1

Will matillion bring the data from source and target into matillion memory and process the data like most other ETL tools do?

Example :

Say I want to join 2 tables, I extract data from 2 tables using 2 extract connector and using join stage I join two table and write the data into a target table.

Does matillion ETL pulls the data in memory and perfom join and loads into target.

2

Matillion is an ELT tool (not ETL): Data is Extracted from the sources, Loaded to the target (cloud) DWH, and then Transformed within that target platform. Matillion "just" generates SQL scripts and pushes them to the target platform. No data is pulled to the memory on the Matillion instance.

3

Thanks For your response. When data gets transferred from On-prem to cloud (snowflake, Redshift etc) , Do the data come into matillion instance ?

4

I thank case, yes. The (JDBC) database driver connects to the on prem database from the Matillion instance. All data goes from the on prem DB to the Matillion instance and from there to the configured staging location (e.g., a S3 bucket if you are on Matillion for AWS). The cloud DWH (Snowflake/Redshift/...) loads all data from the staging location once the data is completely loaded to that location.

5

Thanks for the info