Dynamic mapping (transformation)

k.gowtham · December 29, 2022, 6:09am

Hi All,

I have a requirement to load data from 10 stage tables to 10 target tables. In future the tables count may increase.

So, I wanted to implement a single generic transformation job to load all those tables from Stage to target.

The job I created now I have to change the source and target name manual.

Is there a way to create dynamic mapping like we have option in IICS.

Thanks for your support, assistance in advance.

Thank you

OzW · January 6, 2023, 6:52pm

Potentially you could query the table names using DB Query compoent into a control table (single column table with the names of the tables to be read in it) and iterate a DB query component using the table names as variables. Let me know if you need more clarification.

Topic		Replies	Views
Load multiple tables dynamically using a control table Matillion ETL matillion-etl	1	17	March 12, 2025
Data Load from Transformation Job to Orchestration table created in SNowflake Matillion ETL	1	2	September 16, 2022
Table Input component (in a transformation Job) not recognizing the Table name ( using a environment variable that I defined) Matillion ETL	1	0	April 14, 2021
I am using "Table Update" component for a GENERIC process to update the tables. I am using grid variables to store column names / primary key indicator for both source and target. I want to update the target table by comparing primary key dynamically Matillion ETL	2	8	April 13, 2022
SQL Query V.S. Data Transforms Matillion ETL	1	1	March 16, 2023

Dynamic mapping (transformation)

Related topics