How to read data using the "Input_table" transformation component row by row and store it into variables. Dataset is unstructured data (complex) and large in size

Matillion ETL
1

I am trying to read data from table and iterate over one by one row and pass it to python script.

2

I think what you are describing might be best served using the "Table Iterator" component, attached to the Python script you want to run. https://documentation.matillion.com/docs/2235538 (There's a video at the end of that page also that might be useful)

 

Depending on exactly what you are doing you may also want to consider grid variables and the "Grid Iterator" component. This course might be useful for understanding iterators and the grid variables: https://academy.matillion.com/certifications/a0b870c4-efad-11eb-9666-02d47b69d3fd

3

Thank you! @Phil_BMatillionSalesEngineer​ It works