Data Transfer component is not working in Run Orchestration with File Iterator

Matillion ETL
1

I need to load the CSV files from S3 to Snowflake and then move to the archive folder in the same S3 bucket.

I am running Run Orchestration which has Data Transfer and S3 Load components under File Iteration. Everything works well except Data Transfer and getting Key missing error. 

But when I run the pipeline without Run Orchestration, it works fine. 

Please find the below screenshot of the error for your reference. 

My approach might be wrong. Any thoughts or solutions for this?

2

Hi @kothariu​

Thank you for your post, I was curious to learn if you were able to resolve this.

If not, let me know and I can assist you :)

Kind regards, Joe