We want to create an automated pipeline in Azure devops for the Matillion ETL jobs we have to put data in Snowflake and move the job scripts and run them through environments. i.e. dev, qa, prod. Can you please provide some steps to achieve that

Matillion ETL
1

So we have git repo where we store all the exported json files.

So we would like to automate the merge/push to the git main branch for any changes that happen in the ETL jobs .

We are not sure how we would parameterise the environment variables in the devops pipeline as the option of selecting the environment variables come while doing the export.

Can you please help in guiding us in any steps to achieve the same.

2

Hello @santosh.g31​

This article describes one possible solution, using Azure DevOps https://www.matillion.com/resources/developer-relations/5-best-practices-for-managing-azure-devops-ci-cd-pipelines-with-matillion-etl

Thanks,

Chika

PS: If anyone else in the Community knows a different approach, please share.