I'm working on an analysis whether Matillion can be integrated with Jenkins for CICD. I'm looking for any references related to this idea as well as whether its possible to integrate. Please share some inputs which helps me to conclude.
Hi @santhosh.arumugasamy and welcome to the community!
This awesome post here from @Bryan might be of help to you. Have a read through and let us know if that answers your question.
I hope that helps!
Many thanks,
Claire
Hi @santhosh.arumugasamy ,
I think what you are trying to do may be possible but I have not heard of it being attempted by anyone. I think what would help is to understand what your expectations would be for implementing Matillion as part of Jenkins. If you are simply trying to deploy changes from one Matillion instance to another, API's can be used to do this. It's not real simple though due the various types of changes that are possible in Matillion. For example, if the change is just a change in an orchestration then you could export and import. Where it get's tricky is if the change includes things like API Profiles, Shared Jobs, Webhook Payload templates, etc. you will need to handle those separately.
Either way moving changes isn't real easy which is why most people opt to handle the deployment of changes in a more manual way. The other thing with products like Jenkins is that they work at a lower level than Matillion. Meaning, they work based on changes at an individual line of code level. Matillion's granularity is at the whole project level. Meaning, even if you change 1 parameter in 1 component, you have move the whole project. This leads to a larger/heavier deployment than necessary because the whole project is deployed for 1 tiny change. I am hopeful this will get better over time. Hopefully this helps in some way.