How do you guys do Peer Reviews with the Git Process?

Matillion ETL
1

I'm curious to hear how people are doing their Peer Reviews, Git, and deployments? Do people have designated deployment mangers? And with conducting the PRs over job designs, since Matillion is so UI based, doing a PR over the code file behind the job design is not easy. I'm curious how others are managing their SDLC process with the Matillion tool.

2

Love this post @MichaelBlack​ I hope you don't mind I have asked a member of the Matillion Product for their thoughts on this, its a really good question, and I look forward to hearing everyone's opinions.

Kind regards, Joe

3

Hi @JoeCommunityManager​ I was curious if you were able to connect with the Product team with their thoughts about the PR process for reviewing and promoting code.

Or if there is anyone else in the community, I'd be curious to hear how others are handling their PR process?

4

Hi @mike.r.black​

I am really sorry that this was missed, but thank you for popping back and getting in contact with me.

I spoke with our team who wanted me to share their thoughts on this with you>

This mostly ties to:

  • the size of the company, and the data team
  • the separation of concerns between data engineering & data operations (e.g. is the data team owning the production, or is there a dedicated team for this - likely to happen in bigger organizations)
  • the DevOps/data ops culture, practice, and policies inside of the company

  • the bigger the team, the bigger the org, the more you need collaboration, and processes and the more likely you're going to start seeing that kind of SDLC. We've been designing and building the tool with flexibility in mind so that we can address the needs of smaller, but also bigger organizations. At the end of the day, you should be able to adapt the use of Matillion and its APIs to fit.

  • we do appreciate reviewing a PR might not always be easy with MELT. This is one of the reasons we've introduced DPL in DPC, as a way to review human-readable pipeline descriptors. But the process remains the same whether you're using METL or DPC

I hope that helps, please do let me know if you need anything else :)

Kind regards, Joe