Does anyone have a data pipeline specification template?

Data Productivity Cloud
1

I'm looking to set up some best practices and guidance in documenting data pipelines developed in Matillion DPC. The best way to start when doing this is is to look for established industry practices.

 

Does anyone have a generic template applicable to a pipeline designed in Matillion DPC, or some sort of outline? I'm particularly interested in figuring out how to document the various components used in a pipeline, capturing a manageable and useful level of detail.

 

Thanks!

2

Hi @Raph​ and that's an interesting question. I'd love to see if anyone else in the community has any tips for best practices that they use. If you're still needing to create documentation, could I suggest taking advantage of the AI note feature which should be able to document both the pipeline and all the components in the pipeline.

Many thanks,

Claire