I am having few Orchestratrion jobs --Calling--> Orc Jobs --calling--> Shared Jobs, to process a bunch of related files.
when i have an issue at the Shared Job level, the shared job fails. But that failure is not bubbled up to Orc jobs. I mean, I could see Shared job failure, but the Orc jobs ends successfully. Hence, i am not able to monitor the job completion status in Task history, in a easier manner.
Currently, i am using a Or component & Fail component to bubble the failure up. But it kinda of looks messy.
Is there any job level parameter or setting that can help to fail the whole Orc job, when any component executing within it has a NON-Success return code ?
i think your implementation is already the best solution you can achieve with Matillion's current features. Even if it does not look that beautiful it should give you what you are looking for.
Nevertheless, I encourage you to submit an idea to the ideas portal. I would agree 100% that we need a job-level or project-level setting to fail a job if any sub jobs within this job fail.
As a sidenote: With the latest release, Matillion offers global error reporting. I think this is already a step in the right direction and at least you are notified if any sub job fails.