Note: I am running an old version of Matillion, so this might already be fixed, but in case it's not, I'd had trouble with a Matillion orchestration that would be in the middle of running a Python script, then it just progresses to the next task ever before the script finished.
It seems the print statements I was using to debug the script might have made Matillion assume the script had completed successfully. After disabling all print statements, the next task started only after the Py script finished.
Hi, Did you observe this scenario, while the job is still running? We had a similar issue , where we were not able to see the complete output of the python script in Task History window, while the job is still running. Once the job is completed , the component would reveal the complete python output.
@SP354566, I have never seen this with our Python scripts. And we also have quite some scripts that use print statements for debugging or logging purposes.
@AnudeepK , this is something I have seen as well! The complete output of a Python component is only revealed if the job execution is finished. If the job is still running, you will most likely see only parts of the output.