A Matillion ETL API triggered from external scheduler receives a response "Successfully Queued Job xyz" with 200 OK status . This only means job was queued for execution and behind the scenes job might be running. How to get completion response?

Matillion ETL
1

Basically i want my scheduler to wait for the completion of API job. Is there way to get the server response for completion instead of queueing ?

2

Unfortunately, the response is just a confirmation that the job was started in Matillion.

 

To get information about the job status or completion, you have to poll the API in regular time intervals. But be careful, extensive polling might slow down or even crash your Matillion server instance.

 

Another option is to design your Matillion job to actively notify the scheduler about a successfull completion. This can be done with SQS if you are on AWS.