We have a couple jobs that kick off via SQS whenever new files get dropped in certain S3 buckets. We'd like to disable the SQS listen queue while our nightly ETL job is running though, so those jobs don't chew up valuable CPU resources. Is there a programmatic way to disable SQS at the start of our nightly ETL and re-enable it when the ETL finishes? Can this be done via the API maybe?
Interesting question! I have searched the documentation and there are indeed some API endpoints for queues: https://documentation.matillion.com/docs/2951494
I think you will have to use the "Import" endpoint to change the status of the queue from enabled to disabled and back again. It's probably a good idea to use the "Export" endpoint first to fetch the current configuration, then just change the "enabled" flag in the JSON and write back the changed config with the "Import" enpoint.
Let us know if that works for you!