Matillion version 1.68.3 on AWS hitting Snowflake, and my transactions are off the rails...
I've got my begins and commits where I want them, but somehow, they're not "lining up". The first COMMIT can't find the transaction, and the subsequent BEGIN bumps into it!
Can someone please explain what's happening, or how I can get these transactions to work?
Snowflake supports named transactions, but the BEGIN component doesn't exploit this. It seems like this would solve the problem, no? Being able to COMMIT an open transaction by name would be unambiguous.
I would love to see what design patterns are working for all of you!
... and the full pull for context
The point of the transaction in the RAD job is that the "Recent History" step does DML work that needs to be committed (or rolled back) with the work done in the iterations of RAD_Delta.
Hey, I cant diagnose your issue specifically but we use transactions in our jobs as well. We have had a bunch of issues with it. Something that did help was only putting transformation jobs in transaction blocks.
Hi there, we have a similar problem here, when we are executing parallel transformations using transactional blocks. Raised an idea in the portal, please keep up-voting it .
Idea: Name Transaction Control Components (Begin, Commit, Rollback) (matillion.com)