New Microsoft Exchange Query in Matillion 1.67 - How to save file attachments?

I'm using the new Microsoft Exchange Query component and I'm trying to get and save file attachments from messages of a particular email attachments, it could be Matillion temp folder or directly to S3; but I haven't found a way to achieve this.

 

I'm trying to "mimic" the logic I had with the old Email Query Component, that had a way to get the "attachmentData" field and stored it in Matillion temp folder. As you can see in the next picture:

 

 

However I can’t find any similar field for the new Exchange Query Component:

 

 

I have available several fields avaialble for the file attached (and can query it with SQL), but not the file itself. How can I get this file (let’s say, a CSV) and copy it to Matillion temp folder or AWS S3 bucket.

 

I’m struggling a bit on this, I can’t find any tip or help in the official component documentation.

 

I had to move from Email Query Component to new Exchange Query Component as Email Query couldn’t manage advanced auth.

 

Thank you

 

Hello Roberto

 

We are currently in the process of tackling this issue, as there currently isn't an option to do this in the Microsoft Exchange connector yet. Due to future changes to how Matillion will work, it would no longer be a as straightforward as "download attachments to temp folder".

 

If you are open to it, may I email you directly to discuss your use case, how the attachments will be used and what the simplest options would be for you?

 

Regards

Ben

Matillion Product Team

Hello Angu

 

We have not decided on the solution as of yet, which is why I wanted to discuss your current user journey with you. I am speaking to other users to determine what would work best for them.

 

Possibly ideas spoken about so far include downloading to a storage bucket, adding Microsoft Exchange to Data Transfer, creating a Shared Job and so on... Your input would be very helpful.

 

Regards

Ben

Matillion Product Team

Hi Ben

Thanks for your response.

We are currently using email query component to download the email attachments, which uses basic authentication. As basic authentication will be disabled by Matillion any time soon (within end of this year).

We tried switching to Microsoft Exchange Query component instead of email query component, since it uses advanced authentication (OAUTH).

If we are unable download attachments using microsoft Exchange Query component what is the solution to our problem. Please suggest.

  1. Do we have to look for different options download mail attachments? Or
  2. Microsoft Exchange Query component will be updated to download attachments before basic authentication is disabled by Matillion.? Or
  3. Any other planned solution by Matillion to tackle this issue.

 

Thanks in advance.

Regards

Angu