# \#matillion-etl **URL:** https://matillioncommunity.discourse.group/tag/matillion-etl/2.md [Latest](https://matillioncommunity.discourse.group/latest.md) · [Categories](https://matillioncommunity.discourse.group/categories.md) · [Tags](https://matillioncommunity.discourse.group/tags.md) --- ## [Migrating from METL to Maia - what is your experience so far?](https://matillioncommunity.discourse.group/t/migrating-from-metl-to-maia-what-is-your-experience-so-far/3516)
**Author:** [@SB699925](https://matillioncommunity.discourse.group/u/SB699925)\ **Replies:** 3\ **Last updated:** [June 29, 2026, 3:31am UTC](https://matillioncommunity.discourse.group/t/migrating-from-metl-to-maia-what-is-your-experience-so-far/3516 "2026-06-29T03:31:22Z")
We are long-time METL users and generally enjoy the experience. It has a responsive uncluttered user interface with fairly intuitive components. Moving over to Maia and just noticing the interface gets cluttered very qu… --- ## [Schedule a job every other weekend](https://matillioncommunity.discourse.group/t/schedule-a-job-every-other-weekend/3510)
**Author:** [@srinadhan\_samudrala](https://matillioncommunity.discourse.group/u/srinadhan_samudrala)\ **Replies:** 1\ **Last updated:** [April 21, 2026, 9:56am UTC](https://matillioncommunity.discourse.group/t/schedule-a-job-every-other-weekend/3510 "2026-04-21T09:56:36Z")
Hello I am trying to schedule a job to run every other weekend, I looked at documentation, didn’t find any , can you please help.. We are in METL 1.78. do we know what version Quartz this is aligned to? --- ## [Updates version](https://matillioncommunity.discourse.group/t/updates-version/3491)
**Author:** [@Daikichi](https://matillioncommunity.discourse.group/u/Daikichi)\ **Replies:** 1\ **Last updated:** [February 11, 2026, 10:51am UTC](https://matillioncommunity.discourse.group/t/updates-version/3491 "2026-02-11T10:51:20Z")
Hi Matillion users, I’m currently running Matillion ETL version 1.51.8 on a GCP VM instance. I’ve been granted admin privileges, however I do not see any “Software Update” option in the UI. Under the Admin menu, I onl… --- ## [File Iterator failure](https://matillioncommunity.discourse.group/t/file-iterator-failure/3474)
**Author:** [@jeberson](https://matillioncommunity.discourse.group/u/jeberson)\ **Replies:** 4\ **Last updated:** [December 17, 2025, 11:56am UTC](https://matillioncommunity.discourse.group/t/file-iterator-failure/3474 "2025-12-17T11:56:06Z")
I am trying to create a ETL to iterate the XML file using file\_iterator. But I am getting this error \*\*Could not retrieve File Metadata: Algorithm negotiation fail: algorithmName=“server\_host\_key” jschProposal=“ssh-ed25… --- ## [If I would have one wish for Christmas :)](https://matillioncommunity.discourse.group/t/if-i-would-have-one-wish-for-christmas/3470)
**Author:** [@maike.osterbrink](https://matillioncommunity.discourse.group/u/maike.osterbrink)\ **Replies:** 3\ **Last updated:** [December 15, 2025, 12:46pm UTC](https://matillioncommunity.discourse.group/t/if-i-would-have-one-wish-for-christmas/3470 "2025-12-15T12:46:41Z")
For Documentation direct to the steps I want to have that I can connect a notice to a step. (maybe a function which implement this notice to the documentation when you click on “Generate Job Documentation). This feature… --- ## [Matillion API - Task History](https://matillioncommunity.discourse.group/t/matillion-api-task-history/3440)
**Author:** [@connor.twomey](https://matillioncommunity.discourse.group/u/connor.twomey)\ **Replies:** 2\ **Last updated:** [October 17, 2025, 12:41pm UTC](https://matillioncommunity.discourse.group/t/matillion-api-task-history/3440 "2025-10-17T12:41:10Z")
Hello, I had some questions about how I can most effectively extract task history data using the Matillion API. The issue I am running into is that the response I am getting is huuuuuuge. It appears that I am getting co… --- ## [File Iterator - Filter Regex](https://matillioncommunity.discourse.group/t/file-iterator-filter-regex/3421)
**Author:** [@jvaughn](https://matillioncommunity.discourse.group/u/jvaughn)\ **Replies:** 1\ **Last updated:** [September 22, 2025, 11:32am UTC](https://matillioncommunity.discourse.group/t/file-iterator-filter-regex/3421 "2025-09-22T11:32:10Z")
I am using the File Iterator component. I am looking for specific .txt files in an S3 bucket. I have the following regex in the Filter Regex field: ^${var\_File\_Name}\\S\*.txt$ ${var\_File\_Name} = test\_details full … --- ## [Where is the Azure SQL Query connector?](https://matillioncommunity.discourse.group/t/where-is-the-azure-sql-query-connector/3415)
**Author:** [@mbrameld](https://matillioncommunity.discourse.group/u/mbrameld)\ **Replies:** 1\ **Last updated:** [September 15, 2025, 9:30am UTC](https://matillioncommunity.discourse.group/t/where-is-the-azure-sql-query-connector/3415 "2025-09-15T09:30:19Z")
I’m using Matillion ETL for Snowflake, and want to load data into Snowflake from an Azure SQL database. I found the docs for the Azure SQL Query connector, which seems to be exactly what I need, but I can’t find the conn… --- ## [How to extract the attachments from the email and store it in the snowflake internal stage using Matillion dpc](https://matillioncommunity.discourse.group/t/how-to-extract-the-attachments-from-the-email-and-store-it-in-the-snowflake-internal-stage-using-matillion-dpc/3414)
**Author:** [@pradip.patil](https://matillioncommunity.discourse.group/u/pradip.patil)\ **Replies:** 1\ **Last updated:** [September 12, 2025, 2:51pm UTC](https://matillioncommunity.discourse.group/t/how-to-extract-the-attachments-from-the-email-and-store-it-in-the-snowflake-internal-stage-using-matillion-dpc/3414 "2025-09-12T14:51:39Z")
Hi everyone, i am new to matillion dpc, can someone help me to how to extract the email attachments like images, pdf, csv and store it in the snowflake internal stage using matillion dpc. --- ## [Matillion ETL Excel Query empty Data Selection on #N/A value](https://matillioncommunity.discourse.group/t/matillion-etl-excel-query-empty-data-selection-on-n-a-value/3403)
**Author:** [@bogdan.ciurezu](https://matillioncommunity.discourse.group/u/bogdan.ciurezu)\ **Replies:** 1\ **Last updated:** [August 29, 2025, 2:04pm UTC](https://matillioncommunity.discourse.group/t/matillion-etl-excel-query-empty-data-selection-on-n-a-value/3403 "2025-08-29T14:04:15Z")
Hello everybody, When I want to read an excel file from Blob, that has this value “#N/A” inside some column “PO Date”, the Excel Query component shows an empty Data Selection. This is as if, it cannot recognize the Head… --- ## [Are Matillion ETL Environment Variables accessible from the underlying OS?](https://matillioncommunity.discourse.group/t/are-matillion-etl-environment-variables-accessible-from-the-underlying-os/3374)
**Author:** [@kuroiwa](https://matillioncommunity.discourse.group/u/kuroiwa)\ **Replies:** 6\ **Last updated:** [August 13, 2025, 10:47am UTC](https://matillioncommunity.discourse.group/t/are-matillion-etl-environment-variables-accessible-from-the-underlying-os/3374 "2025-08-13T10:47:56Z")
In Matillion ETL, are the values set in Environment Variables accessible only from within the Matillion application? Or is it also possible for the operating system—such as the EC2 instance running Matillion ETL—to acce… --- ## [Use projects group password in python script](https://matillioncommunity.discourse.group/t/use-projects-group-password-in-python-script/3324)
**Author:** [@RemigiousMikevin.James](https://matillioncommunity.discourse.group/u/RemigiousMikevin.James)\ **Replies:** 1\ **Last updated:** [July 18, 2025, 8:58am UTC](https://matillioncommunity.discourse.group/t/use-projects-group-password-in-python-script/3324 "2025-07-18T08:58:04Z")
I have a Blob Storage connection string stored in Azure Key Vault, and I’ve added the Key Vault to the Secret Manager in Matillion under Project Group Passwords. I then created a password entry in Matillion from the conf… --- ## [Full log required for API Query](https://matillioncommunity.discourse.group/t/full-log-required-for-api-query/3303)
**Author:** [@StewD](https://matillioncommunity.discourse.group/u/StewD)\ **Replies:** 5\ **Last updated:** [July 10, 2025, 7:53am UTC](https://matillioncommunity.discourse.group/t/full-log-required-for-api-query/3303 "2025-07-10T07:53:00Z")
I am having some issues with an API query. The first time the query runs I get a page worth of data back in about 5 seconds. I am using a loop iterator to make the calls for subsequent pages. Each time the loop iterates… --- ## [Need Some Clarification!](https://matillioncommunity.discourse.group/t/need-some-clarification/3293)
**Author:** [@HariRamK](https://matillioncommunity.discourse.group/u/HariRamK)\ **Replies:** 7\ **Last updated:** [July 9, 2025, 9:04am UTC](https://matillioncommunity.discourse.group/t/need-some-clarification/3293 "2025-07-09T09:04:52Z")
I have a Main Job with One Orchestration and five transformation, which run parallely, while running I want all job to start parallely but every time one or two transformation jobs / orchestration job is not starting ini… --- ## [Loop Iterator - issue with advanced conditions](https://matillioncommunity.discourse.group/t/loop-iterator-issue-with-advanced-conditions/3283)
**Author:** [@chris.odell1617208923357](https://matillioncommunity.discourse.group/u/chris.odell1617208923357)\ **Replies:** 3\ **Last updated:** [July 3, 2025, 7:33am UTC](https://matillioncommunity.discourse.group/t/loop-iterator-issue-with-advanced-conditions/3283 "2025-07-03T07:33:23Z")
The overall context is that I’m looping through a set of items and using an API Query to retrieve 1:many inventory data. I’m first doing a query to scalar in order to establish the max item number ${itemid\_current\_max},… --- ## [Slowness in ETL jobs with AWS Redshift after upgrade METL from 1.72 to 1.78](https://matillioncommunity.discourse.group/t/slowness-in-etl-jobs-with-aws-redshift-after-upgrade-metl-from-1-72-to-1-78/3261)
**Author:** [@helen.zhang](https://matillioncommunity.discourse.group/u/helen.zhang)\ **Replies:** 6\ **Last updated:** [June 26, 2025, 4:48pm UTC](https://matillioncommunity.discourse.group/t/slowness-in-etl-jobs-with-aws-redshift-after-upgrade-metl-from-1-72-to-1-78/3261 "2025-06-26T16:48:45Z")
Hello, I’m experiencing noticeable slowness when running jobs after upgrading from version 1.72 to 1.78. While I understand that performance issues could be related to the database side, I’ve observed that the same jobs… --- ## [Data Transfer Component - Not able to using a Session ID](https://matillioncommunity.discourse.group/t/data-transfer-component-not-able-to-using-a-session-id/3252)
**Author:** [@srinadhan\_samudrala](https://matillioncommunity.discourse.group/u/srinadhan_samudrala)\ **Replies:** 2\ **Last updated:** [June 13, 2025, 3:21pm UTC](https://matillioncommunity.discourse.group/t/data-transfer-component-not-able-to-using-a-session-id/3252 "2025-06-13T15:21:01Z")
Currently Data Transfer Component, Source type HTTPS, is not able to connect using a Session ID , is there any work around. --- ## [Matillion performance question - Transformation job vs sql script component in orchestration job](https://matillioncommunity.discourse.group/t/matillion-performance-question-transformation-job-vs-sql-script-component-in-orchestration-job/3243)
**Author:** [@2068303](https://matillioncommunity.discourse.group/u/2068303)\ **Replies:** 1\ **Last updated:** [June 6, 2025, 10:41am UTC](https://matillioncommunity.discourse.group/t/matillion-performance-question-transformation-job-vs-sql-script-component-in-orchestration-job/3243 "2025-06-06T10:41:22Z")
I need to join 19 tables and volume of data is expected to be 5 millions & there are 100 fields to be populated in one target table. Should we use the sql script components in orchestration jobs or should we use transfor… --- ## [Missing Certification Badge and Certificate from Credly](https://matillioncommunity.discourse.group/t/missing-certification-badge-and-certificate-from-credly/3206)
**Author:** [@nileshkumar.agrawal](https://matillioncommunity.discourse.group/u/nileshkumar.agrawal)\ **Replies:** 2\ **Last updated:** [May 16, 2025, 8:52am UTC](https://matillioncommunity.discourse.group/t/missing-certification-badge-and-certificate-from-credly/3206 "2025-05-16T08:52:47Z")
I recently completed the Matillion ETL foundations certification on May 9, 2025. I also received an email confirming my successful completion of the exam with an overall score of 94%. However, I have not yet received the… --- ## [Matillion Pipeline Statistics](https://matillioncommunity.discourse.group/t/matillion-pipeline-statistics/3204)
**Author:** [@gbird](https://matillioncommunity.discourse.group/u/gbird)\ **Replies:** 1\ **Last updated:** [May 14, 2025, 3:38pm UTC](https://matillioncommunity.discourse.group/t/matillion-pipeline-statistics/3204 "2025-05-14T15:38:31Z")
Hello Matillion Community, Just trying this out, to see if there is anyone out there that has done this before. SITUATION: I would like to track historic status of pipelines that are scheduled. For example over the las… --- ## [Need to create an alert email notification when the Orchestration job fails with the error message](https://matillioncommunity.discourse.group/t/need-to-create-an-alert-email-notification-when-the-orchestration-job-fails-with-the-error-message/3172)
**Author:** [@samatha.marreddy](https://matillioncommunity.discourse.group/u/samatha.marreddy)\ **Replies:** 1\ **Last updated:** [April 24, 2025, 8:04am UTC](https://matillioncommunity.discourse.group/t/need-to-create-an-alert-email-notification-when-the-orchestration-job-fails-with-the-error-message/3172 "2025-04-24T08:04:05Z")
Need to create an alert email notification when the Orchestration job fails with the error message. We are trying to capture the error message and call a snaowflake procedure to send an alert email, but not able to achi… --- ## [Trying to establish a connection from Matillion to Salesforce using OAuth](https://matillioncommunity.discourse.group/t/trying-to-establish-a-connection-from-matillion-to-salesforce-using-oauth/3152)
**Author:** [@kuroiwa](https://matillioncommunity.discourse.group/u/kuroiwa)\ **Replies:** 3\ **Last updated:** [April 14, 2025, 6:52am UTC](https://matillioncommunity.discourse.group/t/trying-to-establish-a-connection-from-matillion-to-salesforce-using-oauth/3152 "2025-04-14T06:52:14Z")
I am currently trying to establish a connection from Matillion to Salesforce using OAuth. Here is what I’ve done so far and the current situation: I followed the instructions in the following documentation to create a… --- ## [How to check Volume?](https://matillioncommunity.discourse.group/t/how-to-check-volume/3149)
**Author:** [@HariRamK](https://matillioncommunity.discourse.group/u/HariRamK)\ **Replies:** 1\ **Last updated:** [April 10, 2025, 1:03pm UTC](https://matillioncommunity.discourse.group/t/how-to-check-volume/3149 "2025-04-10T13:03:18Z")
Hi, Our matillion etl faced Out of memory issue on this month so I checked the log it has not sufficient data I need. I want to find the extract volume consumed during the Out of memory issue. Is this can checked by an… --- ## [How do I use a variable for a date in an SFTP task to only grab the latest file?](https://matillioncommunity.discourse.group/t/how-do-i-use-a-variable-for-a-date-in-an-sftp-task-to-only-grab-the-latest-file/3086)
**Author:** [@tom.ballinger](https://matillioncommunity.discourse.group/u/tom.ballinger)\ **Replies:** 1\ **Last updated:** [March 28, 2025, 5:41pm UTC](https://matillioncommunity.discourse.group/t/how-do-i-use-a-variable-for-a-date-in-an-sftp-task-to-only-grab-the-latest-file/3086 "2025-03-28T17:41:08Z")
so here is what I am trying to do, I have a file with a name of BOB\_Minion\_20250318\_load.txt in an sftp location. tommorrow it will be BOB\_Minion\_20250319\_load.txt. I want to create a pipeline that will run daily and p… --- ## [Using OAuth object in python script](https://matillioncommunity.discourse.group/t/using-oauth-object-in-python-script/3108)
**Author:** [@david.makovoz](https://matillioncommunity.discourse.group/u/david.makovoz)\ **Replies:** 3\ **Last updated:** [March 27, 2025, 12:50pm UTC](https://matillioncommunity.discourse.group/t/using-oauth-object-in-python-script/3108 "2025-03-27T12:50:21Z")
I have an OAuth object that I use to authenticate my connection with a Sharepoint site in a SharePointQuery component. Can you use this object in my Python Script Code? --- ## [No documentation for Replace Invalid Characters in Azure Blob Storage Load](https://matillioncommunity.discourse.group/t/no-documentation-for-replace-invalid-characters-in-azure-blob-storage-load/3110)
**Author:** [@andrew.terwiel](https://matillioncommunity.discourse.group/u/andrew.terwiel)\ **Replies:** 1\ **Last updated:** [March 27, 2025, 9:51am UTC](https://matillioncommunity.discourse.group/t/no-documentation-for-replace-invalid-characters-in-azure-blob-storage-load/3110 "2025-03-27T09:51:24Z")
I was not able to find documentation about this property in this page. https://docs.matillion.com/metl/docs/2954735/?utm\_source=metl&utm\_medium=referral&utm\_campaign=component\_help\_tab --- ## [Fix this Issue](https://matillioncommunity.discourse.group/t/fix-this-issue/3102)
**Author:** [@HariRamK](https://matillioncommunity.discourse.group/u/HariRamK)\ **Replies:** 5\ **Last updated:** [March 24, 2025, 4:17pm UTC](https://matillioncommunity.discourse.group/t/fix-this-issue/3102 "2025-03-24T16:17:13Z")
Found new bug when I move note component I’m getting some pop ups like “failed to move the components. No such Component found” but that note is present. So please have a look on this. --- ## [How can I use the Matillion UI via Nginx?](https://matillioncommunity.discourse.group/t/how-can-i-use-the-matillion-ui-via-nginx/3097)
**Author:** [@daniel.bladeck1600237446198](https://matillioncommunity.discourse.group/u/daniel.bladeck1600237446198)\ **Replies:** 1\ **Last updated:** [March 24, 2025, 11:40am UTC](https://matillioncommunity.discourse.group/t/how-can-i-use-the-matillion-ui-via-nginx/3097 "2025-03-24T11:40:14Z")
To further protect access to Matillion (METL version 1.75.20), we want to implement the configuration as follows: WWW → Google IAP → Nginx → Matillion The problem is the base URL. We have several apps defined on our Ng… --- ## [Can you pls share your experience / any document ( sort of checklist) that i can refer for migrating jobs from matillion ETL to matillion DPC?i came across this documentation from the portal (https://docs.matillion.com/metl/docs/migration/)](https://matillioncommunity.discourse.group/t/can-you-pls-share-your-experience-any-document-sort-of-checklist-that-i-can-refer-for-migrating-jobs-from-matillion-etl-to-matillion-dpc-i-came-across-this-documentation-from-the-portal-https-docs-matillion-com-metl-docs-migration/1129)
**Author:** [@rahulsahay123](https://matillioncommunity.discourse.group/u/rahulsahay123)\ **Replies:** 4\ **Last updated:** [March 20, 2025, 3:46pm UTC](https://matillioncommunity.discourse.group/t/can-you-pls-share-your-experience-any-document-sort-of-checklist-that-i-can-refer-for-migrating-jobs-from-matillion-etl-to-matillion-dpc-i-came-across-this-documentation-from-the-portal-https-docs-matillion-com-metl-docs-migration/1129 "2025-03-20T15:46:07Z")
Can you pls share your experience / any document ( sort of checklist) that i can refer for migrating jobs from matillion ETL to matillion DPC? i came across this documentation from the portal (Migration - Matillion Docs)… --- ## [Cannot set up OAuth in Matillion](https://matillioncommunity.discourse.group/t/cannot-set-up-oauth-in-matillion/2956)
**Author:** [@srinivaspach](https://matillioncommunity.discourse.group/u/srinivaspach)\ **Replies:** 5\ **Last updated:** [March 19, 2025, 1:36pm UTC](https://matillioncommunity.discourse.group/t/cannot-set-up-oauth-in-matillion/2956 "2025-03-19T13:36:49Z")
I am trying to setup OAuth with client id and client secret, but it dos not work… These are the steps I followed. Project → Manage Oauth Name - AppName Service - API Click Settings Grant Type - Client Credentials A… [Next page](https://matillioncommunity.discourse.group/tag/matillion-etl/2.md?match_all_tags=true&page=1&tags%5B%5D=matillion-etl)