# Latest **URL:** https://matillioncommunity.discourse.group/latest.md?page=3 [Latest](https://matillioncommunity.discourse.group/latest.md) · [Categories](https://matillioncommunity.discourse.group/categories.md) · [Tags](https://matillioncommunity.discourse.group/tags.md) **Page:** 4 --- ## [What’s New in Data Productivity Cloud - Summer 2025 Update!](https://matillioncommunity.discourse.group/t/what-s-new-in-data-productivity-cloud-summer-2025-update/3405)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [August 27, 2025, 12:57pm UTC](https://matillioncommunity.discourse.group/t/what-s-new-in-data-productivity-cloud-summer-2025-update/3405 "2025-08-27T12:57:29Z")
Hi Everyone, Thank you for watching our video. We are proud to share what exciting new features have made it into the Data Productivity Cloud! Please continue the discussion here, tell us what you thought… --- ## [:maia\_blink: Using Context Files with Maia to Supercharge Data Workflows](https://matillioncommunity.discourse.group/t/using-context-files-with-maia-to-supercharge-data-workflows/3394)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [August 22, 2025, 3:58pm UTC](https://matillioncommunity.discourse.group/t/using-context-files-with-maia-to-supercharge-data-workflows/3394 "2025-08-22T15:58:20Z")
Check out our latest video on Maia! :maia\_blink: Discover how to supercharge Maia, Matillion’s AI assistant, using context files. Learn how reusable Markdown files with business rules, naming conventions, … --- ## [Python component killed - Script killed; output length exceeded](https://matillioncommunity.discourse.group/t/python-component-killed-script-killed-output-length-exceeded/3389)
**Author:** [@SB699925](https://matillioncommunity.discourse.group/u/SB699925)\ **Replies:** 2\ **Last updated:** [August 22, 2025, 8:09am UTC](https://matillioncommunity.discourse.group/t/python-component-killed-script-killed-output-length-exceeded/3389 "2025-08-22T08:09:48Z")
Hi there, Trying to pull info from an API via python component. The output from the API request (according to postman) is about 406KB - in notepad it is nearly 18 million characters. I’m getting the following error wh… --- ## [Problems with DPC GIT - is it feasible to delete DEV and a QA branch and clone again from MAIN?](https://matillioncommunity.discourse.group/t/problems-with-dpc-git-is-it-feasible-to-delete-dev-and-a-qa-branch-and-clone-again-from-main/3383)
**Author:** [@DWGuy](https://matillioncommunity.discourse.group/u/DWGuy)\ **Replies:** 4\ **Last updated:** [August 14, 2025, 2:29pm UTC](https://matillioncommunity.discourse.group/t/problems-with-dpc-git-is-it-feasible-to-delete-dev-and-a-qa-branch-and-clone-again-from-main/3383 "2025-08-14T14:29:27Z")
We are having an issue with DPC and Matillion supplied GIT where we made a change to DEV branch but when we tried to push to QA branch, suddenly DPC identifies 14 changes in the QA branch out of nowhere (they are previou… --- ## [Are Matillion ETL Environment Variables accessible from the underlying OS?](https://matillioncommunity.discourse.group/t/are-matillion-etl-environment-variables-accessible-from-the-underlying-os/3374)
**Author:** [@kuroiwa](https://matillioncommunity.discourse.group/u/kuroiwa)\ **Replies:** 6\ **Last updated:** [August 13, 2025, 10:47am UTC](https://matillioncommunity.discourse.group/t/are-matillion-etl-environment-variables-accessible-from-the-underlying-os/3374 "2025-08-13T10:47:56Z")
In Matillion ETL, are the values set in Environment Variables accessible only from within the Matillion application? Or is it also possible for the operating system—such as the EC2 instance running Matillion ETL—to acce… --- ## [Help Shape Our Documentation 📄](https://matillioncommunity.discourse.group/t/help-shape-our-documentation/3380)
**Author:** [@Joe-Community-Manager](https://matillioncommunity.discourse.group/u/Joe-Community-Manager)\ **Replies:** 0\ **Last updated:** [August 7, 2025, 3:22pm UTC](https://matillioncommunity.discourse.group/t/help-shape-our-documentation/3380 "2025-08-07T15:22:33Z")
Hi all, Today we’ve opened up something exciting, a way for you to help the discussion and improve the documentation to be even more impactful. Do you have a suggestion on how to improve a particular doc? How about a u… --- ## [:maia\_blink: Build Custom API Connectors with Maia in Minutes](https://matillioncommunity.discourse.group/t/build-custom-api-connectors-with-maia-in-minutes/3335)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [July 25, 2025, 4:19pm UTC](https://matillioncommunity.discourse.group/t/build-custom-api-connectors-with-maia-in-minutes/3335 "2025-07-25T16:19:28Z")
Check out our latest video on Maia! :maia\_blink: In this video, learn how Maia can build a custom API connector using just a documentation link! In this quick tutorial, we give Maia full control—and watch … --- ## [Migration Tool Improvements](https://matillioncommunity.discourse.group/t/migration-tool-improvements/2947)
**Author:** [@jamie.cole](https://matillioncommunity.discourse.group/u/jamie.cole)\ **Replies:** 3\ **Last updated:** [July 24, 2025, 8:30am UTC](https://matillioncommunity.discourse.group/t/migration-tool-improvements/2947 "2025-07-24T08:30:21Z")
Hi folks, I’m the Product Manager for the Matillion ETL → Data Productivity Cloud migration tool used for moving across pipelines. We designed the migration tool to remove the manual effort of rebuilding your pipelines… --- ## [Access Project Secret Definitions from Python Pushdown Component](https://matillioncommunity.discourse.group/t/access-project-secret-definitions-from-python-pushdown-component/3327)
**Author:** [@bhensel](https://matillioncommunity.discourse.group/u/bhensel)\ **Replies:** 1\ **Last updated:** [July 23, 2025, 2:51pm UTC](https://matillioncommunity.discourse.group/t/access-project-secret-definitions-from-python-pushdown-component/3327 "2025-07-23T14:51:34Z")
Hello I am looking to use the python pushdown component to generate a JWT Bearer Token and then update a Matillion Project Secret Definition for use with a Custom REST API connector I created. Is it possible to read/wri… --- ## [Use projects group password in python script](https://matillioncommunity.discourse.group/t/use-projects-group-password-in-python-script/3324)
**Author:** [@RemigiousMikevin.James](https://matillioncommunity.discourse.group/u/RemigiousMikevin.James)\ **Replies:** 1\ **Last updated:** [July 18, 2025, 8:58am UTC](https://matillioncommunity.discourse.group/t/use-projects-group-password-in-python-script/3324 "2025-07-18T08:58:04Z")
I have a Blob Storage connection string stored in Azure Key Vault, and I’ve added the Key Vault to the Secret Manager in Matillion under Project Group Passwords. I then created a password entry in Matillion from the conf… --- ## [:maia\_blink: Meet Maia: Your 24/7 Data Team](https://matillioncommunity.discourse.group/t/meet-maia-your-24-7-data-team/3274)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 1\ **Last updated:** [July 11, 2025, 4:09pm UTC](https://matillioncommunity.discourse.group/t/meet-maia-your-24-7-data-team/3274 "2025-07-11T16:09:59Z")
Hello everyone! :maia\_blink: We’re proud to announce that Maia is now live! Maia is your intelligent assistant in the Data Productivity Cloud. To find out more check out our video below, take a look at our Documentation … --- ## [Full log required for API Query](https://matillioncommunity.discourse.group/t/full-log-required-for-api-query/3303)
**Author:** [@StewD](https://matillioncommunity.discourse.group/u/StewD)\ **Replies:** 5\ **Last updated:** [July 10, 2025, 7:53am UTC](https://matillioncommunity.discourse.group/t/full-log-required-for-api-query/3303 "2025-07-10T07:53:00Z")
I am having some issues with an API query. The first time the query runs I get a page worth of data back in about 5 seconds. I am using a loop iterator to make the calls for subsequent pages. Each time the loop iterates… --- ## [New issues with Create Table component starting from April 2025 (Matillion DPC for Snowflake)](https://matillioncommunity.discourse.group/t/new-issues-with-create-table-component-starting-from-april-2025-matillion-dpc-for-snowflake/3140)
**Author:** [@MW](https://matillioncommunity.discourse.group/u/MW)\ **Replies:** 4\ **Last updated:** [July 9, 2025, 1:08pm UTC](https://matillioncommunity.discourse.group/t/new-issues-with-create-table-component-starting-from-april-2025-matillion-dpc-for-snowflake/3140 "2025-07-09T13:08:49Z")
Noticed two new issues when creating a Snowflake table in Matillion DPC: There is a new version of the ”Create Table”-component. A message about it appeared in an Orchestration pipeline. Problem is that I cannot find … --- ## [Need Some Clarification!](https://matillioncommunity.discourse.group/t/need-some-clarification/3293)
**Author:** [@HariRamK](https://matillioncommunity.discourse.group/u/HariRamK)\ **Replies:** 7\ **Last updated:** [July 9, 2025, 9:04am UTC](https://matillioncommunity.discourse.group/t/need-some-clarification/3293 "2025-07-09T09:04:52Z")
I have a Main Job with One Orchestration and five transformation, which run parallely, while running I want all job to start parallely but every time one or two transformation jobs / orchestration job is not starting ini… --- ## [Matillion API orchestration jobs](https://matillioncommunity.discourse.group/t/matillion-api-orchestration-jobs/3301)
**Author:** [@lucas.guevremont](https://matillioncommunity.discourse.group/u/lucas.guevremont)\ **Replies:** 1\ **Last updated:** [July 7, 2025, 8:30am UTC](https://matillioncommunity.discourse.group/t/matillion-api-orchestration-jobs/3301 "2025-07-07T08:30:59Z")
Hello, I am currently using the Matillion API to find all orchestration jobs, to then find a way to group them to their parent jobs to eventually create a KPI for pipeline availability. I don’t seem to see the connectio… --- ## [Loop Iterator - issue with advanced conditions](https://matillioncommunity.discourse.group/t/loop-iterator-issue-with-advanced-conditions/3283)
**Author:** [@chris.odell1617208923357](https://matillioncommunity.discourse.group/u/chris.odell1617208923357)\ **Replies:** 3\ **Last updated:** [July 3, 2025, 7:33am UTC](https://matillioncommunity.discourse.group/t/loop-iterator-issue-with-advanced-conditions/3283 "2025-07-03T07:33:23Z")
The overall context is that I’m looping through a set of items and using an API Query to retrieve 1:many inventory data. I’m first doing a query to scalar in order to establish the max item number ${itemid\_current\_max},… --- ## [Slowness in ETL jobs with AWS Redshift after upgrade METL from 1.72 to 1.78](https://matillioncommunity.discourse.group/t/slowness-in-etl-jobs-with-aws-redshift-after-upgrade-metl-from-1-72-to-1-78/3261)
**Author:** [@helen.zhang](https://matillioncommunity.discourse.group/u/helen.zhang)\ **Replies:** 6\ **Last updated:** [June 26, 2025, 4:48pm UTC](https://matillioncommunity.discourse.group/t/slowness-in-etl-jobs-with-aws-redshift-after-upgrade-metl-from-1-72-to-1-78/3261 "2025-06-26T16:48:45Z")
Hello, I’m experiencing noticeable slowness when running jobs after upgrading from version 1.72 to 1.78. While I understand that performance issues could be related to the database side, I’ve observed that the same jobs… --- ## [How to get the pagination URL from the Response Header?](https://matillioncommunity.discourse.group/t/how-to-get-the-pagination-url-from-the-response-header/1310)
**Author:** [@saqib](https://matillioncommunity.discourse.group/u/saqib)\ **Replies:** 3\ **Last updated:** [June 26, 2025, 1:18pm UTC](https://matillioncommunity.discourse.group/t/how-to-get-the-pagination-url-from-the-response-header/1310 "2025-06-26T13:18:57Z")
We are using Matillion to connect to the Greenhouse Harvest APIs. The Harvest APIs send the pagination URL in the response header, instead of sending it in the JSON response. How can I make Matillion read the pagination … --- ## [Data Transfer Component - Not able to using a Session ID](https://matillioncommunity.discourse.group/t/data-transfer-component-not-able-to-using-a-session-id/3252)
**Author:** [@srinadhan\_samudrala](https://matillioncommunity.discourse.group/u/srinadhan_samudrala)\ **Replies:** 2\ **Last updated:** [June 13, 2025, 3:21pm UTC](https://matillioncommunity.discourse.group/t/data-transfer-component-not-able-to-using-a-session-id/3252 "2025-06-13T15:21:01Z")
Currently Data Transfer Component, Source type HTTPS, is not able to connect using a Session ID , is there any work around. --- ## [Matillion performance question - Transformation job vs sql script component in orchestration job](https://matillioncommunity.discourse.group/t/matillion-performance-question-transformation-job-vs-sql-script-component-in-orchestration-job/3243)
**Author:** [@2068303](https://matillioncommunity.discourse.group/u/2068303)\ **Replies:** 1\ **Last updated:** [June 6, 2025, 10:41am UTC](https://matillioncommunity.discourse.group/t/matillion-performance-question-transformation-job-vs-sql-script-component-in-orchestration-job/3243 "2025-06-06T10:41:22Z")
I need to join 19 tables and volume of data is expected to be 5 millions & there are 100 fields to be populated in one target table. Should we use the sql script components in orchestration jobs or should we use transfor… --- ## [Beginner User Group - May 2025 - Resources, best visual practices and data ops](https://matillioncommunity.discourse.group/t/beginner-user-group-may-2025-resources-best-visual-practices-and-data-ops/3247)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [June 4, 2025, 10:27am UTC](https://matillioncommunity.discourse.group/t/beginner-user-group-may-2025-resources-best-visual-practices-and-data-ops/3247 "2025-06-04T10:27:59Z")
Hi all! Thank you to everyone that came to the session, I hope you found it informative! And a massive thank you as always to our hosts, @marcus.blackhill and @WilliamAubrey! If you missed the session or want to rewatc… --- ## [What’s New in Data Productivity Cloud - Spring 2025 Update!](https://matillioncommunity.discourse.group/t/what-s-new-in-data-productivity-cloud-spring-2025-update/3228)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [May 23, 2025, 10:37am UTC](https://matillioncommunity.discourse.group/t/what-s-new-in-data-productivity-cloud-spring-2025-update/3228 "2025-05-23T10:37:57Z")
Hi all! Check out our video on the latest features in the Data Productivity Cloud. --- ## [The Beginners User Group returns! Friday 30th May, 10 AM PT / 1 PM ET / 6 PM GMT](https://matillioncommunity.discourse.group/t/the-beginners-user-group-returns-friday-30th-may-10-am-pt-1-pm-et-6-pm-gmt/3222)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [May 21, 2025, 4:36pm UTC](https://matillioncommunity.discourse.group/t/the-beginners-user-group-returns-friday-30th-may-10-am-pt-1-pm-et-6-pm-gmt/3222 "2025-05-21T16:36:27Z")
Hi everyone! Our next Beginner User Group Virtual Event is soon and we’d love for you to join us! In this session our hosts @marcus.blackhill and @WilliamAubrey will be sharing top resources for your data needs at Mat… --- ## [METL - How to Upgrade Snowflake JDBC Driver](https://matillioncommunity.discourse.group/t/metl-how-to-upgrade-snowflake-jdbc-driver/3220)
**Author:** [@SB699925](https://matillioncommunity.discourse.group/u/SB699925)\ **Replies:** 1\ **Last updated:** [May 20, 2025, 8:43am UTC](https://matillioncommunity.discourse.group/t/metl-how-to-upgrade-snowflake-jdbc-driver/3220 "2025-05-20T08:43:21Z")
Hi there We are on METL 1.68.26 hosted on our own AWS server instance. Our Snowflake JDBC driver is currently version 3.13.26 which I think is what comes standard with our version of METL. Snowflake has said we need t… --- ## [Missing Certification Badge and Certificate from Credly](https://matillioncommunity.discourse.group/t/missing-certification-badge-and-certificate-from-credly/3206)
**Author:** [@nileshkumar.agrawal](https://matillioncommunity.discourse.group/u/nileshkumar.agrawal)\ **Replies:** 2\ **Last updated:** [May 16, 2025, 8:52am UTC](https://matillioncommunity.discourse.group/t/missing-certification-badge-and-certificate-from-credly/3206 "2025-05-16T08:52:47Z")
I recently completed the Matillion ETL foundations certification on May 9, 2025. I also received an email confirming my successful completion of the exam with an overall score of 94%. However, I have not yet received the… --- ## [Google Calendar](https://matillioncommunity.discourse.group/t/google-calendar/3203)
**Author:** [@SB699925](https://matillioncommunity.discourse.group/u/SB699925)\ **Replies:** 5\ **Last updated:** [May 14, 2025, 5:06pm UTC](https://matillioncommunity.discourse.group/t/google-calendar/3203 "2025-05-14T17:06:21Z")
Hi there - does Matillion ETL have a Google Calendar connector? I can’t see one specifically in the Matillion component list but thought maybe it’s part of another connector… Anyone had success in connecting to Google … --- ## [Matillion Pipeline Statistics](https://matillioncommunity.discourse.group/t/matillion-pipeline-statistics/3204)
**Author:** [@gbird](https://matillioncommunity.discourse.group/u/gbird)\ **Replies:** 1\ **Last updated:** [May 14, 2025, 3:38pm UTC](https://matillioncommunity.discourse.group/t/matillion-pipeline-statistics/3204 "2025-05-14T15:38:31Z")
Hello Matillion Community, Just trying this out, to see if there is anyone out there that has done this before. SITUATION: I would like to track historic status of pipelines that are scheduled. For example over the las… --- ## [The Roadmap is evolving!](https://matillioncommunity.discourse.group/t/the-roadmap-is-evolving/3213)
**Author:** [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\ **Replies:** 0\ **Last updated:** [May 14, 2025, 1:59pm UTC](https://matillioncommunity.discourse.group/t/the-roadmap-is-evolving/3213 "2025-05-14T13:59:25Z")
Hi all, Here at Matillion we are always striving to improve all that we do. With that in mind, we we are updating how our Roadmap works to bring you a better understanding of when new features will be released. We’ve al… --- ## [Hybrid agent installation - Can it be installed on an on-prem server?](https://matillioncommunity.discourse.group/t/hybrid-agent-installation-can-it-be-installed-on-an-on-prem-server/3198)
**Author:** [@DWGuy](https://matillioncommunity.discourse.group/u/DWGuy)\ **Replies:** 4\ **Last updated:** [May 12, 2025, 7:30pm UTC](https://matillioncommunity.discourse.group/t/hybrid-agent-installation-can-it-be-installed-on-an-on-prem-server/3198 "2025-05-12T19:30:18Z")
Currently we are only using the full SaaS agent. We have a on-prem sql server database which we want to replicate parts to Snowflake. Is it possible to install a Matillion Hybrid agent on an on-prem server within our n… --- ## [Strange error when testing dbt in matillion cloud](https://matillioncommunity.discourse.group/t/strange-error-when-testing-dbt-in-matillion-cloud/3193)
**Author:** [@\_jack](https://matillioncommunity.discourse.group/u/_jack)\ **Replies:** 3\ **Last updated:** [May 7, 2025, 2:33pm UTC](https://matillioncommunity.discourse.group/t/strange-error-when-testing-dbt-in-matillion-cloud/3193 "2025-05-07T14:33:32Z")
did I messed up somewhere? I can’t seem to run a simple dbt --version to test out mat and dbt integration [Previous page](https://matillioncommunity.discourse.group/latest.md?page=2) [Next page](https://matillioncommunity.discourse.group/latest.md?page=4)