Does increasing the concurrent user sessions affect the data load via Database Query component? When I increase the concurrent user sessions to 4, the Database Query loads only partial data to Snowflake tables

merlin.peter · April 5, 2022, 10:51pm

However, when I set the concurrent user sessions to 1, it loads all of the data from Source to Snowflake tables.

Data size between 1 GB to 5 GB.

ClaireSeniorCommunityManager · April 6, 2022, 11:08am

Hi @merlin.peter and welcome to the community!

We have some documentation that might help your query. Please take a look and let me know if the information there helps at all.

I hope that helps!

Many thanks,

Claire

Topic		Replies	Views
Increase Snowflake Cluster Size or Number of Cluster for concurrent grid iterators? Matillion ETL	0	3	November 13, 2021
Has anyone been able to make the concurrent setting for a grid variable or table iterator work for a snowflake environment. If so, can you share your configuration to storage? Matillion ETL	9	15	April 19, 2022
Database Query Component - Going into a hung mode when extracting moderate volumes of data Matillion ETL	2	11	September 16, 2022
What is making staging from a Database Query so slow? Matillion ETL	1	13	April 15, 2021
Hi , I am trying to extract the SFDC data . One of the table have high volume , which is 86M records . Some times data is not reading after 3 hours run also not sure what is happening . Tried with to limit the with 10 concurrent process Matillion ETL	0	0	May 13, 2023