# Has anyone been able to pull more than 100 survey responses per survey from SurveyMonkey?

**URL:** <https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917>\
**Category:** Matillion ETL\
**Created:** [August 10, 2022, 2:52pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917 "2022-08-10T14:52:06Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![seth.mitchell](https://avatars.discourse-cdn.com/v4/letter/s/7feea3/32.png) [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell)\
**Post date:** [August 10, 2022, 2:52pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/1 "2022-08-10T14:52:06Z")

</div>

We are currently having issues with our SurveyMonkey orchestration job. It is only pulling back the first 100 responses for each survey. There is reference to the 100 results on the SurveyMonkey documentation&nbsp;(https://api.surveymonkey.net/v3/docs?api\_key=3yr7n6m8sjwvm48x8nhxej52#export-the-results-of-a-survey)

---

<div class="post-metadata">

**Author:** ![ClaireSeniorCommunityManager](https://avatars.discourse-cdn.com/v4/letter/c/7ba0ec/32.png) [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\
**Post date:** [August 16, 2022, 9:15am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/2 "2022-08-16T09:15:10Z")

</div>

Hi [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell)​ and thanks for posting!

It sounds like the limit might be defaulting to 100. On the Properties section for the SurveyMonkey component, look for Limit property and the Value of it. If you remove the 100 you should get more. You can find documentation on [**SurveyMonkey Query here**](https://documentation.matillion.com/docs/2953354) which may also help.

I hope that helps! Let me know how you get on.

Many thanks,

Claire

---

<div class="post-metadata">

**Author:** ![seth.mitchell](https://avatars.discourse-cdn.com/v4/letter/s/7feea3/32.png) [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell)\
**Post date:** [September 6, 2022, 5:45pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/3 "2022-09-06T17:45:51Z")

</div>

[@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)​ Thanks for getting back to me! We are still having the issue after removing the limits as [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)​ also is mentioning.

We are running:

Matillion ETL

Version: 1.65.7 (build 159812d-12014)

AMI Version: 1.65.7

---

<div class="post-metadata">

**Author:** ![SK607582](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@SK607582](https://matillioncommunity.discourse.group/u/SK607582)\
**Post date:** [September 8, 2022, 6:18am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/4 "2022-09-08T06:18:27Z")

</div>

I've successfully queried SurveyMonkey with the latest version of [CData's JDBC driver](https://www.cdata.com/drivers/surveymonkey/download/jdbc/) (default options, didn't tweak anything). Used Dbeaver. Received proper number of records, not just one page/100 records.

Latest Cdata jdbc version **22.0.8257**

Matillion **1.65.8-1** uses version **21.0.8137.0**

[@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)​ could you please share this info with the engineering/development team. It looks like a bug in either SM component or driver version in use.

I've provided more details on case #00055112

FYI [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell)​ [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)​

---

<div class="post-metadata">

**Author:** ![seth.mitchell](https://avatars.discourse-cdn.com/v4/letter/s/7feea3/32.png) [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell)\
**Post date:** [September 8, 2022, 2:11pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/5 "2022-09-08T14:11:15Z")

</div>

[@SK607582](https://matillioncommunity.discourse.group/u/SK607582)​ we too were getting the proper results outside of Matillion and just hitting the SurveyMonkey API directly. We were able to get 1700+ Unique Respondent IDs using Python and iterating over each page. When we hit the Matillion component, we are limited to 100 Unique Respondent IDs.

[@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)​

---

<div class="post-metadata">

**Author:** ![KevinH](https://avatars.discourse-cdn.com/v4/letter/k/4af34b/32.png) [@KevinH](https://matillioncommunity.discourse.group/u/KevinH)\
**Post date:** [October 4, 2022, 9:21pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/6 "2022-10-04T21:21:51Z")

</div>

We're also having this issue. Please help!

Matillion Version: 1.65.8 (build 2caa62f-12676)

I'm not sure, but I do think this bug might have been introduced in a recent version of Matillion, or something. Earlier this year, I think we were able to get results for more than 100 respondent IDs.

---

<div class="post-metadata">

**Author:** ![ClaireSeniorCommunityManager](https://avatars.discourse-cdn.com/v4/letter/c/7ba0ec/32.png) [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\
**Post date:** [October 10, 2022, 8:56am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/7 "2022-10-10T08:56:03Z")

</div>

Hi all and thank you all so much for posting and for your patience.

&nbsp;

The team has added a fix for this in the [new 1.66 update](https://documentation.matillion.com/docs/metl-166-release-notes). Please take a look and let us know how you get on.

&nbsp;

Again, thanks so much for your patience while this was investigated.&nbsp;

Many thanks,

Claire

&nbsp;

---

<div class="post-metadata">

**Author:** ![vp120821](https://avatars.discourse-cdn.com/v4/letter/v/e8c25b/32.png) [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)\
**Post date:** [September 6, 2022, 4:40am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/8 "2022-09-06T04:40:56Z")

</div>

Hi [@seth.mitchell](https://matillioncommunity.discourse.group/u/seth.mitchell) (Customer)​. I too am facing the same issue. Do update this thread if you are able to find the solution to this.

Hi [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager) (Matillion Limited)​.

I tried to get the row count when the limit is 100 and after removing it. Unfortunately both the counts are same.

Moreover I also tried to increase the pagesize in connection options field of component to 1000, but looks like it is capped at 100 as per the documentation.

So, we need a way to achieve following things:

1. Get a list of all the page IDs for **{Survey\_Title\_Responses}**
2. Iterate all these page IDs for **{Survey\_Title\_Responses}** and load it into one table using SurveyMonkey Query component

---

<div class="post-metadata">

**Author:** ![ClaireSeniorCommunityManager](https://avatars.discourse-cdn.com/v4/letter/c/7ba0ec/32.png) [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\
**Post date:** [September 8, 2022, 2:55pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/9 "2022-09-08T14:55:59Z")

</div>

Hi there [@SK607582](https://matillioncommunity.discourse.group/u/SK607582)​ and thanks for your post! I've passed that information onto the team.

Many thanks,

Claire

---

<div class="post-metadata">

**Author:** ![cedric.warren](https://avatars.discourse-cdn.com/v4/letter/c/858c86/32.png) [@cedric.warren](https://matillioncommunity.discourse.group/u/cedric.warren)\
**Post date:** [October 4, 2022, 9:31pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/10 "2022-10-04T21:31:23Z")

</div>

After months of research and frustration we came to the conclusion that the Matillion Component Itself must be either hard coded to limit to 100 responses or the pagination isnt set up correctly. Either possibility means the component is worthless. We were however able to use the API Query Component to get Survey Monkey into Snowflake, a lot more setup is required but in the end, spent less time setting that up than trying to QA the Matillion Component.

---

<div class="post-metadata">

**Author:** ![ClaireSeniorCommunityManager](https://avatars.discourse-cdn.com/v4/letter/c/7ba0ec/32.png) [@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager)\
**Post date:** [September 6, 2022, 4:18pm UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/11 "2022-09-06T16:18:35Z")

</div>

Thanks for posting [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)​. Can you let me know what version of Matillion ETL you are on so that the team can take a further look?

Many thanks,

Claire

---

<div class="post-metadata">

**Author:** ![vp120821](https://avatars.discourse-cdn.com/v4/letter/v/e8c25b/32.png) [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)\
**Post date:** [September 7, 2022, 6:04am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/12 "2022-09-07T06:04:51Z")

</div>

[@ClaireSeniorCommunityManager](https://matillioncommunity.discourse.group/u/ClaireSeniorCommunityManager) (Matillion Limited)​

For me it is:

**Matillion ETL**

Version: 1.61.6 (build a392342-2471)

AMI Version: 1.61.6

---

<div class="post-metadata">

**Author:** ![vp120821](https://avatars.discourse-cdn.com/v4/letter/v/e8c25b/32.png) [@vp120821](https://matillioncommunity.discourse.group/u/vp120821)\
**Post date:** [October 7, 2022, 5:05am UTC](https://matillioncommunity.discourse.group/t/has-anyone-been-able-to-pull-more-than-100-survey-responses-per-survey-from-surveymonkey/1917/13 "2022-10-07T05:05:01Z")

</div>

Hi [@cedric.warren](https://matillioncommunity.discourse.group/u/cedric.warren)​ .

Can you please elaborate more on the additional setup that is required to set up API Query component for fetching SurveyMonkey Responses? Thanking you in advance.
