Python component killed - Script killed; output length exceeded

Matillion ETL
1

Hi there,

Trying to pull info from an API via python component.
The output from the API request (according to postman) is about 406KB - in notepad it is nearly 18 million characters.

I’m getting the following error when I run this in Matillion:

Script killed; output length exceeded

Is this a restriction in Matillion? Is there a configuration setting we can adjust to handle large responses like this?

I did find the following article which seems somewhat related although it mentions a different error message:

Error: Exception: Script variable length exceeds the maximum of 5000000

Any assistance would be much appreciated!

Thanks!

2

Haha - so I figured out I was trying to “print” the response prior to dataframing it. That was the cause of the failure. :smiley:

Lesson is - print just a sample of the response if anything at all on really large response text.

3

Hi @SB699925

Thanks so much for coming back and sharing the solution! If you do have any other questions, please don’t hesitate to ask!

Many thanks, Claire