Google Analytics connector multiple errors

Data Productivity Cloud
1

Hi, I'm trying to use the Google Analytics connector with our GA4 account to land data in Snowflake.

 

Our pipeline is throwing multiple errors whenever we try and run it, however. The most common errors are:

 

  • Error: Parameter Validation Failure: SQL Query - At most 9 dimensions can be specified in the query.
  • Error: Parameter Validation Failure: SQL Query - Attribute 'Parent' is required to query the table.
  • #825 [Query source] - Parameter Validation Failure: SQL Query - At most ten metrics can be specified in the query.
  • AttributeError: 'NoneType' object has no attribute 'upper' Script failed with status: 1

 

It isn't clear how to specify what dimensions/metrics are pulled during the sync. Is this a case of removing some of the columns against each table? The documentation here https://documentation.matillion.com/mdl/docs/google-analytics-batch-pipeline doesn't mention anything about having to restrict what is being requested during the sync.

 

I'm a little lost as to how to resolve this and bring in our GA data.

 

Has anyone been able to get this working who can advise where we're going wrong?

2

Digging into this further, I've been able to move past some of the errors. To resolve the "at most x dimensions/metrics" errors, it's a case of removing some of the fields from the source tables in the MDL pipeline setup.

 

The Matillion Google Analytics 4 data model document lists which are dimensions and which are metrics under each source table/view: https://matillion-docs.s3.eu-west-1.amazonaws.com/datamodels/Google+Analytics+4.html#Tables

 

Getting past that error, I removed the tables/views from my pipeline that were encountering different errors, and the pipeline runs successfully. However, there are no rows returned from GA for any of the tables that have a date component. Checking the same combination of Dimensions and Metrics via the Google Analytics Query Explorer https://ga-dev-tools.google/ga4/query-explorer/ I can see that I should have data for all of those.

 

Can anyone help me understand why I'm not getting data back from the connector?

3

Hi @gshenanigan​, are you still seeing these issues?

I've checked in with the team and they've asked if you can pass along the logs from the failed pipelines if you are still having issues. If you want to post them here that's fine or if you'd prefer, you can send them to me via private message.

As a note, the metrics and dimensions limits are imposed by Google so you may need to amend the columns you are selecting. I suggest double checking with the Google Documentation as Google may have updated the API since our documentation was written.

Let me know how you get on,

Claire

4

In Dataloader Advanced Settings, did you set up this for Google Analytics 4:

 

https://docs.matillion.com/data-productivity-cloud/batch/docs/google-analytics-batch-pipeline/#set-frequency:~:text=To%20select%20the%20Google%20Analytics%204%20(GA4)%20data%20source%2C%20access%20the%20Advanced%20Settings%20and%20add%20a%20parameter%20with%20the%20following%20selections%3A%20Parameter%20%3D%20Schema%2C%20Value%20%3D%20GoogleAnalytics4

 

?

5

Hi Claire, thanks for getting back to me.

 

We ended up giving up on MDL and switching to doing it via METL job.

 

Reducing the number of dimensions and metrics we requested solved some of the errors but we were still experiencing the other two errors via MDL:

  • AttributeError: 'NoneType' object has no attribute 'upper' Script failed with status: 1
  • Error: Parameter Validation Failure: SQL Query - Attribute 'Parent' is required to query the table.

 

I'll look at downloading the logs and sharing these via DM.

6

Hi, sorry for the delayed response. Yes it was configured with the settings for GA4.