After migrating to Matillion 1.73, I have a validation test failing with Google Analytics v4. The job runs but returns zero rows. Below is the verbose output. The job steps finish almost instantly - like it is not really trying to fetch records. I masked the property id in the log below but I confirmed it returns data in my pre-migration environment.
*** One thing I notice is that near the bottom, the log indicates that the query was run in "Mode schema only" and returned 0 rows. Is this a debug setting? I cannot find documentation on what this is or how it got invoked in my 1.73 job.
2023-12-14T23:25:29.003+0000 1 [24|Q-Id] [EXEC|Messag] Executed query: [SELECT
"Date",
"TotalUsers",
"userEngagementDuration",
"ScreenPageViews",
"Dimensions",
"Metrics",
'*********' VIEW_ID
FROM "Engagement"
WHERE
( "StartDate" = '14daysago' )
AND
( "EndDate" = '12daysago' )
LIMIT 0] Mode: [Schema Only] Success: (7 ms)
2023-12-14T23:25:29.183+0000 5 [ |Q-Id] [META|Schema] Engine Invalid object name 'sys_disconnect'
2023-12-14T23:25:29.183+0000 4 [24|Q-Id] [INFO|Connec] Executed sys_disconnect: Success: (0 ms)
2023-12-14T23:25:29.183+0000 1 [24|Q-Id] [INFO|Connec] Closed GoogleAnalytics connection
Additional Information: I am using the Matillion Google Analytics component in Advanced mode. When I compose the query (shown above), I am able to get a few rows returned from clicking the "Sample" button . So I assume the API call works for that purpose, but for every v4 property I process via job execution, the job component stages 0 rows.
Below are the connection options, most of which use enironment values equal to my pre-migration instance.
Hello @CR295672
I have spoken with our team about your post and it sounds like it will need them to take a closer look into this for you, I have raised a case on your behalf.
Please do let me know if you need anything else.
Kind regards, Joe
Joe, I used the advice another community member to rebuild the Googla Analytics Query component from scratch. I am using the ga4 API only. I copied my previous configuration options and now I am able to get some data returned, however the dimensions and metrics I specify in the connection options DefaultFilter parameter are not returned. See my post above with the connection options dialog and the DefaultFilter line. In my 1.59 matillion instance this configuration returned the requested dimensions/metrics, but it does not in the 1.73 migration. Where possible, I moved some of the requested dimensions into a SQL query, but some I cannot extract. For example I am unable to get landingPage out of ga4 using the DefaultFilter parameter. Is this method still supported? If not, how do I get landingPage using the GA query component?
