Sources - Google Analytics 360 (GA360)

Configurations

Prerequisites

To integrate Google Analytics data into our system, the customer must set up BigQuery Export from their Google Analytics account to their own Big Query data warehouse, and provide the project ID and database ID. Please refer to the Google Documentation for instructions on performing the BigQuery Export.

Once set up, their Google Account will export tables to BigQuery daily. We can then pull data from BigQuery using one of the following methods:

• BigQuery REST API
  • BigQuery API must be enabled
  • Standard method for retrieving data from BigQuery. Responses are usually large and slow.
    • Suitable and faster for smaller datasets.
    • Authentication via OAuth.
• BigQuery Storage API
  • BigQuery Storage API must be enabled
  • A newer API from BigQuery that allows fetching binary data from BigQuery, making fetching much faster.
    • Optimal for larger datasets.
    • Free 300TB of data fetch + network charges.
    • Authentication via Service Account.
      • Service Account must have the BigQuery Read Session User role enabled.

Both fetching methods are priced, and the cost falls on the customer's side. Please refer to the BigQuery cost documentation for further details.

Connector Configurations

• Include Intraday Tables

Intraday tables are tables that are updated throughout the day. Enabling this option will sync data from these tables each time the pipeline runs. Note that enabling this option will increase the amount of synced data, but the data will be the most up-to-date. Non-intraday tables will only be synced once.

Collections