Connected Devices/Projects/Metrics/Database and Visualization

< Connected Devices‎ | Projects‎ | Metrics
Revision as of 15:50, 15 June 2016 by Doliver (talk | contribs) (Initial)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Summary

We are using a combination of Google Analytics, Google BigQuery database, and Re:Dash to enable teams to view & analyze project data. This page will describe what data we have and how to access it.

BigQuery

BigQuery is Google's cloud-based big data solution. We are using it as a store for all of the data sent to Google Analytics so that teams can view the full detail of all events sent by their application, rather than the aggregated views that are presented in the Google Analytics dashboards.

Data is imported in batches from Analytics several times per day. Note that there may be a delay of up to 8 hours before event data is exported, though it usually seems to arrive within 2 hours.

BigQuery supports a subset of SQL, covering most common clauses and operators. For a full reference, see https://cloud.google.com/bigquery/query-reference.

Table Schema

The Analytics data is exported into a series of tables, which are named as follows:

  • ga_sessions_20160613 - This table contains all event data recorded on 2016-06-13. A new table is created for each day's data.
  • ga_sessions_intraday_20160614 - This table contains all event data that has been exported for the current day, and batches of data will be appended to it several times during the day.

If you are familiar with Google Analytics data and/or working with multi-dimensional data, you are welcome to query these tables directly. You can find the schema reference here: https://support.google.com/analytics/answer/3437719


  • custom views
    • schema
    • 7day
    • 30day
    • can further customize as necessary to help you access your data, e.g. SH-events
  • github

Data/Vis

  • G analytics
    • file bug to request access
  • re:dash
** soon to be available at sql.telemetry.m.o
  • periscope
** contact doliver for access
  • other tools may be able to access
** contact doliver