Auto-tools/Projects/Structured Logging: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 24: Line 24:
The primary logging API for our data format is mozlog's structured module ([http://mozbase.readthedocs.org/en/latest/mozlog_structured.html readthedocs]).
The primary logging API for our data format is mozlog's structured module ([http://mozbase.readthedocs.org/en/latest/mozlog_structured.html readthedocs]).


For data originating from JavaScript or Java, StructuredLog.jsm and StructuredLogger.java have been implemented to produce this data format. Mozlog supports logging data directly from these producers with log_raw.
For data originating from JavaScript or Java, StructuredLog.jsm and StructuredLogger.java have been implemented to produce this data format. Mozlog supports logging data directly from these producers.


== Status ==
== Status ==

Revision as of 20:52, 26 August 2014

This page is a high level account of the structured logging project providing links to many resources about the project. This page is a work in progress.

Background and Motivation

Goals:

  • Support a range of output formats for test results
  • Eliminate complex and brittle regex based log parsing
  • Consolidate output processing and logging configuration

Approach:

  • Establish a common data format for test results and test harness diagnostics
  • Populate data format in-harness with a logging API designed to output this format
  • Log data from test harnesses as JSON rather than formatted strings

Implementation

Participant Systems

  • Producer process (Firefox/Fennec/B2G - JS/Java/C++)
  • Test harness (Python/JS)
  • Mozharness/Buildbot
  • Tbpl/Treeherder
  • Blobber

Logging APIs

The primary logging API for our data format is mozlog's structured module (readthedocs).

For data originating from JavaScript or Java, StructuredLog.jsm and StructuredLogger.java have been implemented to produce this data format. Mozlog supports logging data directly from these producers.

Status

  • The tracking bug for this effort is bug916295.
  • An etherpad with high-level status updates per test harness is maintained for the time being.