Unified Telemetry/Status reports/dataprogram/datapipeline: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(new page)
 
(formatting)
 
(2 intermediate revisions by the same user not shown)
Line 3: Line 3:


=== Overall Project Health ===
=== Overall Project Health ===
Pipeline: Green
* Pipeline: Green
desktop client: Yellow
* desktop client: Yellow
SvcOps: Green
* SvcOps: Green


=== Exec Summary ===
=== Exec Summary ===
* Issue with TestPilot are being investigated at priority, putting desktop client into yellow
* Issue with TestPilot are being investigated at priority
* Investigating multi-backend data sources for presto, to allow querying both server side and client data together.
* Investigating multi-backend data sources for presto, to allow querying both server side and client data together.
* V2 edge provisioning
* V2 edge provisioning
Line 15: Line 15:
* Scalar measurement work begins
* Scalar measurement work begins


== Updates ==
==== Updates ====
Desktop Telemetry
===== Desktop Telemetry =====
* scalar measurements work kicked off
* scalar measurements work kicked off
* Planning keyed histogram hardening after recent events
* Planning keyed histogram hardening after recent events
Line 22: Line 22:
* HTTP Date header uplift requested
* HTTP Date header uplift requested


Infrastructure and Tools
===== Infrastructure and Tools =====
* Reordered the sprint slightly since the popen bug is no longer blocking
* Reordered the sprint slightly since the popen bug is no longer blocking
* Moved the S3 tooling up into this sprint
* Moved the S3 tooling up into this sprint
* Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)
* Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)


SvcOps
===== SvcOps =====
* working on v2 edge provisioning
* working on v2 edge provisioning
* rpms for librdkafka and luasandbox (in lib64)
* rpms for librdkafka and luasandbox (in lib64)
Line 34: Line 34:
** Blake PTO, but working on presto (hive centralization)
** Blake PTO, but working on presto (hive centralization)


TestPilot
===== TestPilot =====
* Investigations / discussion about latency w.r.t. MAU/DAU
* Investigations / discussion about latency w.r.t. MAU/DAU
* Server-data analysis proceeding nicely
* Server-data analysis proceeding nicely


SSL
===== SSL =====
* Decoder Pull request pending
* Decoder Pull request pending
* Seems this was merged, deploy going out today
* Seems this was merged, deploy going out today
* Bunch of pipeline PRs landed
* Bunch of pipeline PRs landed


Other Reporting
===== Other Reporting =====
* V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
* V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
* fxa uid hmacification for email retention analysis for rfkelly
* fxa uid hmacification for email retention analysis for rfkelly
* Loop - trink implemented loop retention reports. To be reportified?
* Loop - trink implemented loop retention reports. To be reportified?


Hiring
= Hiring =
Job description: https://careers.mozilla.org/position/ocIi2fwY
Job description: https://careers.mozilla.org/position/ocIi2fwY



Latest revision as of 21:58, 25 May 2016

Data Pipeline, desktop client, SvcOps report July 10, 2015

Status for desktop client, data pipeline and service ops.

Overall Project Health

  • Pipeline: Green
  • desktop client: Yellow
  • SvcOps: Green

Exec Summary

  • Issue with TestPilot are being investigated at priority
  • Investigating multi-backend data sources for presto, to allow querying both server side and client data together.
  • V2 edge provisioning
  • V3 of main_summary is impending
  • Intern started this week (w00t)
  • Scalar measurement work begins

Updates

Desktop Telemetry
  • scalar measurements work kicked off
  • Planning keyed histogram hardening after recent events
  • Also planning analysis to find more crazy keyed histograms
  • HTTP Date header uplift requested
Infrastructure and Tools
  • Reordered the sprint slightly since the popen bug is no longer blocking
  • Moved the S3 tooling up into this sprint
  • Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)
SvcOps
  • working on v2 edge provisioning
  • rpms for librdkafka and luasandbox (in lib64)
  • building nginx/openresty 1.9.15rc1 for nginx_moz_ingest
  • testing in stage
    • Blake PTO, but working on presto (hive centralization)
TestPilot
  • Investigations / discussion about latency w.r.t. MAU/DAU
  • Server-data analysis proceeding nicely
SSL
  • Decoder Pull request pending
  • Seems this was merged, deploy going out today
  • Bunch of pipeline PRs landed
Other Reporting
  • V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
  • fxa uid hmacification for email retention analysis for rfkelly
  • Loop - trink implemented loop retention reports. To be reportified?

Hiring

Job description: https://careers.mozilla.org/position/ocIi2fwY

Important Links/References