Unified Telemetry/Status reports/dataprogram/datapipeline: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Updates: formatting)
Line 16: Line 16:


== Updates ==
== Updates ==
Desktop Telemetry
= Desktop Telemetry =
* scalar measurements work kicked off
* scalar measurements work kicked off
* Planning keyed histogram hardening after recent events
* Planning keyed histogram hardening after recent events
Line 22: Line 22:
* HTTP Date header uplift requested
* HTTP Date header uplift requested


Infrastructure and Tools
= Infrastructure and Tools =
* Reordered the sprint slightly since the popen bug is no longer blocking
* Reordered the sprint slightly since the popen bug is no longer blocking
* Moved the S3 tooling up into this sprint
* Moved the S3 tooling up into this sprint
* Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)
* Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)


SvcOps
= SvcOps =
* working on v2 edge provisioning
* working on v2 edge provisioning
* rpms for librdkafka and luasandbox (in lib64)
* rpms for librdkafka and luasandbox (in lib64)
Line 34: Line 34:
** Blake PTO, but working on presto (hive centralization)
** Blake PTO, but working on presto (hive centralization)


TestPilot
= TestPilot =
* Investigations / discussion about latency w.r.t. MAU/DAU
* Investigations / discussion about latency w.r.t. MAU/DAU
* Server-data analysis proceeding nicely
* Server-data analysis proceeding nicely


SSL
= SSL =
* Decoder Pull request pending
* Decoder Pull request pending
* Seems this was merged, deploy going out today
* Seems this was merged, deploy going out today
* Bunch of pipeline PRs landed
* Bunch of pipeline PRs landed


Other Reporting
= Other Reporting =
* V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
* V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
* fxa uid hmacification for email retention analysis for rfkelly
* fxa uid hmacification for email retention analysis for rfkelly
* Loop - trink implemented loop retention reports. To be reportified?
* Loop - trink implemented loop retention reports. To be reportified?


Hiring
= Hiring =
Job description: https://careers.mozilla.org/position/ocIi2fwY
Job description: https://careers.mozilla.org/position/ocIi2fwY


Revision as of 21:56, 25 May 2016

Data Pipeline, desktop client, SvcOps report July 10, 2015

Status for desktop client, data pipeline and service ops.

Overall Project Health

Pipeline: Green desktop client: Yellow SvcOps: Green

Exec Summary

  • Issue with TestPilot are being investigated at priority
  • Investigating multi-backend data sources for presto, to allow querying both server side and client data together.
  • V2 edge provisioning
  • V3 of main_summary is impending
  • Intern started this week (w00t)
  • Scalar measurement work begins

Updates

Desktop Telemetry

  • scalar measurements work kicked off
  • Planning keyed histogram hardening after recent events
  • Also planning analysis to find more crazy keyed histograms
  • HTTP Date header uplift requested

Infrastructure and Tools

  • Reordered the sprint slightly since the popen bug is no longer blocking
  • Moved the S3 tooling up into this sprint
  • Rob + Roberto looking into multi-backend data sources for presto (for querying server- and client-data together)

SvcOps

  • working on v2 edge provisioning
  • rpms for librdkafka and luasandbox (in lib64)
  • building nginx/openresty 1.9.15rc1 for nginx_moz_ingest
  • testing in stage
    • Blake PTO, but working on presto (hive centralization)

TestPilot

  • Investigations / discussion about latency w.r.t. MAU/DAU
  • Server-data analysis proceeding nicely

SSL

  • Decoder Pull request pending
  • Seems this was merged, deploy going out today
  • Bunch of pipeline PRs landed

Other Reporting

  • V3 of main_summary is impending. Please let mreid know about any fields that should be added asap. * So far, planning to address bugs 1270482 (push metrics), 1270505 (client date), 1265874 (default search engine id)
  • fxa uid hmacification for email retention analysis for rfkelly
  • Loop - trink implemented loop retention reports. To be reportified?

Hiring

Job description: https://careers.mozilla.org/position/ocIi2fwY

Important Links/References

Retrieved from "https://wiki.allizom.org/index.php?title=Unified_Telemetry/Status_reports/dataprogram/datapipeline&oldid=1134454"