Auto-tools/Meetings/2012-06-18

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

• [ON TRACK] Extend Mobile Platform Automation for B2G and Fennec Native to extend our automation systems to work with specific phone hardware and new development boards for both products.

• [ON TRACK] Datazilla: Provide generic interfaces/web app plugability for new harnesses to reuse the same infrastructure backend
  • [samliu, carljm] - made progress towards splitting data ingestion from processing

• [MISSED] Datazilla: Ensure that new UI is based on extensible statistics package that can be used both by developers and the graphserver UI.
  • [jeads] - wrote push log walker to try out t-test method on a chunk of data, sent that to metrics
  • [carljm] - followed up with metrics, made progress towards getting them data that includes a known talos regression

• [ON TRACK] Signal From Noise Phase II - Make the same noise-reduction changes we made on Tp5 on all the other page-load tests and ensure all performance tests are sending raw observations to Datazilla.

• [AT RISK] Enhance Bugzilla Performance by upgrading hardware and software dependencies as well as fixing a major performance bug in BMO (a bug related to how we, as Mozilla, use bugzilla)

• [ON TRACK] Reduce android test automation instability and make it easier for the web QA and desktop QA teams to write and run automated tests.

In-Depth Project Discussion

MozTrap, presented by camd.

The Overview

Eideticker

• [wlach] Lots of benchmarking for new Fennec release
• [wlach] Added support for various types of Eideticker startup tests for Android. Interesting yet depressing findings so far. See bug 765228 (Time from startup to completely rendered web page is poor) for more details.

Talos

• [jhammel] results processing bug 755527

Marionette

• [jgriffin] Got 3 new VM's on Amazon AWS running for mochitest-plain runs.
• [jgriffin] Changed our B2G CI so it runs against https://github.com/mozilla/mozilla-central instead of https://github.com/doublec/mozilla-central.
• [jgriffin] Investigated B2G test failures.
• [jgriffin] Spent time with releng hashing out B2G build needs.

New Graphserver (Datazilla)

• [camd] reviewed 3 pull requests from carljm
• [carljm] Test harness is fully functional.
• [carljm] MySQL db engine can be specified per-database.
• [carljm] Reviewed code and assisted samliu and camd with splitting data loading and creating pushlog database.
• [carljm] Learned enough about how try works to have some idea how we might be able to implement compare-talos for try.
• [carljm] With help from edmorley and jmaher, found a talos-regression changeset that metrics can use for validating the t-test method.
• [carljm] Updated installation and development documentation.
• [camd] created the pushlog database, tables and stored procedure json
• [camd] wrote the management command for querying hg pushlogs and storing them in the tables (partially functional, not complete)

MozTrap

• [camd] scheduled meeting with QA to talk about MozTrap best practices
• [camd] attempting to finish at-risk goal of results-api before EOQ
• [carljm] fixed a bug with single-case URL

Mobile Evangelism Site-Scraping Tool

• [carljm, samliu] met with stakeholder reps to iron out phase 1 requirements

Upcoming Events

All times Pacific Time, click on link to find your timezone

• Platform Meeting (all platform engineers) Tuesday at 11AM, Conf # 8605.
• Mobile Test Automation Wednesday at 10:30AM, Vidyo Warp Core
• Marionette/Eideticker Meeting Thursday at 10AM Conf # 304
• Signal from Noise Thursday at 11AM #343

Round Table

Holidays and Trips

• Jgriffin is out from June 20 to July 2. See Mdas for B2G issues or Ctalbert for anything else. I will be reachable by cell phone; ctalbert has the number!
• wlach out from June 18 to July 2. Mcote to keep eideticker dashboard running while gone.
• camd out from June 25th through end of month.
• Monday, June 25, is a holiday in Quebec (observed date of La fête nationale). mcote will be out that day (and wlach, but this falls in the middle of his vacation anyway).

Misc

The Evolution of 8-Bit Art, from [PBS's Off Book http://video.pbs.org/program/off-book/] series.