Auto-tools/Meetings/2012-07-16

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

• [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
• [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices, NEON Chipsets (panda boards), and ARMv6 (Beagle boards).
• [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
  • NOTE: We will not be replacing existing Talos in Q3. By the end of Q3, we want to have Datazilla to a point at which it can shadow the existing Talos system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of Talos to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
• [ON TRACK] Implement and land Bugzilla UX Optimizations for web mail, tracking flags optimizations, secure mail, and work with UX team on other suggested improvements.
• [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
• [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

Eideticker

• [wlach] - Finished merging Orangutan input simulation framework into master branch (see: http://wrla.ch/blog/2012/07/the-evolution-of-simulating-events-in-eideticker-from-monkeys-to-orangutns/)
• [wlach] - Set up Nagios to monitor status of Eideticker machines / phones
• [wlach] - Various work to try and make Eideticker dashboard update scripts more resilient (retrying failed jobs, etc.)
• [wlach] - In Toronto this week to set up Eideticker machines and help anyone interested get up to speed on running/developing Eideticker tests.

Mobile Automation

• [jmaher] - investigating problem when boards reboot in the middle of a test with no indication of what is happening.
• [jmaher] - investigating resource consumption during tests to see if that causes reboots/crashes/oranges.
• [wlach] - various patches to SUTAgent and client library, mostly to fix eideticker-related stuff but may be useful elsewhere as well: commands now run as su by default (bug 763497), fall back to wifiman to get MAC address on older versions of Android (bug 768597), give better error when we fail to push a file (bug 772105), and don't consume tons of CPU when waiting for a response in the client (bug 773463).

Mobile Evangelism Site-Scraping Tool

• [samliu, carljm] fixed a number of bugs in the scraper, worked on writing tests

MozTrap

[rbillings] - Doing a test run pass on the 1.1.X codebase

New Graphserver (Datazilla)

• [carljm] Added support for Oauth to datazilla_client (also added tests, fixed a couple bugs, and added support for sending prebuilt JSON)
• [camd] Added storage and importing of pushlog data, merged to master
• [camd] Adding batch processing to certain management commands for cache updates and data processing. Added batch field to be able to assign projects to specific cron batches. (not yet merged)

Signal From Noise

• [jhammel] working on a tool/webpage to correlate names from buildbot, talos, TBPL, and graphserver for bug 770460; a (messy) WIP may be seen here: https://bug770460.bugzilla.mozilla.org/attachment.cgi?id=641530

Talos

• [jmaher] - worked with jhammel to get reporting to graph server for new sunspider, v8, kraken tests
• [jmaher] - wrote blog post about compare.py for comparing talos numbers from graph server.
• [jmaher] - backed out specialpowers for talos as it caused massive performance regressions.

Automation Development

• [jmaher] - bug 762908 - add specialpowers to jsreftests - in review queue, required for landing ionmonkey

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

• Review the goals - are they specific enough while maintaining some amount of flexibility (since this is going to be a quarter that requires a ton of flexibility from us), do you have an idea how we'll measure them?
• Discuss how to attack the Reftest Resolution problem for mobile. Come up with plan of attack and priority in terms of other actions.

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

• Damn you Autocorrect, in the spirit of all our mobile work
• [wlach] hired bicycle movers to move apartments last weekend. Truly a sight to behold. See also: http://www.demenagementmyette.ca/videos/