Auto-tools/Meetings/2013-05-20

Goals

• Goal: Improve Developer/QA ergonomics around running and debugging automation by:
  • Add debugger support to B2G testrunners
  • Improve patch review experience on bugzilla/Make bugzilla more user-centric
  • Replace graph server with Datazilla for all desktop Talos tests
  • Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng

• Goal: Improve stability, reliability, and scalability of automation platforms by:
  • Addressing all P1 B2G automation stability issues
  • Complete native REST interface for Bugzilla
  • Complete Mochitest to Mozbase port
  • Create POC Microbenchmark suite to get feedback from developers for its usefulness
  • Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
  • Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder
  • Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.

• Goal: Build toward our future by:
  • Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
  • Release a mozmill 2 and work with contributor community to drive toward a 2.1
  • Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
  • Create and Deploy BMO user profile data for community building and education
  • Create a solid net and filter system to build a bugmaster community
  • Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
  • Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.

Deep Dives

Mobile (1st Monday)

Android Automation

• [edmorley] Patches:
  • Output a TBPL compatible message for Android logcat "FATAL EXCEPTION" failures (bug 872116).
  • Tweak logcat java-exception regex (bug 872507).

Tools (2nd Monday)

Tinderboxpushlog

• [edmorley] New things in production: https://bugzil.la/770579,828866,867171,873099
• [edmorley] Patches:
  • Clean up RawGzLogDownloader.php now that buildbot jobs no longer reference ftp-scl3.m.o (bug 828866).
  • Fix the "add a comment" pop-up intermittently not rendering correctly (bug 872494).
  • WIP patch to make the annotated summary generator suggest bug numbers for more edge cases.

War on Orange

• OrangeFactor on trunk for last 7 days: 7.62

Process (4th Monday)

Sheriffing & Trees

• [edmorley] 4-day week, was on PTO Thurs.
• [edmorley] Android mochitest-gl has been moved out of the default TBPL view due to high failure rate. As a bonus, this will reduce the occurrences of bug 663657, since it turns out they were mainly due to webgl (now that we can tell it apart from the rest of the mochitest-1 chunk).