EngineeringProductivity/Meetings/2011-08-01

RoundTable

• Native Events or not - wlach ctalbert siding with the fact that native events probably aren't going to buy us a whole lot in the user responsiveness tests, thinking of shelving.
• New Project - DXR Support, undertaken by mdas.

Goals

• Work with release engineering to reduce overall end-to-end time from push to test result to an average of 2 hours.
• Ensure all harnesses and tests are E10S ready
• Improve performance testing by finalizing user-activated addons performance system, xperf-enabled performance testing, and automating a user responsiveness performance test.

Automation

• Go Faster (P1) - jgriffin, ted, mdas, bc, ctalbert
  • Working on adding statistics to the ES library so sam's dashboard can more quickly calculate stats without downloading all the data.
  • Go Faster Dashboards - harth, samliu
  • httpd.js profiling - no progress. scheduled for this week. /bc
  • xpchsell tests slow on Win7 - Created a list of slowest relative tests (vs. Linux). Diagnosing reasons for slowness, filed two bugs so far: https://bugzilla.mozilla.org/show_bug.cgi?id=675363 and https://bugzilla.mozilla.org/show_bug.cgi?id=674738 - wlach
    • Live on brasstacks, working on some performance problems (see above w.r.t. ES stats)

• Mobile Support (P1) - jmaher, bmoss, ctalbert
  • Unhiding jsreftest cause they are green
  • Turning on more mochitests for android today - 16 new directories.
  • Turned on tests for many other branches to bump up the load on the tegras
  • Tegra Pool Automation - jhammel, ?? No progress yet

• Bug Hunter (P1) - bc
  • Bug Hunter UI - mcote, bc
    • Discussing Crash view; should be starting work this week.
      • I owe mcote a review on the ldap authentication patch and help on work flow. Working on that today.
    • sm-purify01 set up to run unittests under bughunter. Problems with purify due to Firefox crashing. Sent out a note to several engineers, hoping for some guidance. Issues with vnc connections repeatedly dropping. /bc
    • Getting 3 more valgrind workers. /bc

• Mozmill 2.0/1.5.x (P1) - jhammel, harth, ctalbert
  • down to the wire here: 6ish bugs with known fixes (although one fix has opened up a can of worms)
  • need to port some tests
  • need to document -- mail to mozmill-dev forthcoming

• Crossweave 2 - jgriffin
  • Landed on services-central last week
  • working on a make tps integration today
  • Looking into integration with mozmill for UI automation

• Native Events - wlach
  • On hold: no performance diff vs. synthetic events

Performance

• Talos/User Responsiveness (P1) - anode, ted
  • Talked with bsmedberg last week.
    • Wanted a way for developers to land in a set of mochitest like tests, which can be the second harness.
    • decided to move forward with what alice prototyped for the first run.

• Talos/Addon Testing Service (P1) - anode
  • Had first end to end tests last week, working with the addons guys to finalize that support.

• Talos/Xperf (P2) - jmaher
  • Rolling out tools to slaves
  • Sam has dashboard ready, needs to be hooked to autolog.

• SpeedTests (P2) - mcote
  • Problems from the machine upgrade 1.5 weeks ago have been solved (badly installed graphics driver and changing Safari UA string).
  • Looking into BrowerScope as a possible alternative for test results.

• Eideticker (P2) - mcote
  • Played with DeckLink for a while, but realized I need a better machine. Looking into HP workstations.

Web Tools

• War on Orange/Auto-log (P1) - jgriffin, mcote
  • Still waiting on ehsan to comment on the correlation scheme, but might just go ahead and put it up.

• Bugzilla Improvements (P1) - dkl, glob
  • Epic discussions with Input regarding integration between Input and BMO have reached agreement on what should happen, now detailing out how
  • Bugzilla Tweaks has been handed over to us

• Regression Hunter (P1) - harth, samliu
  • Met with Zandr and Dustin to understand how we can solve the building problem. Decided that the easiest way forward is to store builds going back 6 months, and use try if we need to build non-locally for anything older than that.
  • Adding in the ability to specify a test to run in the non-local method.

• DXR Automation/Support {P2} - mdas
  • Tracking down Joshua Cranmer to get started.

• Personal Bugzilla Dashboard (P2) - harth
  • Work ongoing. Should have first pass done the end of the week.

Tool Infrastructure

• SpecialPowers (P1) - jmaher, ted
  • Working to get waitForFocus green on try
  • Running into issues with multiple windows and special powers - going to resolve that this week
  • After waitForFocus is resolved there are 8 more instances of special powers in the harness and its associated tools.

• MozBase (P2) - jmaher, jhammel, ted
  • shaping up mozprofile, mozrunner, mozinfo
  • one next step: make automation.py.in just automation.py and replace 90% of it with mozprofile, mozrunner
    • need a way to import python sanely in m-c
  • Have a working version of talos implemented in MozBase now - about 200 lines of code.
  • [mockup of talos] using mozprocess and mozprofile.

• Web UX Platform (P2) - mcote, harth
  • Working on a templeton app controller to easily register, unregister, start, stop, disable, and enable templeton apps.
  • Related: starting to set up the second web tools machine, flyingtanks. Got catlee's treestatus app on there; just waiting for IT to open up the web server to the world.

Misc

Today's misc is brought to you by LASERS and the number 2.

• [1]
• [2]