EngineeringProductivity/Meetings/2011-06-20: Difference between revisions

(Created page with "= Roundtable = * Use Vidyo going forward? ** The physical location in mountain view will move to PB&J on the 3rd floor (only vidyo enabled conf room available at this time slot)....")
 
 
(30 intermediate revisions by 7 users not shown)
Line 1: Line 1:
= Roundtable =
= Roundtable =
* Use Vidyo going forward?
* Use Vidyo as a solution in the future
** The physical location in mountain view will move to PB&J on the 3rd floor (only vidyo enabled conf room available at this time slot).
** The physical location in mountain view will move to PB&J on the 3rd floor (only vidyo enabled conf room available at this time slot).


== Q3 Goals Discussion ==
* Q3 Goals
=== Automation ===
** [[https://wiki.mozilla.org/Auto-tools/Meetings/2011-06-13 last week]] wiki with goals
* Going Faster Project (aka Speedy Gonzales)
** Profile and streamline mochitest suite of test harnesses
** Proof of concept using extra test capacity by using on-demand vms
** Expand orange factor to monitor the vms so that we know if the vms are causing us oranges
** ?
* Webcrawler
** EC2 - could piggy back atop the test ec2 stuff.
** no movement.
* HTTP record/playback
** inclusion into bughunter
** part of QA uses/JS uses/evangelism etc.
** orange tests
* Mobile as a first class citizen
** TBPL changes/autolog changes to make the builds more visible.
** Not sure if any implications for underlying harnesses at this point
*** Ensure xpcshell working?
*** ensure js api working?
 
=== Performance ===
* Talos
** Addons  (carryover)
*** joint with releng to figure out how to roll out talos changes in a more sane way.
*** tp5/dirtyprofile/xperf etc.
*** Staging envirionment back up!
*** we need to be able to keep our machines in sync
*** investigate measuring by other metrics than time
* Edeticker
** framework in place to setup conditions required to start capture, run test, stop capture and push file somewhere.
* User Responsiveness
** Talos integration this quarter?
* speed Tests
** ?
 
=== Webtools ===
* autolog
** See wiki (better display of rich log data)
** abiltiy to manipulate orange comments
** Roll changes back into tbpl
** adding backend cache to make it faster
** Firebug might move to use autolog.
* Bug Hunter
** UI finished
** valgrind stuff
* WOO
** still supporting developers with various requests.
** starting to look at more interesting days to mine the data we have
* WebUX
** ? (follow up with mark)
* Bugzilla
** Bugzilla workflow improvements
** (carry overs - REST, Pulse)
** ES -- follow up.
* Tool for aiding with merging/backing out project branches
** ?
 
=== Tool Infrastructure ===
* MozBase
** Complete xpcshell integration deployed
** All base libaries written
** ?
* Regression Hunter
** ?
 
=== Thoughts for things we should do that you don't know where to put them ===
* Support rest of mozilla...
* special powers
** complete the move to chrome tests
** continuing work on the harnesses
 
* mozmill - supporting QA


= The Boulders =
= The Boulders =
=== Automation ===
=== Automation ===
* '''Bug Hunter''' - ''bc''
* '''Bug Hunter''' - ''bc''
** Reran Flash urls to get current on issues and marked as wfm any existing bugs I filed that are no longer reproducible.
** Working on using mozprocess and Unittest.
** Ran all OOM aborts that have been seen for preparation for the MemShrink project.
** Continuing to file bugs are they are found.
** Local fixes for minor issues with detecting zombies and detecting test processes
** Experimenting with different approaches to improve performance by reducing lock contentions: reducing locks due to zombie and orphan job detection, partitioning SiteTestRun locks by operating system, version and cpu. Contention between concurrent queries in MySQL may limit benefits. Still investigating.


* '''Mozmill 2.0/1.5.x''' - ''harth, jhammel, ctalbert''
* '''Mozmill 2.0/1.5.x''' - ''harth, jhammel, ctalbert''
** down to 20 bugs: https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-2.0%2B&product=Testing&resolution=---&list_id=520388
** ...and the work continues; will re-triage next week and have a final estimate to done


=== Performance ===
=== Performance ===
Line 92: Line 22:


* '''Talos'''/'''XPerf''' - ''jmaher''
* '''Talos'''/'''XPerf''' - ''jmaher''
** planning on staging the patches this week on releng environment
** tp5 only for now, will get side by side comparison to vanilla tp5 once bandwidth is available


=== Web Tools ===
=== Web Tools ===
* '''War on Orange'''/'''Auto-log''' - ''jgriffin, mcote''
* '''War on Orange'''/'''Auto-log''' - ''jgriffin, mcote''
** More War on Orange bug fixes and new features.
** Continuing work on Autolog UI.
** An ElasticSearch upgrade is happening today, along with a migration to a new storage scheme.  Tools depending on ES may be unavailable for an hour or two today, depending on how things shake out.


* '''Bugzilla Improvements''' - ''dkl, glob''
* '''Bugzilla Improvements''' - ''dkl, glob''
** continuing efforts to assist triage ([https://bugzilla.mozilla.org/show_bug.cgi?id=663751 bug 663751])
** working on closing last blockers for bugzilla 4.2


=== Tool Infrastructure ===
=== Tool Infrastructure ===
* '''MozBase''' - ''jmaher, ted, jhammel''
* '''MozBase''' - ''jmaher, ted, jhammel''
** Ctalbert published a [[Auto-tools/Projects/MozBase|strawman]]
** mozinfo created, in patch form should land this week


* '''SpecialPowers''' - ''ted, ctalbert, jmaher''
* '''SpecialPowers''' - ''ted, ctalbert, jmaher''
** moved a bunch of tests this weekend.  After 4 more patches land this week (waiting on r+), there will be 18 files to move to mochitest-chrome.
** now part of the eventutils.js conversion can happen (probably get into review queues this week)


* '''Web UX Platform''' - ''mcote, harth''
* '''Web UX Platform''' - ''mcote, harth''
** Working on Python package for server side.


= The Gravel =
= The Gravel =
Line 113: Line 53:


* '''Crossweave 2''' - ''jgriffin''
* '''Crossweave 2''' - ''jgriffin''
** Converting existing YAML-like tests to JavaScript.
** Update pulse monitor to handle duplicate buildbot messages we're receiving through pulse.


=== Performance ===
=== Performance ===
Line 118: Line 60:


* '''SpeedTestsJS''' - ''mcote''
* '''SpeedTestsJS''' - ''mcote''
** Fix last week to IE controller.  Still something flaky there, as IE seems to skip tests sometimes.  Everything else is very stable.
** Interesting: Chrome 12 has small but noticeable speed improvements in some tests (viz http://brasstacks.mozilla.com/birt-viewer/run?__report=report/MedianRuns.rptdesign&RP_TEST=MrPotatoGun&RP_OS=Windows&RP_IP=10.250.4.115 - Chrome 11 was running up to June 14 at a very stable 48 FPS in this test, and Chrome 12 now runs at a very stable 53 FPS).


=== Web Tools ===
=== Web Tools ===
* '''Bug Hunter UI''' - ''mcote, bc''
* '''Bug Hunter UI''' - ''mcote, bc''
** First couple admin views are up.  One or two more things to do for the admin view, then starting on crash/unit test/assertion views.


* '''Toolbox''' - ''jhammel, harth''
* '''Toolbox''' - ''jhammel, harth''
** round 1 effectively done \o/
** there are a few minor bugs and directions for future work, but overall it works pretty well
** over 100 tools so far!


* '''Regression Hunter''' - ''samliu, harth''
* '''Regression Hunter''' - ''samliu, harth''
** Currently implementing EC2 "cloud building" which will do regression-finding builds on EC2 instead of on your local machine
** mozregression finds regressions using nightly and local builds. Also you can use mozremotebuilder to use the try server right now (very slow)


=== Tool Infrastructure ===
=== Tool Infrastructure ===
* '''Manifest for the manifest-less''' - ''jmaher, jhammel''
* '''Manifest for the manifest-less''' - ''jmaher, jhammel''
** getting closer: new ManifestDestiny out, currently playing with this in mozmill
** patches mostly done to integrate manifestdestiny and mozinfo into m-c and xpcshell {{bug|658671}}
** jhammel should write up how manifests, mozinfo, and the build -> JSON file fit together


= Backburner =
= Backburner =
Line 134: Line 85:


= The Misc =
= The Misc =
* In honor of Monday the 13th:
* [http://blogs.oracle.com/geertjan/entry/cismet_developers_will_code_for no more] (who is that on the left- Mr. Scranton?)
** [http://www.youtube.com/watch?v=ChfIyHZqEd8 Something to get you over your "case of the mondays"]
* [http://www.kpsurplus.com/sharp-pc-8660-notebook-track-ball-disks-carrying-bag.html a secure computing environment] - future of Firefox?
** [http://www.youtube.com/watch?v=mGS2tKQhdhY&feature=related For working on your people skillz]
* [http://en.wikipedia.org/wiki/File:DynaTAC8000X.jpg super powered mobile] - future of Fennec?
** [http://www.youtube.com/watch?v=_IwzZYRejZQ&feature=related And in case you haven't seen it, here's what you need to know.]


= The Pulverized =
= The Pulverized =

Latest revision as of 00:46, 28 August 2015

Roundtable

  • Use Vidyo as a solution in the future
    • The physical location in mountain view will move to PB&J on the 3rd floor (only vidyo enabled conf room available at this time slot).

The Boulders

Automation

  • Bug Hunter - bc
    • Working on using mozprocess and Unittest.
    • Continuing to file bugs are they are found.

Performance

  • Talos/Addon Testing Service - ctalbert, anode
  • Talos/Tp5 - anode
  • Talos/XPerf - jmaher
    • planning on staging the patches this week on releng environment
    • tp5 only for now, will get side by side comparison to vanilla tp5 once bandwidth is available

Web Tools

  • War on Orange/Auto-log - jgriffin, mcote
    • More War on Orange bug fixes and new features.
    • Continuing work on Autolog UI.
    • An ElasticSearch upgrade is happening today, along with a migration to a new storage scheme. Tools depending on ES may be unavailable for an hour or two today, depending on how things shake out.
  • Bugzilla Improvements - dkl, glob
    • continuing efforts to assist triage (bug 663751)
    • working on closing last blockers for bugzilla 4.2

Tool Infrastructure

  • MozBase - jmaher, ted, jhammel
    • mozinfo created, in patch form should land this week
  • SpecialPowers - ted, ctalbert, jmaher
    • moved a bunch of tests this weekend. After 4 more patches land this week (waiting on r+), there will be 18 files to move to mochitest-chrome.
    • now part of the eventutils.js conversion can happen (probably get into review queues this week)
  • Web UX Platform - mcote, harth
    • Working on Python package for server side.

The Gravel

Automation

  • Supporting Releng with Android Automation Rollout - ctalbert, bmoss, jmaher
  • Firebug Test Automation - ctalbert
  • Crossweave 2 - jgriffin
    • Converting existing YAML-like tests to JavaScript.
    • Update pulse monitor to handle duplicate buildbot messages we're receiving through pulse.

Performance

  • User Responsiveness Measurement - ted

Web Tools

  • Bug Hunter UI - mcote, bc
    • First couple admin views are up. One or two more things to do for the admin view, then starting on crash/unit test/assertion views.
  • Toolbox - jhammel, harth
    • round 1 effectively done \o/
    • there are a few minor bugs and directions for future work, but overall it works pretty well
    • over 100 tools so far!
  • Regression Hunter - samliu, harth
    • Currently implementing EC2 "cloud building" which will do regression-finding builds on EC2 instead of on your local machine
    • mozregression finds regressions using nightly and local builds. Also you can use mozremotebuilder to use the try server right now (very slow)

Tool Infrastructure

  • Manifest for the manifest-less - jmaher, jhammel
    • patches mostly done to integrate manifestdestiny and mozinfo into m-c and xpcshell bug 658671
    • jhammel should write up how manifests, mozinfo, and the build -> JSON file fit together

Backburner

  • Profile Manager - jgriffin

The Misc

The Pulverized

  • Fennec Profile Manager Tool
  • Productize Pulse
  • Profile Manager v1
  • Breakpad for Android
  • Crossweave
  • Grafx Bot
  • Firebug Test Support
  • Mozmill 1.4.2 aka 1.5 Released
  • Bugzilla Review & REST API Improvements (2010 Q2)
  • Implement AddOns Performance prototype system
  • Initial Landing of E10s Enabled Mochitest
  • Websockets Test Infrastructure Support