Auto-tools/Meetings/2012-08-05: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎War on Orange: Add edmorley)
(Moved to proper date)
 
(16 intermediate revisions by 5 users not shown)
Line 1: Line 1:
== Goals Progress ==
Maybe you meant [[Auto-tools/Meetings/2012-08-06]]...
 
Below are our [https://wiki.mozilla.org/Auto-tools/Goals/2012Q3 top level goals].  Beneath each goal, note any progress made towards that goal this week.
* {{ok|Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.}}
* {{ok|Expand Mobile testing platforms for B2G and Fennec Native to include user devices, NEON Chipsets (panda boards), and ARMv6 (Beagle boards).}}
** [mcote] New SUTAgent requirements finished; high-level design just about finished.
** [mihneadb] SUTAgent/DeviceManager tests resurrected and committed to mozdevice.
* {{ok|Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.}}
** ''NOTE:'' This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will '''not''' be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
** [jeads] Datazilla is in production https://datazilla.mozilla.org/test/
* {{ok|Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)}}
* {{ok|Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures}}
* {{ok|Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation}}
 
[https://www.pivotaltracker.com/projects/582883# '''Check out Pivotal Tracker''']
 
== Highlights ==
 
* [glob] expect this thursday's bmo push to include a fix for interdiff [{{bug|779862}}]
 
== In-Depth Project Discussion ==
 
''Pick one project/presenter per week who will give a detail presentation on their project.''
 
== The Overview ==
 
''Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!''
 
=== [[Auto-tools/Projects/AutoPhone|AutoPhone/Noah's Ark]] ===
* [mcote] High-level design will be finished Monday.
* [minheadb] resurrected and fixed up the SUTAgent/DeviceManager tests and moved them to mozdevice.
 
=== [[Auto-tools/Projects/Bughunter|Bughunter]] ===
 
=== [[BMO|Bugzilla]] ===
* pushes: https://globau.wordpress.com/2012/07/31/bmo-breakage-push/ https://globau.wordpress.com/2012/08/02/happy-bmo-push-day-7/
* [glob] lots of work on bmo 4.2 search functionality
* [dkl+glob] lots of upstream activity (reviews and patches)
 
=== [[Project_Eideticker|Eideticker]] ===
* [wlach] No luck so far finding an ARMv6 device with HDMI capture, even asked Mozilla China.
* [wlach] Got the MK6513 working with Orangutan (allows testing ARMv6 Fennec without HDMI capture)
 
=== [https://github.com/mozilla/Firebug-Test-Runner Firebug Testing] ===
 
=== [[Auto-tools/Projects/Jetperf|Jetperf]] ===
 
=== [[Auto-tools/Projects/Marionette|Marionette]] ===
* [DBurns] Added Keys helper, as in Selenium, to Marionette
 
=== Mobile Automation ===
 
* [mihneadb] Add SUT Agents test for the Android agent to mozdevice {{bug|778366}}
* [mihneadb] Fixes/improvements to devicemanagerSUT and its tests {{bug|780245}} {{bug|778363}} {{bug|778329}}
* [mihneadb] Got C++ code (including stdlib and STL) compiling and working on B2G (Android NDK is a [broken] mess!) https://github.com/mihneadb/NewAgent
* [wlach] Mostly finished a smoke test for Pandaboards based on the autophone one
 
=== [[Auto-tools/Projects/Mobile_Evangelism_Site_Scraper|Mobile Evangelism Site-Scraping Tool]] ===
 
=== Mochitest ===
 
=== [[Auto-tools/Projects/MozBase|MozBase]] ===
 
* [mihneadb] Moztest landed in Mozbase {{bug|774419}}
* [mihneadb] Some first tests for Moztest {{bug|779664}}
* [mihneadb] Mozbase uses Moztest to store test results {{bug|779665}}
 
=== [[Auto-tools/Projects/Mozmill|Mozmill]] ===
 
=== [[Auto-tools/Projects/MozTrap|MozTrap]] ===
 
=== [[Auto-tools/Projects/Datazilla|New Graphserver (Datazilla)]] ===
* [jeads] Worked through lots of issues with IT and got datazilla into production https://datazilla.mozilla.org/test/
* [jeads] Made some more headway on implementing the t-test and push log walking logic.  This branch should be finished within the week.
 
=== [[Auto-tools/Projects/Open_Web_Apps_Testing|Open Web Apps]] ===
 
=== [[Auto-tools/Projects/peptest|Peptest]] ===
 
=== [[Auto-tools/Projects/Powerball|Powerball]] ===
 
=== [[Auto-tools/Projects/Pulse|Pulse]] ===
 
=== [[Auto-tools/Projects/Signal_From_Noise|Signal From Noise]] ===
 
=== [[Auto-tools/Projects/Speedtests|Speedtests]] ===
 
=== Systems ===
 
=== Talos ===
 
=== Sheriffing & Trees ===
* [edmorley] Day-to-day sheriffing of the trees.
* [edmorley] Sheriffing issues of note:
** Philor away 15th July-6th Aug.
** Several spidermonkey build types busted for weeks - filed bugs & found regression ranges: https://bugzil.la/778460,778467,778469
** Permanent Win7 failure on esr10 ({{bug|779159}}).
** 30% Windows Ts regression since 1st March ({{bug|778718}}).
** Discussions with Ehsan about a more suitable birch/profiling cron job frequency (for their pulls from m-c), in order to save load (was 30 mins, we've lowered to every 12 hours).
** Following up on {{bug|773120}} since OS X 10.5 tests are still running, even though it has landed+reconfig'd.
** Switched off spidermonkey-nomethodjit builds on tinderbox since busted and deemed no longer necessary ({{bug|779150}}).
** Spidermonkey builds are still scheduled with DONTBUILD ({{bug|779784}}).
** Landed the patch to switch off non-OSX builds/tests on the birch branch, to save load ({{bug|775149}}).
** Self-serve 'trigger pgo builds' sometimes triggers dep builds instead ({{bug|780468}}).
** Hid android-xul builds+tests on all trees apart from {mozilla-central,mozilla-inbound,try} whilst we wait for {{bug|777037}}.
** Recalculated failure rates for the hidden Android mochitest suites ({{bug|777436}}), now that {{bug|775227}} disabled the worst OOM offenders. Filed dependent bugs for unhiding the rest.
** Unhid all native/XUL Android test suites apart from native mochitest-3, once the reboot fixes resolved most of the problems! \o/
 
=== [https://treestatus.mozilla.org/ Treestatus] ===
 
=== [https://tbpl.mozilla.org/ Tinderboxpushlog] ===
* [edmorley] Initial plan for a TBPL bug intermittent failure bug filer {{bug|779529}}.
* [edmorley] Requested adjustments to TBPL's push to prod script {{bug|779752}}.
* [edmorley] Patch for to remove disabled trees from TBPL's tree menu & move the less active repos lower down ({{bug|780116}}).
 
=== [[Auto-tools/Projects/WarOnOrange|War on Orange]] ===
*[DBurns] Created {{bug|779644}} to get a Dev/Stage instance.
* [edmorley,jgriffin] OrangeFactor seems to have not imported failures for a day ({{bug|779129}}).
* [edmorley] Changeset links to {aurora,beta,inbound} 404, due to missing /{integration,releases}/ ({{bug|779126}}).
* [edmorley] WIP patch for {{bug|765200}}.
* [edmorley] Reviewed {{bug|687032}}.
* [edmorley] Backports of [orange] fixes: https://bugzil.la/770542,688897,649564,750241,773653,722956
* [edmorley] Patches to disable parts of top-orange tests that owners said they wouldn't be able to fix any time soon: https://bugzil.la/661099,733848,760770,620598,661076,687972 & filed: https://bugzil.la/780490,780491,780492
* [edmorley] More chasing/pinging of devs in top-orange bugs. Starting to see more fixes appearing, so hopefully having an effect :-)
 
=== Web QA ===
* [dhunt] Migrated Jenkins to new hardware
* [dhunt] Performed an audit on when Jenkins jobs are currently triggered and submitted proposals
* [dhunt] [[QA/Execution/Web_Testing/Automation/Build_Notifications Set up a mailing list]] (webqa-ci) for all build notifications
* [dhunt] Implemented [https://wiki.jenkins-ci.org/display/JENKINS/Parameterized+Trigger+Plugin Parameterized Trigger Plugin] for Browser ID jobs to reduce IRC notification noise
 
=== Automation Development ===
 
== Upcoming Events ==
 
''Standing weekly meeting related to our projects should go here''
 
== Round Table ==
 
''Put your questions and things to raise with the entire team here''
 
=== Take notes [https://etherpad.mozilla.org/A-TeamMeetingNotes here] and copy and paste them to this section afterwards. ===
 
=== Notes ===
 
=== Holidays and Trips ===
* [Dburns]Tuesday-Thursday 1/2 days and Friday off last week to do [http://instagram.com/p/N4Cj9oJuEb/ engineering of another kind]
 
=== Next week MC ===
 
== Misc ==
 
''Find something you think is cool, interesting, funny, or exciting and put it here''
 
* Real programmers manually specify common include paths: https://github.com/mihneadb/NewAgent/blob/master/Makefile

Latest revision as of 17:26, 6 August 2012

Maybe you meant Auto-tools/Meetings/2012-08-06...