QA/Automation/Meetings/140901

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
• Chair: Henrik
• Notes: Andreea

Last Weeks Action Items

• [DONE] [Andrei] file a bug to have 3 new machines for OSX 10.10 (yosemite) and discuss with releng or qa about the 10.7 (10.8) nodes if there is further testing necessary on them;
• [DONE] [Henrik] Change the meeting template to have major items for the upcoming week ("Upcoming" for each project / goal)
• [DONE] [Henrik] get in contact with :jeads to get a treeherder API key (or similar) to try pushing our results to treeherder
  • For now we have https://bugzilla.mozilla.org/show_bug.cgi?id=1053086. We will follow-up next quarter
• [DONE] [All] check who can be assigned to mozmill-ci https://github.com/mozilla/mozmill-ci/issues/473

Highlights

• [henrik] We should now see way lesser failures with AMO related tests since we switched to addons.allizom.org (Bug 1058445)
• [henrik] Started to sort bugs and test requests as layed out on https://etherpad.mozilla.org/firefox-automation-bug-triage
• [henrik] Mozmill Tests and Infrastructure components have been added to bugsahoy ( https://github.com/jdm/bugsahoy/pull/105 )
• [Andrei] new mozprofile version which includes a fix for wptserve, and we should have this week a new version of manifestparser which is the last blocker for wptserve

Blockers

• Complete list: http://bit.ly/Tph0NY
• [07/10] - Bug 735184 - RFE: Create Pulse notifications for update channel activities (maybe in Q4)
• [08/05] - Bug 980938 - Crash of Adobe Flash with protected mode enabled and clearing cookies [@ F2102588022] (waiting for feedback)
• [08/29] - Bug 1053977 - Request EDID for all QA maintained Mac minis in qa.scl3.mozilla.com (will be continued on Wed Sep 3rd)
• [08/29] - Bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes (waiting for security review)
• [09/01] - Bug 911048 - [mozinstall] Add support to install Firefox via the stub installer (needs work done by Henrik)
• [09/01] - Bug 957852 - Add files and cronjob for mciconf on mozqa1.qa.scl3 (waiting for feedback)
• [09/01] - Bug 1038646 - Broken package dependencies when installing OpenJDK 7 on Ubuntu 12.04 machines (waiting for feedback)
• [09/01] - Bug 891288 - Create subdomains of mozqa with self-signed SSL certificates for all supported versions versions (SSL3 - TLS 1.1) (waiting for feedback)

Roundtable

• [Andrei] do we know for sure if the merge will be done today or tomorrow?

Goals

• https://wiki.mozilla.org/QA/Automation#Goals

Puppet for restarting CI Machines (Andrei, Henrik, Andreea)

• Current Status:
  • No updates

Mozmill-CI for testing all Locales (Andreea, Cosmin)

• Current Status:
  • On issue Increase build retention policy for release jobs on production #473
  • We added 2 more batches to the list 9 and 10, I tested them today but I didn't made a pr.
• Planned for this week:
  • TBD

Mozmill for Restart Stability (Henrik, Andrei)

• Current Status:
  • bug 1058445 - Switching from AMO dev to staging web server should give us way lesser failures
• Planned for this week:
  • bug 794020 - Client disconnect errors
  • bug 972912 - Mozmill fails to ran all expected tests

Automation of TPS tests (Daniel, Mihaela)

• Current Status:
  • tests are in progress, waiting for review or dependencies to be fixed
• Planned for this week:
  • waiting for review in order to continue working on the tests

Project Updates

Mozmill (Henrik)

• We upgraded to mozprofile 0.22 to benefit from persisted preferences after a profile reset

Mozmill Tests (Softvision)

• 17 bugs closed last week - 6 P1 bugs:
  • bug 1028856 - Prepare mozmill-tests for the new webserver
  • bug 1049676 - [mozprofile] Preferences set via set_preferences() should survive a profile reset if specified as user pref
  • bug 899923 - Test failure "Addons have been found - got 'false'" in /testAddons/testSearchAddons.js
  • bug 1038119 - Test failure 'Autocomplete results should be visible' in testAwesomeBar/testAccessLocationBar.js
  • bug 1051777 - Multiple test failures in relation to the AwesomeBar
  • bug 1053170 - Test failure "Cookie value is displayed in private mode - should equal 'cookieValue'" in testPrivateBrowsing/testFlashCookie.js
  • bug 935451 - Test failure "Geolocation position is: Position acquisition timed out" in /testGeolocation/testShareLocation.js
  • bug 818128 - Failure in testAwesomeBar/testVisibleItemsMax.js | Number of visible rows should equal 6
  • [FIXED] bug 1059243 - Test failure 'getEntity: Entity - privatebrowsingpage.perwindow.* has been found' in /testPrivateBrowsing/*
  • [DUPE] bug 1023206 - Test failure 'Scroll arrows are visible after a couple tabs have been opened' in testBackgroundTabScrolling.js
  • [WFM] bug 923071 - Test failure "Scroll arrows are visible after a couple tabs have been opened" in testTabbedBrowsing/testBackgroundTabScrolling.js
  • [WONTFIX] bug 1057990 - GMPInstallManager installing openh264 plugin while testrun is underway
  • [DUPE] bug 972433 - [zh-CN] Test failure "AddonsManager_isAddonEnabled: Add-on has been specified. - got 'undefined'" in restartTests/testAddons_enableDisableExtension/test3.js
  • [DUPE] bug 983161 - Test failure 'AddonsManager_getAddonChildElement: Add-on has been specified. - got 'undefined in /restartTests/testAddons_uninstallExtension/test4.js
  • [DUPE] bug 977010 - Test failure Add-on has been specified. - got 'undefined' in /restartTests/testAddons_enableDisableExtension/
  • [WFM] bug 985884 - Massive failures for "controller.waitForPageLoad(): Timeout waiting for page loaded" on aurora, remote testrun
  • [WFM] bug 942823 - Test failure "The tab with index '1' has been selected" in /testTabbedBrowsing/testOpenInForeground.js

TPS (Henrik)

• TBD

WebRTC (Nils)

• TBD

Softvision Updates

Desktop Automation

• Goals progress:
  • TBD

• Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/jpjhjDe4j7M

Personal Status

For the personal status please check the weekly status updates:

• 140901 - 140907

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-meeting-20140901

If you missed the meeting you can also watch it in our archive.

Action items

• [NEW] [Henrik and Andrei] Update production 14.04 machines (8 total) to be ready for running tests as a Jenkins slave