QA/Automation/Meetings/130107

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
  • TBD
• This meeting:
  • Chair: Henrik

Last Weeks Action Items

• [DONE] Henrik: Check the new way in setting the system proxy for our ESX Linux VMs
  • Lots of work was involved here because of tools like Mercurial or mozdownload were not happy when called via Jenkins (there is a bug which drops env variables)
• [DONE] Henrik: Follow up with Ted about the faked devices for WebRTC
  • Ted was working before Christmas on a Linux implementation. It's up for review and installation on test machines now.
• [DONE] Dave: Investigate and fix the broken SeleniumIDE extension for Firefox 20

Highlights

• [henrik] Mozmill ESX cluster in PHX data center is mostly ready to be finished off for Linux and Windows machines
  • Was working heavily on setting everything up. Proxy settings caused us a lot of headaches across Linux and Windows given that tools retrieve that information from different sources, and Jenkins is even buggy in handling environment variables (see bug)
  • As by now all Linux and Windows machines should be connected and running the daily tests (32 VMs have been deployed so far - Fedora machines are left to do)
  • We have to think about how to best get our Mac minis moved to PHX or requesting new ones?
  • Only a single test is failing due to proxies (/restartTests/testSoftwareUpdateAutoProxy/test2.js)

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Blockers

• bug - %summary%

Issues

• bug - %summary%

Project Updates

Gaia UI (Dave)

• Pull request is up to remove media between tests and push required media for tests
  • https://github.com/mozilla/gaia-ui-tests/pull/236
• Had to switch devices over the holidays, now switched back

WebAPI (Rob)

• Final two WebAPI tests are under review bug 813774 and bug 813777
• Finished post-review patch for maximum segment SMS test bug 806811
• Some WebTelephony tests are disabled on TBPL as they cause the following WebAPI tests to fail (battery tests), even though the WebTelephony tests were passing; Rob to investigate using Cedar

WebRTC (Henrik)

• mozGetUserMedia has been enabled by default on mozilla-central, given that our gUM mochitests do not fail and leak anymore
• Also the peer connection leaks have been mostly fixed. There are only some around which are hard to investigate. So we cannot enable crashtests for now too.
• We will decide later to turn on peer connection tests on the aurora channel given how stable the code is
• Have to continue to write peer connection tests (e.g. datachannel) and catch up with crashtests

Softvision Updates

• Fixed:
  • bug 782661 -Mozmill endurance test failure in testBookmarks_OpenAllIntTabs | "could not find element Selector: .bookmark-item[label='Test Folder'] "
  • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
  • bug 823869 - Test which checks that the accept cookie dialog is not displayed in private browsing mode
  • bug 812435 - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
  • bug 810301 - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
  • bug 780892 - Split testFocusAndSearch.js into two test modules

• Blocked bugs:
  • bug 788531 - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check

• Waiting for review
  • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
  • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods

• Working on:
  • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
    • waiting for review
  • bug 790538 - Enhance update tests to check for the 'what's new page' when `actions='silent'` given in update snippet
  • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
    • unable to reproduce locally yet
  • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
    • waiting for review
  • bug 807931 - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
    • unable to reproduce locally yet
  • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
  • bug 600291 - Update test module testSearchAddons to reflect the new Add-ons API
    • patch will be added today
  • bug 809434 - Get rid of controller.assertChecked() in favor of expect.* and assert.* methods
    • Checkin on default done, backports will be added today
  • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
  • bug 800708 - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js
    • will be closed when bug 823064 will be fixed
  • bug 785041 - Mozmill test failure testSecurity/testGreyLarry.js with "Controller.assertJSProperty(ID: page-proxy-favicon) : http://localhost:43336/images/mozilla_favicon.ico == http://localhost:43336/favicon.ico "
    • Andreea will update the issue today
  • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js

Roundtable

• [henrik] Sprint definition task will be a joined task by Otilia and Daniela

Presentation / Demo

• [%name%] %topic%

Triage

• mozmill-2.0?
• mozmill-2.0+

Personal Status

For the personal status please check the weekly status updates:

• 121231 - 130106

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130107

Action items

• [NEW] Henrik to get back to Clint and ask about feedback re: moving mac mini machines
• [NEW] Henrik: Update meeting page template for blockers list
• [NEW] Andrei: look into MozMill 2.0, see if we have any regressions