QA/Automation/Meetings/121210

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
  • Clint, Andreea, Mihaela, Rob, Alex, Henrik, Joel, Mario, Andrei
• This meeting:
  • Chair: Alex

Last Weeks Action Items

• [CARRY OVER] Daniela - Investigate bug 772360 (The bookmark was created) and get it reproduced constantly
• [DONE] Dave - Schedule December testday
  • See highlight
• [DONE] Henrik - Ping Jason to get the meeting setup for mozqa.com
• [DONE] Dave - Document responsbilities for failure / infrastructure duties
  • See Mozmill CI Duties

Highlights

• [davehunt] We're hosting a Firefox OS Automation Testday this Friday. Come along and help to contribute some automated tests. You might want to prepare your machine in advance (guides can be found in the etherpad) if you don't have a device or emulator ready.
• [davehunt] b2gperf (time to paint) tests running for Phone, Messages, Browser, and Settings apps on Unagi device in Jenkins (requires MV VPN). Reporting to DataZilla is in progress.

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Blockers

• Automation Blockers: http://bit.ly/Tph0NY

Issues

• bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
• bug 805812 - Locale updates for Windows are offering the same build for updating from/to
• bug 745975 - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
• bug 757122 - Pulse: Notifications for finished builds should not be send out before the builds are available for download

Project Updates

Gaia UI (Dave)

• Blocker: bug 819809 - Marionette not properly starting tests and switching to frame (regression: 12/09)
• Marked tests appropriately when they require a local area network (rather than wifi specifically) to allow such tests to run on B2G desktop and panda boards
• Test stability improvements, with more in progress
• FM Radio test landed

WebAPI (Rob)

• Submitted updated patch for WebProximitySensor tests (bug 811583)
• Submitted patch for WebMobileConnection.data tests (bug 811580)
• Dave submitted patch for battery charging status (bug 805452)
• Test reviews for our tests and reviews of some test changes by development
• Patch coming today for Screen Orientation API test (bug 813777)

WebRTC (Henrik)

• Leaking mochitests have been enabled on the Alder branch
• Working on the initial basic video peer connection test caused a lot of extra work due to crashes and unexpected behavior.
• I'm going to simply transform the manual tests from http://mozilla.github.com/webrtc-landing/ as first step (those should be proven to work)
• We now have https://github.com/whimboo/webrtc-tests where first mochitests will land until they are ready for final review

Softvision Updates

• Fixed:
  • bug 817289 -Test failure 'Controller.assertJSProperty(XPath: /*[name()="window"]/*[name()="popupset"][1]/*[name()="menupopup"][5]/*[name()="menuitem"][1]) : true == false' in testPrivateBrowsing/testDisabledPermissions.js
  • bug 810820 - Test failure "Modal dialog has been found and processed" in /testSecurity/testEncryptedPageWarning.js
  • bug 812438 - Test failure ": could not find element Selector: .bookmark-item[label='testFolder']" in endurance/testBookmarks_OpenAndClose/test1.js
  • bug 795831 - Add test files to litmus-data repository for video controls testing
  • bug 785176 - Do some testing to make sure that enablePrivilege is not exposed to the web

• Blocked bugs:
  • bug 788531 - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check

• Dependent bugs:
  • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing - dependent on bug 810301 - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager

• Working on:
  • bug 800800 - Ensure we always wait for removeAllHistory() in places.js - P1
    • check reports to see if bug 815605 has fixed the "Browsing History has been cleared" failure
  • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
  • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
    • Asked Marco Bonardo about the property we should wait for in case the test is failing
  • bug 810301 - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
  • bug 812435 - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
  • bug 812114 - Add an observer for the stop() method in private-browsing.js shared module
    • investigate why this fails on ESR17, do testruns on release as well (waiting answer from Josh Matthews)
  • bug 790538 - Enhance update tests to check for the 'what's new page' when `actions='silent'` given in update snippet
  • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
  • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
  • bug 782661 - Mozmill endurance test failure in testBookmarks_OpenAllIntTabs | "could not find element Selector: .bookmark-item[label='Test Folder'] "}}
    • Possible fix found, but unable to reproduce locally so cannot make sure the fix is correct
  • bug 780892 - Split testFocusAndSearch.js into two test modules

Roundtable

• Introducing Mario

Presentation / Demo

• [%name%] %topic%

Triage

• mozmill-2.0?
• mozmill-2.0+

Personal Status

For the personal status please check the weekly status updates:

• 121210 - 121217

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20121210

Action items

• [NEW] Henrik: Talk to Michael Ventnor about the system proxy issue on Linux
• [NEW] Henrik: Follow up with Ted about the faked devices for WebRTC