QA/Automation/Meetings/150202

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
• Chair: Mihaela
• Notes: Andreea

Highlights

• TBD

Blockers

• List of blockers (http://bit.ly/Tph0NY):
  • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
  • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
  • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
  • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
  • [01/14] Bug 1120919 - [pulsetranslator] Consumers should listen for routing keys ending with .finished instead of .log_uploaded

Roundtable

• TBD

Goals

• https://wiki.mozilla.org/QA/Automation#Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

• bug 1123401 - Chrome window handling has been landed
• bug 1123871 - Navbar and Location bar modules have been landed
• bug 1127831 - Tabbar and tab handling is still under work. Has to land today
• The next three days we will have a Marionette training and will start to convert tabbed browsing and locationbar tests.

Run Marionette tests in Mozmill CI (bug 1119725)

• No updates from last week
• Will integrate mozinstall for installing and uninstalling builds
• Different entry points will be defined for individual tests

Create Pulse notifications for update channel activities (bug 735184)

• No updates

Test Automation (Softvision)

Creation of automated tests for important regressions

• bug 1009460 Add automated test to verify the UI and preferences after forgetting the email for unverified user
• bug 1037416 Add mozmill test for Developer Tools keyboard shortcuts
• bug 1113101 Add automated test to check that openH264 plugin’s state is maintained after restart
• bug 1113192 Add automated test to check that prefs for openH264 plugin are correctly generated
• bug 1109140 Create a remote Mozmill test for "What is this page?" links in "about:newtab" | BLOCKED

Project Updates

Mozmill Tests (Softvision)

• bug 908649 Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
• bug 1088551 Test failure 'Panel is in the correct state - 'closed' should equal 'open in testSecurity/testSSLStatusAfterRestart.js
• bug 1106736 Test failure 'The page title matches the underlined text' in testAwesomeBar/testSuggestBookmarks.js
• bug 1110639 Remove testAdons_installTheme
• bug 1113158 Refactor testAwesomeBar tests to use nsINavHistoryService.addObserver method instead of sleep
• bug 1120461 Test failures "Suite progress indicator is green - got 'false'", "No tests have failed - '1' should equal '0'" and "No error messages present - '1' should equal '0'" in testAssertAlertPresentPasses.js and testVerifyAlertPresentPasses.js
• bug 1120462 Test failure "One error message present - '2' should equal '1' " in /testVerifyAlertNotPresentFails.js and testVerifyAlertPresentFails.js
• bug 1120906 waitForPageLoad fails intermittently after opening a new tab when 'browser.newtab.preload' property is set to true
• bug 1122516 Refactor tabBrowser's closeAllTabs() method in firefox/lib/tabs.js
• bug 1126175 Test failure 'The correct SSL error title is shown - 'Unable to Connect Securely' should equal 'Secure Connection Failed ' in testSecurity/testSSLDisabledErrorPage.js
• bug 1126771 Disable animations for opening and closing tabs

Mozmill (Henrik)

• Landed two preferences changes (disabling of newtab prefetching and tab animation) to get more stable tests

TPS (Henrik)

• Still blocked on server-side issues

Testday Bot (Barbara)

• in progress
  • https://github.com/mozilla/testdaybot/pull/64 - Add to :help response with single message to channel (review)
  • https://github.com/mozilla/testdaybot/pull/69 - Count updated firebot bug URLs (review)
  • https://github.com/mozilla/testdaybot/pull/70 - Report stats using fewer messages (review)

Softvision Updates

• Detailed progress information from last sprint: https://groups.google.com/forum/#!topic/mozilla.dev.automation/ZK_Us-uVBss

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-meeting-20150202

If you missed the meeting you can also watch it in our archive.

Action items

Chair Notes