QA/Automation/Meetings/150126

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees: Andreea, Cosmin, Daniela, Henrik, Mihaela, Teodor
• Chair: Teodor
• Notes: Cosmin

Last Weeks Action Items

• [NEW] [Softvision] Trigger some tests in loops to see which machines are most affected by the failures (WSAEINVAL or the most affected one...)
  • have a simple test case which reproduces the problem and run it with Mozmill 2.1 which gives more info when FF crashes or disconnects
  • use 2.0.9 to see get the test then use 2.1 to get more info
  • Andreea will look at this tomorrow - Tuesday
• [DONE] Barbara - to talk to Anthony about the testday bot, if he wants to use it for next test day
  • henrik discussed with Anthony who is happy with this and wil start to use it this Friday

Highlights

• [henrik] Firefox Automation report – week 49/50 2014: http://www.hskupin.info/2015/01/22/firefox-automation-report-week-49-50-2014/
• [Softvision] bug 1113158 - Functional testruns are ~30-40 seconds faster now.

Blockers

• List of blockers (http://bit.ly/Tph0NY):
  • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
    • no updates
  • [09/03] Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
    • no updates
  • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
    • no updates
  • [11/05] Bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals
    • no issues in the last weeks, decrease the priority
  • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
    • no updates, we will need to increase the priority
  • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
    • fixed

Roundtable

• TBD

Goals

• https://wiki.mozilla.org/QA/Automation#Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

• Upgraded to marionette-client 0.87
• Working heavily to finish the windows module. For a WIP see https://github.com/mozilla/firefox-ui-tests/pull/50/files. I hope to have it up for review later today or early tomorrow.
• Once done the tab module is next

Run Marionette tests in Mozmill CI (bug 1119725)

• No updates

Create Pulse notifications for update channel activities (bug 735184)

• Update channels for all releases are on AUS4 (Balrog) now
• Have to find time to analyze all the logged pulse notifications

Test Automation (Softvision)

Creation of automated tests for important regressions

• In progress:
  • bug 1009460 - Add automated test to verify the UI and preferences after forgetting the email for unverified user
  • bug 1113192 - Add automated test to check that prefs for openH264 plugin are correctly generated
  • bug 1037416 - Add mozmill test for Developer Tools keyboard shortcuts
• Blocked:
  • bug 1109140 - Create a remote Mozmill test for "What is this page?" links in "about:newtab"
  • bug 1110187 - Create a remote Mozmill test for "Sponsored" tiles in "about:newtab"

Project Updates

Mozmill Tests (Softvision)

• Fixed
  • bug 879972 - Create new dialog ui class (which also drops the usage of lookup expressions)
  • bug 1117737 - Test failure 'controller.waitForPageLoad(URI=about:addons, readyState=uninitialized) ' in testAddons/testServiceInstallDisableEnableRemove.js
  • bug 1122530 - Test failure "Tab has been closed" in /ide@seleniumhq.org/tests/testCommands/testAlert/testAssertAlertFails.js
  • bug 1121915 - Move testPreferencesMasterPasswod from testAddons to testPasswordManager
  • bug 1005811 - Update Mozmill tests for in-content preferences pane
  • bug 1120923 - Test failure ": could not find element ID: service" in /testAddons/testServiceInstallDisableEnableRemove.js

Mozmill (Henrik)

• No updates

TPS (Henrik)

• No updates

Testday Bot (Barbara)

• https://github.com/mozilla/testdaybot/pull/48 - Save data and reload Test Day data across bot restarts

• https://github.com/mozilla/testdaybot/pull/53 - Provide information on joining the community

• https://github.com/mozilla/testdaybot/pull/59 - Identify against NickServ

• https://github.com/mozilla/testdaybot/pull/60 - Set Test Day topic using welcome message

• https://github.com/mozilla/testdaybot/pull/61 - Announce in the channel when the test day begins and ends

• https://github.com/mozilla/testdaybot/pull/62 - Print start and end time using UTC with :next command

• https://github.com/mozilla/testdaybot/pull/55 - Refine commands

• https://github.com/mozilla/testdaybot/pull/63 - Improve output of :stats command

• https://github.com/mozilla/testdaybot/pull/66 - Move config.json to config-example.json

Softvision Updates

• Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/%ID%

Personal Status

For the personal status please check the weekly status updates:

• 150126 - 150201

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-meeting-20150126

If you missed the meeting you can also watch it in our archive.

Action items

• TBD