QA/Automation/Meetings/130121

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
  • Dave, Andreea, Andrei, Daniela, Mario, Mihaela, Otilia, Henrik, Rob
• This meeting:
  • Chair: Andreea Matei

Last Weeks Action Items

• [NEW] Henrik: Update goals on the wiki page
  • Cannot do that as long goals haven't been added to smartsheet
• [NEW] Alex and Clint: Follow up on WebQA review process guidelines
• [NEW] Clint: Followup with Releng about the idea to report directly to tbpl

Highlights

• [Softvision] Alex has left our team, but he promised to continue as an enthusiastic contributor :-)
• [Henrik] We finally turned the knob and switched over to the new CI system for Windows and Linux (this includes a speed-up from 2h to 20min for ondemand update tests!!!)
• [davehunt] B2G/Gaia performance test data is live!

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Blockers

• The following are active blockers: http://bit.ly/Tph0NY

Issues

• bug 832510 - Merge l10n build requests for same locale
• bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
• bug 745975 - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
• bug 757122 - Pulse: Notifications for finished builds should not be send out before the builds are available for download
• bug 781129 - Pulse: Notifications for outdated builds are getting send via Pulse
• bug 777354 - Regression in shutdown time of httpd.js (~6s) when multiple local pages have been opened

Project Updates

Gaia UI (Dave)

• [rwood] Adding method to data_layer atom to delete existing SMS messages
• [rwood] Adding test for moving application on homescreen, need fix for longpress first
• Landed a fix for an issue often seen when a test fails, and causes all later tests to fail early.
• Tests now clear all media between tests and provide required media in setup.

WebAPI (Rob)

• bug 806811 - WebSMS: add test case for multi-segment SMS and maximum segments supported (patch finished, pushed to try)
• bug 805005 - Implement Marionette tests for Screen Orientation API (tests under review/need post-review update)

WebRTC (Henrik)

• Patch landed to update all basic mochitests for conformance (bug 831782)
• Next is updating the peer connection tests to verify media flow (bug 831789)
• Followed by various data connection tests

Softvision Updates

• Fixed:
  • bug 830262 - Test failure %Plugin% does not appear in about:plugins - got 'false in testPluginDisableAffectsAboutPlugins.js
  • bug 793092 - Replace controller.waitFor with assert/expect.waitFor in remaining mozmill tests and modules
  • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1

• Blocked bugs:
  • bug 788531 - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
  • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js

• Waiting for review / Checkin needed
  • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
  • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
  • bug 826251 - Make testPreferences/testPreferredLanguage.js language independend

• Working on:
  • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
    • reproduced on the new environment, trying to reproduce locally. In case it doesn't reproduce, I will try on the machines where it previously reproduced.
  • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • need feedback in order to continue creating the patch since while running the updated tests, a new issue was found.
  • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
    • working on new library for windows handling
  • bug 812114 - Add an observer for the stop() method in private-browsing.js shared module
    • found fix, waiting for mozmill-crowd to function in order to add reports as well
  • bug 803489 - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox
  • bug 785306 - Add more logic to the restart tests to skip following test files if a test is failing
  • bug 831297 - Test Failure "Disconnect Error: Application unexpectedly closed" in /l10n/testAccessKeys/test1.js
  • bug 684679 - Mozmill test for installing and uninstalling a blocklisted extension

Roundtable

• [henrik] Today we have a fallout of IrisCouch so we can't send any of our results to the dashboard. What about switching to our own rewritten Dashboard instance?

Presentation / Demo

• [%name%] %topic%

Triage

• mozmill-2.0?
• mozmill-2.0+

Personal Status

For the personal status please check the weekly status updates:

• 130121 - 130127

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130121

Action items

• [NEW] Henrik: Update goals on the wiki page
• [NEW] Alex and Clint: Follow up on WebQA review process guidelines
• [NEW] Clint: Followup with Releng about the idea to report directly to tbpl
• [NEW] Dave: Investigate and implement binding the endurance tests to specific nodes of the CI
• [NEW] Henrik: Check mozmill or mozmill-automation so we do not fail when we can't send the report