QA/Test Automation/2010-11-17

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

• Cameron, Geo, Al, Matt, Anthony, Aaron, Adrian, Henrik, Dave

Goals Overview

• QA Q4 goals

Project Status

Tests / Shared Modules

General (Henrik)

• Waiting for Clint's proposal how to do Drag&Drop - needed for Panorama tests

Broken Tests

• Firefox 4.0 (Geo)
• Firefox 3.5/3.6 (Anthony)
  • Landed waitForTabPanel() to make notification bar handling more reliable (5 of top-10 fails resolved)

DOM Walker + L10n API (Adrian)

• final review stages

Redesign Shared Modules (Geo)

Test Refactoring (Anthony)

• Draft styleguide being composed (targetting EOW)
• Begin refactoring once styleguide approved

Local Test Data (Anthony)

• No progress yet - considering community outreach to create testpages
  • 35 tests are already local
  • 4 tests remain which can be made local
  • remainder are not doable in Mozmill
  • not much value-add

Update Testing (Henrik)

• Currently we fail in downloading partial updates because the about window and the old ui are blocking each other. (bug 599290)
  • Attached is a workaround patch
• We will have to update the shared module asap to be able to test the new ui

Add-ons Testing (Henrik)

• With Mozmill 1.5.1 add-on authors should be able to create tests now. But should we wait with advertisement until shared modules have been refactored?
• Dave is working on tests for the Selenium IDE extension

Mozmill Crowd Extension (Henrik)

• In contact with Patrick Brunswig regarding IPC-PIPE regression. Will still use nsIProcess to prevent possible other upcoming regressions

Mozmill Result Dashboard (Henrik)

• Waiting to land patches for software update tests (multiple updates)

Automation / Infrastructure (Henrik)

• Investigating possible notification exchange between RelEng/QA for triggered test-runs

Personal Status

For the personal status please check the weekly status updates:

• 101115 - 101119

Roundtable

General

• Results from work week
• Endurance tests with Mozmill (see Etherpad document)
• MozMill testday on Nov 26th?
  • Can we combine this testday with goals we want to see accomplished by end of this year?
  • What about help in refactoring the tests? That sounds like a great collaboration.
  • Help in fixing still remaining broken tests.
  • Getting feedback for the documentation, beside the notes Dave already has written down
  • Creation of test files for local test data project
• Litmus vs. Mozmill tests
  • For the add-ons manager we have 60+ in-litmus requests. Do we want to have manual tests for all those requests or can we only implement those which really need manual action?
• Other
  • Etherpad
    • Any comments? What do you like? What don't you like? Any suggestions?
      • I can directly see the status of any team member without having to look at their status reports (Henrik)
      • I can see discussions even when I was offline (Henrik)
      • Etherpad makes it so easy and fast to edit content compared to the wiki (Henrik)

Issues