QA/Test Automation/2011-06-29

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

Last action items

  • David: Work with Geo and Anthony to get some first ideas for changes of the review process; we will schedule a meeting once Henrik is back (should happen in June)
    • We should have a deeper discussion during our upcoming work week (Henrik)

Goals Overview

Risky Goals

  • Complete the refactoring of the API
  • Create the top 5 tests for the discovery pane
    • 4 tests now in SR, remainder need revisions

Project Status

Redesign Shared Modules (Geo/Henrik)

On-demand release tests (Geo/Henrik)

  • Henrik is working on the final version of the staging script, which will also cover candidate builds (and later daily builds)

Endurance Tests (Dave/Anthony)

  • Flash videos landed on mozqa.com and litmus-data, will target test page and test case writing next quarter
  • Waverley to assist next quarter by making a portion of their test development Endurance tests related to the focus area

Others

Mozmill Crowd

  • We are about to release Mozmill Crowd 0.1.3 by latest tomorrow (bug 667902)
  • Waiting for preliminary review on addons.mozilla.org
  • Testday for Mozmill Crowd (and test development) this Friday, July 1st

Dashboard

Current dashboard installation (Henrik)
  • no updates
New dashboard driven by ES (Owen)
  • updates?

Sync Server Load Testing (Owen)

  • updates?

On Demand Provisioning (Cloud Automation) (Al/Henrik)

  • updates?

Tests / Shared Modules

General (Henrik)
Broken Tests
  • A couple of broken tests across brances in the last days. It has been caused by Henrik's patch for the Mozmill change in handling 'documentLoaded'. As is turned out today it's a Mozmill bug which blocks the thread execution if the window passed to the controller is null. See 668202 bug 668202.
Softvision (Anthony)
  • 4 Discovery Pane tests in SR, remainder need revisions
  • Will focus on Add-ons Manager restart tests next quarter, tacking on Web Apps or a Firefox 8 feature pending feature readiness

TCM (Cameron/Rebecca B.)

  • updates?

Shadow web server (Al/Henrik)

  • updates?

Automation Scripts / Infrastructure (Henrik)

  • Download script has been enhanced to also download daily builds of Nightly or Aurora
  • We can now even download Nightly builds from project branches - anyone interested in?

Personal Status

For the personal status please check the weekly status updates:

Roundtable

General
  • Changes to our bi-weekly meeting regarding the org changes (Henrik)
    • We should setup preliminary pages which describe our new team next week
    • We should move the meeting pages below the new team page and call it "QA Automation Services Meeting"
  • Review process (Henrik)
    • A more detailed discussion should happen during our work week in Cambridge
    • We have to find an interim solution to get not stuck in review requests
      • If you are not able to react to a review request from Softvision or contributors within one day, you should pass the review to another person
      • If there are issues you are running into, spread this information across the team. It takes lesser time to solve it together
  • Discovery Pane tests
    • Do we want to allow tests to auto-skip themselves? If not we should mark those tests as skipped on default and aurora as long as the dependencies with WebDev are not solved.

Meeting Notes

Action items