QA/Test Pilot Test Plan

Test Pilot Test Plan

last update by tracy (1-26-2010 - This is a work in progress)

Overview

Test Pilot is a platform aimed at collecting structured user feedback from Firefox and other Mozilla Labs experiments.

Testing Weave will present some unique challenges in that data from many areas of the browser are to be stored and synced securely across multiple browser versions and multiple operating systems, including mobile.

Mozilla Labs - Test Pilot Project Page
Test Pilot Home Page Test Pilot Blog

Builds

• Mozilla Labs - Test Pilot Add-ons page

Test Strategy

Mozilla QA will be taking a lightweight testing approach to Test Pilot.

• Areas of test coverage
  • Installing/Upgrading the extension
  • General User Interface
    • Access to various pages
    • Verify interfaces for surveys, experiments, etc.
    • Verify data is collected as expected
    • Confirm data is uploaded with feedback as to its status
• Attempt to verify bug fixes a couple times a month

• Unit tests from developers?

• Areas not tested
  • data integrity/correctness on server end
  • long term regular interaction with Test Pilot tests (this is better left for our community)

• Browser Versions covered
  • Firefox 3.6 (primary)
  • Firefox next (spot check if time allows)

• Operating systems covered
  • Windows
    • XP (primary)
    • 7 (spot check if time allows)
  • Apple
    • Snow Leopard (10.6) (primary)
  • Linux (spot check if time allows)

Schedule Scoping

• We would like QA to give each new version of the Test Pilot Extension itself as well a each new test a quick once over before it is released as a sanity check. We'll be flexible in doing this smoke testing any time in the development cycle for that release.

Bugs

• All open Test Pilot bugs
• Bugs fixed in the last month (need VERIFICATION)

Contacts

• Developer - Jono
• QA - Tracy