QA/Test Pilot Test Plan: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
(Created page with ';Test Pilot Test Plan ''last update by tracy (1-26-2010 - This is a work in progress)'' = Overview = Test Pilot is a platform aimed at collecting structured user feedback from…')
 
mNo edit summary
Line 52: Line 52:
* [https://bugzilla.mozilla.org/buglist.cgi?classification=Other;query_format=advanced;bug_status=UNCONFIRMED;bug_status=NEW;bug_status=ASSIGNED;bug_status=REOPENED;component=Test%20Pilot;product=Mozilla%20 All open Test Pilot bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?classification=Other;query_format=advanced;bug_status=UNCONFIRMED;bug_status=NEW;bug_status=ASSIGNED;bug_status=REOPENED;component=Test%20Pilot;product=Mozilla%20 All open Test Pilot bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED;classification=Other;chfieldto=Now;query_format=advanced;chfieldfrom=-1m;bug_status=RESOLVED;component=Test%20Pilot;product=Mozilla%20Labs Bugs fixed in the last month (need VERIFICATION)]
* [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED;classification=Other;chfieldto=Now;query_format=advanced;chfieldfrom=-1m;bug_status=RESOLVED;component=Test%20Pilot;product=Mozilla%20Labs Bugs fixed in the last month (need VERIFICATION)]
= Contacts=
Developer - Jono
QA - Tracy

Revision as of 17:12, 26 January 2010

Test Pilot Test Plan
last update by tracy (1-26-2010 - This is a work in progress)

Overview

Test Pilot is a platform aimed at collecting structured user feedback from Firefox and other Mozilla Labs experiments.

Testing Weave will present some unique challenges in that data from many areas of the browser are to be stored and synced securely across multiple browser versions and multiple operating systems, including mobile.

Mozilla Labs - Test Pilot Project Page
Test Pilot Home Page Test Pilot Blog

Builds

Test Strategy

Mozilla QA will be taking a lightweight testing approach to Test Pilot.

  • Areas of test coverage
  • Installing/Upgrading the extension
  • General User Interface
    • Access to various pages
    • Verify interfaces for surveys, experiments, etc.
      • Verify data is collected as expected
      • Confirm data is uploaded with feedback as to its status
  • Unit tests from developers?
  • Areas not tested
    • data integrity/correctness on server end
    • long term regular interaction with Test Pilot tests (this is better left for our community)
  • Browser Versions covered
    • Firefox 3.6 (primary)
    • Firefox next (spot check if time allows)
  • Operating systems covered
    • Windows
      • XP (primary)
      • 7 (spot check if time allows)
    • Apple
      • Snow Leopard (10.6) (primary)
    • Linux (spot check if time allows)

Schedule Scoping

  • We would like QA to give each new version of the Test Pilot Extension itself as well a each new test a quick once over before it is released as a sanity check. We'll be flexible in doing this smoke testing any time in the development cycle for that release.

Bugs

Contacts

Developer - Jono QA - Tracy

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Test_Pilot_Test_Plan&oldid=196832"