QA/Weave Test Plan/Client Manual Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(9 intermediate revisions by 2 users not shown)
Line 6: Line 6:
*[https://addons.mozilla.org/en-US/firefox/addon/10868 Mozilla Labs - Weave Sync]  
*[https://addons.mozilla.org/en-US/firefox/addon/10868 Mozilla Labs - Weave Sync]  
*[https://people.mozilla.com/~cbeard/weave/dist/latest-weave.xpi Experimental Version]
*[https://people.mozilla.com/~cbeard/weave/dist/latest-weave.xpi Experimental Version]
*Staging Server [https://stage-auth.services.mozilla.com https://stage-auth.services.mozilla.com]


== Areas Covered ==
== Areas Covered ==


#UI/front end - [http://spreadsheets.google.com/ccc?key=0AkSa2kZ0OBffdFMtR1NwZ2Nra29xMllTSlY2OExCUVE&hl=en Test case spreadsheet]  
#UI/front end - [https://litmus.mozilla.org/run_tests.cgi?test_run_id=83 Litmus Weave 1.x Test Run]  
#*Account management  
#*Account management  
#**Setup new account
#**Setup new account
Line 18: Line 19:
#**Bookmarks  
#**Bookmarks  
#**Passwords  
#**Passwords  
#**Preferences - [http://mxr.mozilla.org/labs-central/source/weave/source/defaults/preferences/sync.js.in#34 Synced settings]  
#**Preferences - [http://mxr.mozilla.org/labs-central/source/weave/source/defaults/preferences/sync.js.in#34 Synced settings]. [http://hg.mozilla.org/labs/weave/file/1.3b3/source/defaults/preferences/sync.js.in#l34 within hg]
#**History (browser and form)  
#**History (browser and form)  
#**Tabs  
#**Tabs  
#**Personas  
#**Personas  
#*Backward compatibility  
#*Fennec Sync
#**Bookmarks, History, Passwords, Tabs
#** Not compatible: Preferences and Themes
#*Backward compatibility
#*Fresh Start with exceptionally large profile
#** ensure no hangs, crashes or apparent data loss (note: Weave limits and parcels out syncing of large data sets)
#* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=45 Firefox 3.6] BFT of subgroups that Weave touches
#** Tabbed Browsing
#** Bookmarks
#** History
#** Options
#** Lightweight Themes
#** Awesomebar
#** Password Manager
#** Form Manager
#** Search
#** Private Browsing


== Areas not covered ==
== Areas not covered ==
Line 49: Line 66:


= Schedule Scoping  =
= Schedule Scoping  =
*1.2 (released 4/9/2010) [https://wiki.mozilla.org/QA/Weave_Test_Plan/1.2 1.2 Client test plan]  
*1.3 (target 5/17)  
*1.3 (target 5/17) [https://wiki.mozilla.org/QA/Weave_Test_Plan/1.3 1.3 Client test plan]
**[https://wiki.mozilla.org/QA/Weave_Test_Plan/1.3 1.3 Client test plan]
 
*1.2 (released 4/9/2010)  
**[https://wiki.mozilla.org/QA/Weave_Test_Plan/1.2 1.2 Client test plan]


= Litmus Test Cases =
= Litmus Test Cases =


Until Weave is integrated into Firefox test cases will be filed in the Weave dedicated testgroup. When weave becomes integrated into Firefox, relevant test cases will be merged into the Firefox test groups.
Until Weave is integrated into Firefox test cases will be filed in the Weave dedicated testgroup. When weave becomes integrated into Firefox, relevant test cases will be merged into the Firefox test groups.

Latest revision as of 14:54, 5 May 2010

Test Strategy

Weave Client Extension Testing (Lead: Tracy Walker)

This involves black box execution directly on the extension, testing the features and usage of the operation of the client.   Involves data syncing and cross browsers and OS platform support.   Will heavily include Fennec integration.

Builds

Areas Covered

  1. UI/front end - Litmus Weave 1.x Test Run
    • Account management
      • Setup new account
      • Password and Passphrase changes
      • Reset Sync
      • Switching accounts
    • ensure sync is accurate in the following areas. No data loss is critical. Check each area by syncing item adds and item removals
    • Fennec Sync
      • Bookmarks, History, Passwords, Tabs
      • Not compatible: Preferences and Themes
    • Backward compatibility
    • Fresh Start with exceptionally large profile
      • ensure no hangs, crashes or apparent data loss (note: Weave limits and parcels out syncing of large data sets)
    • Firefox 3.6 BFT of subgroups that Weave touches
      • Tabbed Browsing
      • Bookmarks
      • History
      • Options
      • Lightweight Themes
      • Awesomebar
      • Password Manager
      • Form Manager
      • Search
      • Private Browsing

Areas not covered

Platform and product coverage

  • Browsers Versions covered
    • Firefox 3.6 (primary)
    • Fennec 1.0 (primary)
    • Firefox 3.5 (spot check if time allows)
    • Firefox next (spot check if time allows)
  • Operating systems covered
    • Windows
      • 7 (primary)
      • XP (spot check if time allows, ahead of any other spot checks)
      • Vista (spot check if time allows)
    • Apple
      • Snow Leopard (10.6) (primary)
      • Leopard (10.5) (spot check if time allows)
      • Tiger (10.4) (spot check if time allows)
    • Linux (spot check if time allows)
    • Mobile
      • fennec mobile device (primary)
      • fennec desktop versions on XP (spot check if time allows)

Schedule Scoping

Litmus Test Cases

Until Weave is integrated into Firefox test cases will be filed in the Weave dedicated testgroup. When weave becomes integrated into Firefox, relevant test cases will be merged into the Firefox test groups.