Releases/Firefox 3.6.4/Test Plan:Smoketests2: Difference between revisions

(Created page with '<small>« Firefox:3.6.4:Test_Plan</small> Smoketests and BFTs are run partially though Mozmill automation and partially through manual …')
 
 
(29 intermediate revisions by 4 users not shown)
Line 3: Line 3:
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.


= Firefox 3.6.4 Build 2 Smoketest Results =
= Firefox 3.6.4 Build 3 Smoketest Results =


'''Build IDs'''
'''Build IDs'''
* Windows:  
* Windows: 20100503122926
* OS X:  
* OS X: 20100503113315
* Linux:  
* Linux: 20100503113541


* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=149 Click] to run the Smoketests - '''Not a valid link yet'''
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=152 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=149 Smoketest Report] - '''Not a valid link yet'''
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=152 Smoketest Report]




== Windows XP (tester) ==
== Windows XP (abillings) ==
* Date:  
* Date: 5/3/2010
* Build ID:
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [x Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/e01e5e9056f311dfb93a005056a533eb Results]
** Restart: [x Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/662fcb4056f411dfb93a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Manual) (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes:


== Windows 7 (tester) ==
== Windows 7 (abillings) ==
* Date:  
* Date: 5/3/2010
* Build ID:
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [x Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ec036ab256f711dfb93a005056a533eb Results]
** Restart: [x Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/5eb6255e56f811dfb93a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Manual) (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes:


== Windows Vista (tester) ==
== Windows Vista (abillings) ==
* Date:  
* Date: 5/3/2010
* Build ID:
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [x Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/3792424e56fa11dfb93a005056a533eb Results]
** Restart: [x Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/efec1b8a56fa11dfb93a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Manual) (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes:


== Mac OS X 10.5/6 (tester) ==
== Mac OS X 10.5/6 (marcia) ==
* Date:  
* Date: 05/03/10
* Build ID:   
* Build ID:  Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [x Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/008b163c56f411dfb93a005056a533eb Results]
** Restart: [x Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/7f6b6f3856f411dfb93a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Manual) (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes:
***No issues noted during manual test run. Visited a number of different video sites.
***Spot check using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4. Looked good as well.


== Linux (tester) ==
== Linux (abillings) ==
* Date:  
* Date: 5/3/2010
* Build ID:
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''RESULTS'''
** Normal: [x Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/bb69c4d656f311dfb93a005056a533eb Results]
** Restart: [x Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/429d419e56f411dfb93a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Manual) (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes:
= BFT's =
BFTs will occur on all platforms that ships Out of Process Plugins.
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=153 Click] to run the BFT
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=153 BFT Report]
== Windows XP ==
The BFT will be divided up in four sections.
* Date: 5/3/2010 - 5/4/2010
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
** Installation - Tabbed Browsing (aravindm)
*** Results: '''PASS''' - Results in Litmus
** Search - Addons (abillings)
*** Results: '''PASS''' - Results in Litmus
** Downloading - Cookies (aravindm)
*** Results: '''PASS''' - Results in Litmus
** Security - Uninstall (aravindm)
*** Results: '''PASS''' - Results in Litmus
* Notes:

Latest revision as of 15:53, 4 May 2010

« Firefox:3.6.4:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.4 Build 3 Smoketest Results

Build IDs

  • Windows: 20100503122926
  • OS X: 20100503113315
  • Linux: 20100503113541


Windows XP (abillings)

  • Date: 5/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes:

Windows 7 (abillings)

  • Date: 5/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 5/3/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes:

Mac OS X 10.5/6 (marcia)

  • Date: 05/03/10
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes:
      • No issues noted during manual test run. Visited a number of different video sites.
      • Spot check using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4. Looked good as well.

Linux (abillings)

  • Date: 5/3/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
  • Mozmill RESULTS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes:

BFT's

BFTs will occur on all platforms that ships Out of Process Plugins.

Windows XP

The BFT will be divided up in four sections.

  • Date: 5/3/2010 - 5/4/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100503 Firefox/3.6.4
    • Installation - Tabbed Browsing (aravindm)
      • Results: PASS - Results in Litmus
    • Search - Addons (abillings)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (aravindm)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (aravindm)
      • Results: PASS - Results in Litmus
  • Notes: