Releases/Firefox 3.6.4/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(34 intermediate revisions by 4 users not shown)
Line 3: Line 3:
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.


= Firefox 3.6.4 Smoketest and BFT Results =
= Firefox 3.6.4 Build 1 Smoketest and BFT Results =


'''Build IDs'''
'''Build IDs'''
* Windows:  
* Windows: 20100413172113
* OS X:  
* OS X: 20100413152922
* Linux:  
* Linux: 20100413154310


= Smoketests for Build 1 =
= Smoketests =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=149 Click] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=149 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=149 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=149 Smoketest Report]


== Windows XP (gmontagu) ==
== Windows XP (gmontagu) ==
* Date:  
* Date: April 15 2010
* Build ID:  
* Build ID: 20100413172113
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [ Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/572313ae479b11df9a92005056a533eb Results]
** Restart: [ Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/b36bcc9a479c11df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Manual) (Mozmill and Manual)
** Notes:
** Notes: I didn't run the "Basic Printing" test


== Windows 7 (tester) ==
== Windows 7 (abillings) ==
* Date:  
* Date: 4/14/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [ Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/1ec26bfa479f11df9a92005056a533eb Results]
** Restart: [ Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/90e5de42479f11df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Windows Vista (tester) ==
== Windows Vista (aravindm) ==
* Date:  
* Date: 4/15/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [ Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/175c6cd247a211df9a92005056a533eb Results]
** Restart: [ Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/e843d11447a211df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.5/6 (abillings) ==
* Date:  
* Date: 4/14/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''RESULTS'''
** Normal: [ Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/06fd456a479c11df9a92005056a533eb Results]
** Restart: [ Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/7ccc3ad0479c11df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Linux (tester) ==
== Linux (aravindm) ==
* Date:  
* Date: 4/15/2010
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''RESULTS'''
* Mozmill '''PASS'''
** Normal: [ Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/081e7770479c11df9a92005056a533eb Results]
** Restart: [ Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ea8cffcc479d11df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: From Opera 10.10 version, able to import cookies only.


= BFT's =  
= BFT's =  
Line 67: Line 67:
== Windows XP ==
== Windows XP ==
The BFT will be divided up in four sections.
The BFT will be divided up in four sections.
* Date:  
* Date: April 14 2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729)
** Installation - Tabbed Browsing (tester)
** Installation - Tabbed Browsing (gmontagu)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Search - Addons (tester)
** Search - Addons (gmontagu)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Downloading - Cookies (tester)
** Downloading - Cookies (abillings)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Security - Uninstall (tester)
** Security - Uninstall (abillings)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
* Notes:
* Notes:


== Linux ==
== Linux ==
The BFT will be divided up in four sections.
The BFT will be divided up in four sections.
* Date:  
* Date: April 15 2010
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
** Installation - Tabbed Browsing (tester)
** Installation - Tabbed Browsing (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Search - Addons (tester)
** Search - Addons (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Downloading - Cookies (tester)
** Downloading - Cookies (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Security - Uninstall (tester)
** Security - Uninstall (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
* Notes:
* Notes:



Latest revision as of 00:52, 24 April 2010

« Firefox:3.6.4:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.4 Build 1 Smoketest and BFT Results

Build IDs

  • Windows: 20100413172113
  • OS X: 20100413152922
  • Linux: 20100413154310

Smoketests

Windows XP (gmontagu)

  • Date: April 15 2010
  • Build ID: 20100413172113
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes: I didn't run the "Basic Printing" test

Windows 7 (abillings)

  • Date: 4/14/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (aravindm)

  • Date: 4/15/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.5/6 (abillings)

  • Date: 4/14/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill RESULTS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (aravindm)

  • Date: 4/15/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: From Opera 10.10 version, able to import cookies only.

BFT's

BFTs will occur on all platforms that ships Out of Process Plugins.

Windows XP

The BFT will be divided up in four sections.

  • Date: April 14 2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729)
    • Installation - Tabbed Browsing (gmontagu)
      • Results: PASS - Results in Litmus
    • Search - Addons (gmontagu)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (abillings)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (abillings)
      • Results: PASS - Results in Litmus
  • Notes:

Linux

The BFT will be divided up in four sections.

  • Date: April 15 2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
    • Installation - Tabbed Browsing (aravindm)
      • Results: PASS - Results in Litmus
    • Search - Addons (aravindm)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (aravindm)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (aravindm)
      • Results: PASS - Results in Litmus
  • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Status: RESULTS