Releases/Firefox 3.6.4/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(13 intermediate revisions by 3 users not shown)
Line 3: Line 3:
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.


= Firefox 3.6.4 Smoketest and BFT Results =
= Firefox 3.6.4 Build 1 Smoketest and BFT Results =


'''Build IDs'''
'''Build IDs'''
Line 10: Line 10:
* Linux: 20100413154310
* Linux: 20100413154310


= Smoketests for Build 1 =
= Smoketests =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=149 Click] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=149 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=149 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=149 Smoketest Report]
Line 33: Line 33:


== Windows Vista (aravindm) ==
== Windows Vista (aravindm) ==
* Date:  
* Date: 4/15/2010
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''PASS'''
* Mozmill '''PASS'''
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/175c6cd247a211df9a92005056a533eb Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/175c6cd247a211df9a92005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/e843d11447a211df9a92005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/e843d11447a211df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


Line 51: Line 51:


== Linux (aravindm) ==
== Linux (aravindm) ==
* Date:  
* Date: 4/15/2010
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
* Mozmill '''PASS'''
* Mozmill '''PASS'''
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/081e7770479c11df9a92005056a533eb Results]
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/081e7770479c11df9a92005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ea8cffcc479d11df9a92005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ea8cffcc479d11df9a92005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: From Opera 10.10 version, able to import cookies only.


= BFT's =  
= BFT's =  
Line 68: Line 68:
The BFT will be divided up in four sections.
The BFT will be divided up in four sections.
* Date: April 14 2010
* Date: April 14 2010
* Build ID: 20100413172113
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729)
** Installation - Tabbed Browsing (gmontagu)
** Installation - Tabbed Browsing (gmontagu)
*** Results: '''PASS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Search - Addons (gmontagu)
** Search - Addons (gmontagu)
*** Results: '''In process''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Downloading - Cookies (tester)
** Downloading - Cookies (abillings)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Security - Uninstall (tester)
** Security - Uninstall (abillings)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
* Notes:
* Notes:


== Linux ==
== Linux ==
The BFT will be divided up in four sections.
The BFT will be divided up in four sections.
* Date:  
* Date: April 15 2010
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
** Installation - Tabbed Browsing (aravindm)
** Installation - Tabbed Browsing (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Search - Addons (aravindm)
** Search - Addons (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Downloading - Cookies (aravindm)
** Downloading - Cookies (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
** Security - Uninstall (aravindm)
** Security - Uninstall (aravindm)
*** Results: '''RESULTS''' - Results in Litmus
*** Results: '''PASS''' - Results in Litmus
* Notes:
* Notes:



Latest revision as of 00:52, 24 April 2010

« Firefox:3.6.4:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.4 Build 1 Smoketest and BFT Results

Build IDs

  • Windows: 20100413172113
  • OS X: 20100413152922
  • Linux: 20100413154310

Smoketests

Windows XP (gmontagu)

  • Date: April 15 2010
  • Build ID: 20100413172113
  • Mozmill PASS
  • Status: PASS in Litmus (Manual) (Mozmill and Manual)
    • Notes: I didn't run the "Basic Printing" test

Windows 7 (abillings)

  • Date: 4/14/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (aravindm)

  • Date: 4/15/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.5/6 (abillings)

  • Date: 4/14/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill RESULTS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (aravindm)

  • Date: 4/15/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: From Opera 10.10 version, able to import cookies only.

BFT's

BFTs will occur on all platforms that ships Out of Process Plugins.

Windows XP

The BFT will be divided up in four sections.

  • Date: April 14 2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729)
    • Installation - Tabbed Browsing (gmontagu)
      • Results: PASS - Results in Litmus
    • Search - Addons (gmontagu)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (abillings)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (abillings)
      • Results: PASS - Results in Litmus
  • Notes:

Linux

The BFT will be divided up in four sections.

  • Date: April 15 2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100413 Firefox/3.6.4
    • Installation - Tabbed Browsing (aravindm)
      • Results: PASS - Results in Litmus
    • Search - Addons (aravindm)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (aravindm)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (aravindm)
      • Results: PASS - Results in Litmus
  • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Status: RESULTS