Releases/Firefox 4b11/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(41 intermediate revisions by 10 users not shown)
Line 2: Line 2:


= Firefox 4 Beta 11 Smoketest and BFT Results =
= Firefox 4 Beta 11 Smoketest and BFT Results =
'''Build IDs''' - build 3
* Windows: 20110203141415
* OS X (32bit): 20110203140743
* OS X (64bit): 20110203140743
* Linux (32bit): 20110203140750
* Linux (64bit): 20110203141146


'''Build IDs''' - build 2
'''Build IDs''' - build 2
Line 17: Line 24:
* If you file a new bug, please enter '''[4b11]''' in the Whiteboard field
* If you file a new bug, please enter '''[4b11]''' in the Whiteboard field


== Windows XP (tester) ==
== Windows XP (Andrei) ==
* Date:  
* Date: 2/3/2011
* Build ID:  
* Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c569d0 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c58ec1 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Notes:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cbcca Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293ceefa Results]
* Status: '''PASS''' in Litmus (Manual)
** Notes: No new issues found during manual testing


== Windows 7 (tester) ==
== Windows 7 (vlad) ==
* Date:  
* Date: 2/3/2011
* Build ID:  
* Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c578b2 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c59060 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cd459 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293d0a12 Results]
* Status: '''PASS''' in Litmus (Manual)
** Notes:
** Notes:
*** No new issues found during manual testing


== Windows Vista (tester)  ==
== Windows Vista (vlad)  ==
* Date:  
* Date: 2/3/2011
* Build ID:  
* Build ID: Mozilla/5.0 (Windows NT 6.0; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c57ac8 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c596c3 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Notes:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cb738 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cfad0 Results]
* Status: '''PASS''' in Litmus (Manual)
** Notes: No new issues found during manual testing


== Mac OS X 10.5 (tester) ==
== Mac OS X 10.5 (teodosia) ==
* Date:  
* Date: 2/3/11
* Build ID:  
* Build ID: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c5bc14 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c5c298 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Notes:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129478112 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51294cb608 Results]
* Status: '''PASS''' in Litmus (Manual)
** Notes: No issues found


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.6 (alex) ==
* Date:  
* Date: 02-03-2011
* Build ID:  
* Build ID: Build identifier: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Mozmill '''PASS''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cc8aa results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c5a0be Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293d1556 results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c5aef0 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Notes:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cc8aa Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293d1556 Results]
* Status: '''PASS''' (build 2) in Litmus (Manual)
** Notes: No new issues were found


== Linux (tester) ==
== Linux (George) ==
* Date:  
* Date: 3 Feb 2011
* Build ID:  
* Build ID: 20110202143540
* Mozmil: '''PASS''' - build 2 results
* Mozmil: '''PASS''' - build 3 results
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51290540dd Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129bb3f73 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129054ae6 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129bb4f9d Results]
* Mozmill '''PASS''' (known test failures) - build 1 results
* Mozmill '''PASS''' (known test failures) - build 1 results
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050101 Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050101 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050bcc Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050bcc Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Manual Testing '''Passed''' in Litmus


= BFT's Windows XP (automation) =
= BFT's Windows XP (manual and automation) =
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=260 Click] to run the BFT  
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=260 Click] to run the BFT  
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=260 BFT Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=260 BFT Report]
Line 80: Line 103:
The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.
The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.


= BFT's Mac 10.5 (manual testing - teodosia) =
* Date: 2/3/2011
* Build ID: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Results: '''PASS''' in Litmus
** Notes: No new issues found
= BFT's Windows 7 (manual - vlad) =
* Date: 2/3/2011
* Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Results: '''PASS''' in Litmus
** Notes: No new issues found
= BFT's Mac OS X 10.6 (manual - alex) =
* Date: 02-03-2011
* Build ID:  Build identifier: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Results: '''PASS''' in Litmus
** Notes: No new issues found
= BFT's Ubuntu Linux 10.04 32bit (manual - George) =
* Date: 02-03-2011
* Build ID:  Mozilla/5.0 (X11; Linux i686; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Results: '''PASS''' in Litmus
** Notes: No new issues found
= BFT's Windows XP (manual - Andrei) =
* Date: 02-03-2011
* Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
* Results: '''PASS''' in Litmus
** Notes: No new issues found


= Other OS Spot Checks =
= Other OS Spot Checks =


== Windows 2000 -spotcheck only- (tester) ==
== Windows 2000 -spotcheck only- (juanb) ==
* Date:  
* Date: 2/03
* Build ID:  
* Build ID:  
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (build 3)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c55dad Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129c58984 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Mozmill '''PASS''' (build 1)
** Notes:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293ca8fc Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb51293cdb20 Results]
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes: Went through common user functionality and found no major problems.


== Linux 64bit -spotcheck only- (tester) ==
== Linux 64bit -spotcheck only- (juanb) ==
* Date:  
* Date:  
* Build ID:  
* Build ID:  
* Mozmil: '''result''' - build 2 results
* Mozmill: '''PASS''' - build 3 results
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129bb4832 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/00edfccff35537bd5dcddb5129bb5f36 Results]
* Mozmill '''PASS''' (known test failures) - build 1 results
* Mozmill '''PASS''' (known test failures) - build 1 results
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050569 Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050569 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050c45 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/1e1976614f18204afcd577ed5c050c45 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Went through a quick spot check on a hardware machine with Ubuntu; I tried gmail, youtube, yahoo, lolcats, gtalk; played several videos in youtube and yahoo, including fullscreen mode and tried private browsing. No problems noticed.

Latest revision as of 19:02, 4 February 2011

4.0 Beta 11 Test Plan

Firefox 4 Beta 11 Smoketest and BFT Results

Build IDs - build 3

  • Windows: 20110203141415
  • OS X (32bit): 20110203140743
  • OS X (64bit): 20110203140743
  • Linux (32bit): 20110203140750
  • Linux (64bit): 20110203141146

Build IDs - build 2

  • Windows: 20110202143949
  • OS X (32bit):
  • OS X (64bit):
  • Linux (32bit): 20110202143540
  • Linux (64bit): 20110202151324

Smoketests for Build 2

Windows XP (Andrei)

  • Date: 2/3/2011
  • Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS in Litmus (Manual)
    • Notes: No new issues found during manual testing

Windows 7 (vlad)

  • Date: 2/3/2011
  • Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS in Litmus (Manual)
    • Notes:
      • No new issues found during manual testing

Windows Vista (vlad)

  • Date: 2/3/2011
  • Build ID: Mozilla/5.0 (Windows NT 6.0; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS in Litmus (Manual)
    • Notes: No new issues found during manual testing

Mac OS X 10.5 (teodosia)

  • Date: 2/3/11
  • Build ID: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS in Litmus (Manual)
    • Notes: No issues found

Mac OS X 10.6 (alex)

  • Date: 02-03-2011
  • Build ID: Build identifier: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS (build 2) in Litmus (Manual)
    • Notes: No new issues were found

Linux (George)

  • Date: 3 Feb 2011
  • Build ID: 20110202143540
  • Mozmil: PASS - build 3 results
  • Mozmill PASS (known test failures) - build 1 results
  • Status: result in Litmus (Mozmill and Manual)
    • Notes: Manual Testing Passed in Litmus

BFT's Windows XP (manual and automation)

The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.


BFT's Mac 10.5 (manual testing - teodosia)

  • Date: 2/3/2011
  • Build ID: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Results: PASS in Litmus
    • Notes: No new issues found

BFT's Windows 7 (manual - vlad)

  • Date: 2/3/2011
  • Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Results: PASS in Litmus
    • Notes: No new issues found

BFT's Mac OS X 10.6 (manual - alex)

  • Date: 02-03-2011
  • Build ID: Build identifier: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Results: PASS in Litmus
    • Notes: No new issues found

BFT's Ubuntu Linux 10.04 32bit (manual - George)

  • Date: 02-03-2011
  • Build ID: Mozilla/5.0 (X11; Linux i686; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Results: PASS in Litmus
    • Notes: No new issues found

BFT's Windows XP (manual - Andrei)

  • Date: 02-03-2011
  • Build ID: Mozilla/5.0 (Windows NT 6.1; rv:2.0b11) Gecko/20100101 Firefox/4.0b11
  • Results: PASS in Litmus
    • Notes: No new issues found

Other OS Spot Checks

Windows 2000 -spotcheck only- (juanb)

  • Date: 2/03
  • Build ID:
  • Mozmill PASS (build 3)
  • Mozmill PASS (build 1)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: Went through common user functionality and found no major problems.

Linux 64bit -spotcheck only- (juanb)

  • Date:
  • Build ID:
  • Mozmill: PASS - build 3 results
  • Mozmill PASS (known test failures) - build 1 results
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: Went through a quick spot check on a hardware machine with Ubuntu; I tried gmail, youtube, yahoo, lolcats, gtalk; played several videos in youtube and yahoo, including fullscreen mode and tried private browsing. No problems noticed.