MozillaWiki

QA/Firefox3.5/TestPlan/Beta1: Difference between revisions

Page Discussion

QA/Firefox3.5/TestPlan/Beta1 (view source)

Revision as of 03:45, 24 March 2009

4,067 bytes added ,  24 March 2009
m
QA/Firefox3.1/TestPlan/Beta1 moved to QA/Firefox3.5/TestPlan/Beta1
 
(66 intermediate revisions by 7 users not shown)
Line 7: Line 7:
== Related Pages ==
== Related Pages ==
[http://wiki.mozilla.org/Firefox3.1 Firefox 3.1 Tracking Site]
[http://wiki.mozilla.org/Firefox3.1 Firefox 3.1 Tracking Site]
* [https://wiki.mozilla.org/Firefox3.1/StatusMeetings/2008-08-05 Beta 1 features]
* [https://wiki.mozilla.org/Firefox3.1/Features Beta 1 features]


== Contact Info ==  
== Contact Info ==  
Line 15: Line 15:


== Schedule ==  
== Schedule ==  
;Builds hand to QA: ETA
;Code Freeze: 9/30


;QA test signoff: ETA
;Builds hand to QA: 10/8
 
;QA test signoff: 10/14
* Smoketests
* BFTs
* BFTs
* Smoketests
* L10n
* L10n
* Updates
* Spotchecks
* Spotchecks


== Build Location and IDs ==
== Build Location and IDs ==


Download:
* http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1
* ftp://ftp.mozilla.org/pub/firefox/nightly/3.1b1-candidates/build1/
Builds:
* Windows
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
*** 20081007144708
* Mac
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1 (Full Build ID is: 20081007125523)
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
* Linux: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1


== Test Coverage ==  
== Test Coverage ==  
Line 33: Line 50:
** Updates
** Updates
** Spotchecks & Webpages
** Spotchecks & Webpages
** Bug Fixes


* Areas Not Covered:
* Areas Not Covered:
Line 48: Line 66:
|-
|-
| Smoketests
| Smoketests
| Tester - '''result'''
| juanb - '''PASS'''
| Tester - '''result'''
| marcia - '''PASS'''
| Tester - '''result'''
| tomcat - '''PASS'''
|-
|-
| BFTs
| BFTs
| Tester - '''result'''
| tracy - '''FAIL'''
| Tester - '''result'''
| marcia - '''PASS'''
| Tester - '''result'''
| Joel - '''PASS'''
|-
|-
| L10n
| L10n
| Tester - '''result'''
| Tony - '''PASS'''
| Tester - '''result'''
| Tony - '''PASS'''
| Tester - '''result'''
| Tony - '''PASS'''
|-
|-
| Updates
| Updates
| Tester <BR> '''Betatest - result''' <BR> '''Beta - result'''
| tracy <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''  
| Tester <BR> '''Betatest - result''' <BR> '''Beta - result'''
| Tony <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''  
| Tester <BR> '''Betatest - result''' <BR> '''Beta - result'''
| Tony / (Tomcat for beta) <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''
|-
|-
| Live Spotchecks & Webpages
| Live Spotchecks & Webpages
| Tester - '''result'''
| juanb - '''Pass'''
| Tester - '''result'''
| marcia - '''result'''
| Tester - '''result'''
| Tomcat - '''result'''
|}
|}


=== Smoketest Testing ===
=== Smoketest Testing ===
Lite verification tests (or smoketests) will be first ran when the builds are ready.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  Please record your detailed results in the section [below].  In any case the Smoketests fail, we will raise blockers asap before proceeding with the bfts.
Lite verification tests (or smoketests) will be first ran when the builds are ready.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  In any case the Smoketests fail, we will raise blockers asap before proceeding with the bfts.
 
Please record your detailed results in the section [https://wiki.mozilla.org/QA/Firefox3.1/TestPlan/Beta1#Smoketests_Results below].


=== BFT Testing ===
=== BFT Testing ===
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests pass.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  Please record your detailed results in the section [below].  
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests pass.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].   
 
Please record your detailed results in the section [https://wiki.mozilla.org/QA/Firefox3.1/TestPlan/Beta1#BFT_Results below].


=== Updates Testing ===
=== Updates Testing ===
We will be doing updates of all Alpha users to Beta1.  We will be checking partial updates, complete updates, and failover scenarios.   
We will be doing updates of all Alpha users to Beta1.  We will be checking complete updates, and failover scenarios.   


Will be available on ''betatest'', ''releasetest'', and ''beta'' channels.
Will be available on ''betatest'', ''releasetest'', and ''beta'' channels.
Line 89: Line 111:
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here]  
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here]
 
* {{Bug|459156}} - BLOCKER :zhCN beta 1 builds show different search plugins per OS filed.  A respin of zhCN only will be made on 3 platforms.
** '''Update''' - Issue fixed on respin.


=== Live Spotchecks & Webpages ===
=== Live Spotchecks & Webpages ===
Line 116: Line 141:
= <FONT COLOR = "RED">Detailed Results </FONT> =
= <FONT COLOR = "RED">Detailed Results </FONT> =
== Smoketests Results ==
== Smoketests Results ==
=== Mac [] ===
=== Windows XP [juanb] ===
* Windows XP SP3 (vm)
* Smoketests Results in Litmus - PASS
* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
** 20081007144708
** {{Bug|459082}} - (filed) migration wizard not coming up
** {{Bug|458579}} - (existing) Feed tab missing in page info


=== Linux []===
=== Mac [marcia] ===


=== Windows XP [] ===
*10.5 Results, PASS, results in Litmus
**Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
**Bugs Filed
***[https://bugzilla.mozilla.org/show_bug.cgi?id=458968 Bug 458968] - Firefox Mac Beta 1 candidate build is branded "Minefield"
 
=== Linux [tomcat on Fedora F9]===
* PASS - Results in Litmus
** Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1


== BFT Results ==
== BFT Results ==
=== Windows XP [tracy] ===
* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1 (20081007144708)
Failed form manager test case at www.google.com. Filed {{bug|459399}}
also seeing:
{{bug|459157}} Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
=== Mac [marcia] ===
*Intel Mac 10.5, PASS, results in Litmus
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
*New Bugs Filed:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459411 Bug 459111] Crash in [@ nsNavHistoryResult::OnClearHistory() ] when deleting individual history entry
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459157 Bug 459157] Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459256 Bug 459256] Error: [Exception... "'Error: %82' when calling method: [nsIDOMEventListener::handleEvent]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459406 Bug 459406] "Save" button in query search is misaligned
*Existing Bugs Seen:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=428602 Bug 428602]
=== Linux [jmaher]===
* Ubuntu 8.04 (vm) - FAIL
* Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
* Bugs
**New:
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459282|| bug 459282]] session restore dialog appears after a system reboot when it shouldn't
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459289|| bug 459289]] when firefox abnormally terminates and a download is active, it continues to download if you start a new session
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459108|| bug 459108]] doing an auto search from the location bar doesn't work for numbers
**Existing:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=459157|| Bug 459157]] Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=374189|| bug 374189]]  [Linux/SunOS] Ctrl+Y for "Downloads" doesn't work when focus is in a textbox (conflicts with "Redo")
[[Category:Shiretoko beta|1]]
Samuelsidler
1,457

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/111289...135711"