MozillaWiki

QA/Firefox3.5/TestPlan/Beta1: Difference between revisions

Page Discussion

QA/Firefox3.5/TestPlan/Beta1 (view source)

Revision as of 03:45, 24 March 2009

4,348 bytes added ,  24 March 2009
m
QA/Firefox3.1/TestPlan/Beta1 moved to QA/Firefox3.5/TestPlan/Beta1
 
(69 intermediate revisions by 7 users not shown)
Line 7: Line 7:
== Related Pages ==
== Related Pages ==
[http://wiki.mozilla.org/Firefox3.1 Firefox 3.1 Tracking Site]
[http://wiki.mozilla.org/Firefox3.1 Firefox 3.1 Tracking Site]
* [https://wiki.mozilla.org/Firefox3.1/StatusMeetings/2008-08-05 Beta 1 features]
* [https://wiki.mozilla.org/Firefox3.1/Features Beta 1 features]


== Contact Info ==  
== Contact Info ==  
Line 15: Line 15:


== Schedule ==  
== Schedule ==  
;Builds hand to QA: ETA
;Code Freeze: 9/30


;QA test signoff: ETA
;Builds hand to QA: 10/8
 
;QA test signoff: 10/14
* Smoketests
* BFTs
* BFTs
* Smoketests
* L10n
* L10n
* Updates
* Spotchecks
* Spotchecks


== Build Location and IDs ==
== Build Location and IDs ==


Download:
* http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1
* ftp://ftp.mozilla.org/pub/firefox/nightly/3.1b1-candidates/build1/
Builds:
* Windows
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
*** 20081007144708
* Mac
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1 (Full Build ID is: 20081007125523)
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
* Linux: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1


== Test Coverage ==  
== Test Coverage ==  
* Areas Covered:
* Areas Covered:
** Smoketests
** BFTs
** BFTs
** Smoketests
** L10n
** L10n
** Spotchecks
** Updates
** Spotchecks & Webpages
** Bug Fixes


* Areas Not Covered:
* Areas Not Covered:
** FFTs
** FFTs
** Updates
** Topsites
** Accessibility


== Test Results ==
== Test Results ==
Line 46: Line 66:
|-
|-
| Smoketests
| Smoketests
| Tester - '''result'''
| juanb - '''PASS'''
| Tester - '''result'''
| marcia - '''PASS'''
| Tester - '''result'''
| tomcat - '''PASS'''
|-
| Spotchecks
| Tester - '''result'''
| Tester - '''result'''
| Tester - '''result'''
|-
|-
| BFTs
| BFTs
| Tester - '''result'''
| tracy - '''FAIL'''
| Tester - '''result'''
| marcia - '''PASS'''
| Tester - '''result'''
| Joel - '''PASS'''
|-
|-
| L10n
| L10n
| Tester - '''result'''
| Tony - '''PASS'''
| Tester - '''result'''
| Tony - '''PASS'''
| Tester - '''result'''
| Tony - '''PASS'''
|-
| Updates
| tracy <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''
| Tony <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''
| Tony / (Tomcat for beta) <BR> '''Betatest - PASS''' <BR> '''releasetest - PASS''' <BR> '''Beta - result'''
|-
| Live Spotchecks & Webpages
| juanb - '''Pass'''
| marcia - '''result'''
| Tomcat - '''result'''
|}
|}


=== Smoketest Testing ===
=== Smoketest Testing ===
Lite verification tests (or smoketests) will be first ran when the builds are ready.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  Please record your detailed results in the section [below].  In any case the Smoketests fail, we will raise blockers asap before proceeding with the bfts.
Lite verification tests (or smoketests) will be first ran when the builds are ready.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  In any case the Smoketests fail, we will raise blockers asap before proceeding with the bfts.
 
Please record your detailed results in the section [https://wiki.mozilla.org/QA/Firefox3.1/TestPlan/Beta1#Smoketests_Results below].


=== BFT Testing ===
=== BFT Testing ===
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests pass.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].  Please record your detailed results in the section [below].  
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests pass.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=31 Firefox 3.1 test suite].   
 
Please record your detailed results in the section [https://wiki.mozilla.org/QA/Firefox3.1/TestPlan/Beta1#BFT_Results below].


=== Updates Testing ===
=== Updates Testing ===
We will be doing updates of all Alpha users to Beta1.  We will be checking partial updates, complete updates, and failover scenarios.   
We will be doing updates of all Alpha users to Beta1.  We will be checking complete updates, and failover scenarios.   
 
Will be available on ''betatest'', ''releasetest'', ''beta'', and ''release (rc1 only)'' channels


* Betatest channel - '''result'''
Will be available on ''betatest'', ''releasetest'', and ''beta'' channels.
* Releasetest channel - '''result'''
* Beta channel (live) - '''result'''
<del>* Release channel (rc1 only) - '''result'''</del>


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/Updates here].
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/Updates here].


=== L10N P1 Spotchecks ===
=== L10N ===
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here] - '''Result'''
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3.1/TestResults/beta1/L10N here]
 
* {{Bug|459156}} - BLOCKER :zhCN beta 1 builds show different search plugins per OS filed.  A respin of zhCN only will be made on 3 platforms.
** '''Update''' - Issue fixed on respin.


=== Live Spotchecks & Webpages ===


=== Testday ===
1) Verify the following webpages that gets pushed to staging and then to the live sites.   Look for content messaging, spelling mistakes, broken links & imnages, etc..
A Beta1 testday will be held and call for the community support to assist with testing. Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented.  More can be found on [http://quality.mozilla.org/events/test-days QMO].


* Firstrun page
* Whatsnew Page
* Releasenotes page


=== Live Spot Checks ===
2) Check live site download links on all platforms.  Please cover en-US, and 2 or 3 additional Tier 1 locales as well.  Pay attention to the following areas:
Check live site download links on all platforms.  Please cover en-US, and 2 or 3 additional Tier 1 locales as well.  Pay attention to the following areas:
* Check for signed installer and applications (windows only)
* Check for signed installer and applications (windows only)
* Firstrun page, whatsnew page, Home page, Search plugin
* Firstrun page, whatsnew page, Home page, Search plugin
Line 101: Line 130:
* General spotchecks and browser functionality
* General spotchecks and browser functionality
* Confirm Build IDs
* Confirm Build IDs


=== Fixed Bugs Verifications ===
=== Fixed Bugs Verifications ===
The following bugs are fixed for Beta 1 and need verifications:
The following bugs are fixed for Beta 1 and need verifications:
* Platform 1.9.1 bugs: http://tinyurl.com/4c4qwb
* Platform 1.9.1 bugs: http://tinyurl.com/4c4qwb
* Firefox 3.1 bugs: http://tinyurl.com/3tw7zw
* Firefox 3.1 bugs: http://tinyurl.com/3tw7zw
=== Testday ===
A Beta1 testday will be held and call for the community support to assist with testing.  Activities include executing litmus testcases, bug verifications, and focus on the new feature areas that are being implemented.  More can be found on [http://quality.mozilla.org/events/test-days QMO].


= <FONT COLOR = "RED">Detailed Results </FONT> =
= <FONT COLOR = "RED">Detailed Results </FONT> =
== Smoketests Results ==
== Smoketests Results ==
=== Mac [] ===
=== Windows XP [juanb] ===
* Windows XP SP3 (vm)
* Smoketests Results in Litmus - PASS
* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
** 20081007144708
** {{Bug|459082}} - (filed) migration wizard not coming up
** {{Bug|458579}} - (existing) Feed tab missing in page info


=== Linux []===
=== Mac [marcia] ===


=== Windows XP [] ===
*10.5 Results, PASS, results in Litmus
**Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
**Bugs Filed
***[https://bugzilla.mozilla.org/show_bug.cgi?id=458968 Bug 458968] - Firefox Mac Beta 1 candidate build is branded "Minefield"
 
=== Linux [tomcat on Fedora F9]===
* PASS - Results in Litmus
** Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1


== BFT Results ==
== BFT Results ==
=== Windows XP [tracy] ===
* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1 (20081007144708)
Failed form manager test case at www.google.com. Filed {{bug|459399}}
also seeing:
{{bug|459157}} Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
=== Mac [marcia] ===
*Intel Mac 10.5, PASS, results in Litmus
*Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
*New Bugs Filed:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459411 Bug 459111] Crash in [@ nsNavHistoryResult::OnClearHistory() ] when deleting individual history entry
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459157 Bug 459157] Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459256 Bug 459256] Error: [Exception... "'Error: %82' when calling method: [nsIDOMEventListener::handleEvent]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=459406 Bug 459406] "Save" button in query search is misaligned
*Existing Bugs Seen:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=428602 Bug 428602]
=== Linux [jmaher]===
* Ubuntu 8.04 (vm) - FAIL
* Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1) Gecko/20081007 Firefox/3.1b1
* Bugs
**New:
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459282|| bug 459282]] session restore dialog appears after a system reboot when it shouldn't
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459289|| bug 459289]] when firefox abnormally terminates and a download is active, it continues to download if you start a new session
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=459108|| bug 459108]] doing an auto search from the location bar doesn't work for numbers
**Existing:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=459157|| Bug 459157]] Exception in (NS_ERROR_INVALID_POINTER) [nsIPermissionManager.add] failure blocking images from Page Info
***[[https://bugzilla.mozilla.org/show_bug.cgi?id=374189|| bug 374189]]  [Linux/SunOS] Ctrl+Y for "Downloads" doesn't work when focus is in a textbox (conflicts with "Redo")
[[Category:Shiretoko beta|1]]
Samuelsidler
1,457

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/111285...135711"