QA/Firefox3.5/TestPlan/Alpha1: Difference between revisions

m
 
(40 intermediate revisions by 5 users not shown)
Line 18: Line 18:


;QA test signoff: ETA 7/25
;QA test signoff: ETA 7/25
* Smoketests '''result'''
* Smoketests '''PASS'''
* Spotchecks '''result'''
* Spotchecks '''PASS'''


== Build Location and IDs ==
== Build Location and IDs ==


===Build 1===
*http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
*http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
===Build 2 (mac respin only)===
*ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1


== Test Coverage ==  
== Test Coverage ==  
Line 49: Line 57:
|-
|-
| Smoketests
| Smoketests
| Hasham - '''result'''
| Hasham - '''PASS'''
| Marcia - '''PASS'''
| Marcia - '''PASS'''
| Hasham - '''result'''
| Hasham - '''PASS'''
|-
|-
| Spotchecks
| Spotchecks
| Hasham - '''result'''
| Hasham - '''PASS'''
| Marcia - '''result'''
| Marcia - '''PASS'''
| Hasham - '''result'''
| Hasham - '''PASS'''
|}
|}


Line 67: Line 75:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=447644 Bug 447644]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=447644 Bug 447644]
*Bugs Hit during testing
*Bugs Hit during testing
**[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit
**[https://bugzilla.mozilla.org/show_bug.cgi?id=444963 Bug 444963] - Sites with java applets freeze the browser and require a force quit '''Pending blocker review'''
*Themes were not tested due to the fact no themes were compatible
*Themes were not tested due to the fact no themes were compatible
'''Testing of Build 2 [marcia] '''
*Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
*Bugs Filed
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448023 Bug 448203]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=448031 Bug 448031]


====Linux [hasham]====
====Linux [hasham]====
*[https://bugzilla.mozilla.org/show_bug.cgi?id=447690 Bug 447690] - Rendering issue with Litmus on 3.1
 
* '''PASS'''
* Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
* Bugs Filed -
** [https://bugzilla.mozilla.org/show_bug.cgi?id=447690 Bug 447690] - Rendering issue with Litmus on 3.1 [http://i37.tinypic.com/29cp7pd.jpg SCREENSHOT]
* Bugs Come Across -
** [https://bugzilla.mozilla.org/show_bug.cgi?id=447699 Bug 447699] To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)


====Windows XP [hasham]====
====Windows XP [hasham]====
*'''PASS'''
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
* Bugs Come Across -
** [https://bugzilla.mozilla.org/show_bug.cgi?id=447699 Bug 447699] To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)


=== Spotcheck Results ===
=== Spotcheck Results ===


Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken.  Test a few extensions and plugins to make sure web compatibility looks good.
Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken.  Test a few extensions and plugins to make sure web compatibility looks good.
====Spotchecks on 10.4/10.5 [marcia] ====
*Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
*Tested the Alexa Top 10 Global Sites - PASS
*Tested Installing Certificates - PASS
*Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
====Verifying Signing on XP [Hasham] ====
*'''PASS'''
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
====Verifying Signing on Vista [marcia]====
*'''PASS'''
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Checked updater, crash reporter, app and several dlls and all were signed
====Verify Crash Reporter fires====
*Install Crash Reporter xpi and verify Crash Reporter fires
**XP - Hasham - '''PASS'''
**Vista - marcia
**'''PASS''' using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
**Mac - marcia
** '''PASS''' using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
**Linux - Tomcat
** using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
====Spot Checks of Live Builds====
*Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match
[[Category:Shiretoko Alpha|1]]
1,457

edits