MozillaWiki

QA/Firefox3/TestResults/RC2: Difference between revisions

Page Discussion

QA/Firefox3/TestResults/RC2 (view source)

Revision as of 23:33, 4 June 2008

2,297 bytes added ,  4 June 2008
m
→‎<FONT COLOR = "RED">Detailed Results </FONT>
 
(45 intermediate revisions by 9 users not shown)
Line 24: Line 24:
;Code Build: 5/29
;Code Build: 5/29
;QA test signoff: ETA 6/4
;QA test signoff: ETA 6/4
* Smoketests  '''result'''  
* Smoketests  '''PASS'''  
* BFTs '''result'''  
* BFTs '''PASS'''  
* RC2 and past focused Tests (ongoing) '''result'''   
* RC2 and past focused Tests (ongoing) '''PASS'''   
* Update snippets from Alpha X, Beta X -> RC2 ''betatest'', '''result''' ''releasetest'', '''result''', ''rc1->rc2 beta/release'', '''result'''  
* Update snippets from Alpha X, Beta X -> RC2 ''betatest'', '''PASS''' ''releasetest'', '''PASS''', ''rc1->rc2 beta/release'', '''result'''  
* P1 L10N spotchecks  '''result'''  
* P1 L10N spotchecks  '''PASS'''
* Top plugins '''PASS'''
* RC2+ bug verifications (ongoing)  '''result'''  
* RC2+ bug verifications (ongoing)  '''result'''  
* RC2 Testday '''result'''
* RC2 Testday '''PASS'''
* Release notes, Websites, live tests '''result'''
* Release notes, Websites, live tests '''result'''


Line 58: Line 59:


=== Linux ===
=== Linux ===
* Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0


== Test Coverage ==  
== Test Coverage ==  
Line 95: Line 97:
|-
|-
| Smoketest
| Smoketest
| Tomcat - ''''''PASS'''
| Tomcat - '''PASS'''
| juanb - '''PASS'''
| juanb - '''PASS'''
| Tracy - '''PASS'''
| Tracy - '''PASS'''
Line 102: Line 104:
|-
|-
| BFT
| BFT
| Tomcat - '''result'''  
| Tomcat - '''PASS'''  
| Juan - '''result'''
| Juan - '''PASS'''
| Hasham/Marcia - '''result'''
| Hasham/Marcia - '''PASS'''
| Tomcat - '''PASS''' Build 2 BFT in progress
| Tomcat - '''PASS''' Build 2 BFT '''PASS'''
| Tracy - '''result'''
| Tracy - '''PASS'''
|-
|-
| Updates Testing
| Updates Testing
| Tchung - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Tchung - Betatest '''PASS''', Releasetest '''PASS''', Beta '''result'''
| Juanb - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Juanb - Betatest '''PASS''', Releasetest '''PASS''', Beta '''result'''
| Stephend - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Tracy - Betatest '''PASS''', Releasetest '''PASS''', Beta '''result'''
| Marcia - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Marcia - Betatest '''PASS''', Releasetest '''PASS''', Beta '''result'''
| Abillings - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Abillings - Betatest '''PASS''', Releasetest '''PASS''', Beta '''result'''
|-
|-
| l10N Pri 1 locales
| l10N Pri 1 locales
Line 120: Line 122:
| Tchung - '''PASS'''
| Tchung - '''PASS'''
| N/A
| N/A
| Tchung - '''result'''
| Tchung - '''PASS'''
|-
|-
| Top Plugins
| Top Plugins
| Tchung - '''result'''   
| Hasham - '''PASS'''   
| N/A  
| N/A  
| Tracy - '''result'''
| Tracy - '''PASS'''
| N/A
| N/A
| Stephend - '''result'''
| Tchung - '''PASS'''
|-
|-
| Bug Verifications
| Bug Verifications
Line 138: Line 140:
| Live Checks & Download Links
| Live Checks & Download Links
| Tomcat - '''result'''
| Tomcat - '''result'''
| Stephend - '''result'''
| Juanb - '''result'''
| Tracy - '''result'''
| Marcia - '''result'''
| Marcia - '''result'''
| Juanb - '''result'''
| Abillings - '''result'''
| Abillings - '''result'''
|}
|}
Line 149: Line 151:
Will be available on ''betatest'', ''releasetest'', ''beta'', and ''release (rc1 only)'' channels
Will be available on ''betatest'', ''releasetest'', ''beta'', and ''release (rc1 only)'' channels


* Betatest channel - '''result'''
* Betatest channel - '''PASS'''
* Releasetest channel - '''result'''
* Releasetest channel - '''PASS'''
* Beta channel (live) - '''result'''
* Beta channel (live) - '''PASS'''
* Release channel (rc1 only) - '''result'''
* Release channel (rc1 only) - '''PASS'''


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC2/Updates here].
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC2/Updates here].
Line 161: Line 163:
Automation inspection: supported locales will be ran through Minotaur, and results will be reviewed by axel and mic.
Automation inspection: supported locales will be ran through Minotaur, and results will be reviewed by axel and mic.


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC2/L10N here] - '''result'''
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC2/L10N here] - '''PASS'''


=== Top Plugins Testing ===
=== Top Plugins Testing ===
Line 222: Line 224:
OS assignments:
OS assignments:
* XP - Tomcat - '''result'''
* XP - Tomcat - '''result'''
* Vista - Stephend - '''result'''
* Vista - Juanb - '''pass'''
* Mac Tiger - Marcia - '''result'''
* Mac Tiger - Tracy - '''PASS'''
* Mac Leopard - Juanb - '''result'''
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; it; rv:1.9) Gecko/2008053008 Firefox/3.0
* Linux - Abillings - '''result'''
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; da; rv:1.9) Gecko/2008053008 Firefox/3.0
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; sv-SE; rv:1.9) Gecko/2008053008 Firefox/3.0
* Mac Leopard - Marcia - '''result'''
* Linux - Abillings - '''PASS'''


= <FONT COLOR = "RED">Detailed Results </FONT> =
= <FONT COLOR = "RED">Detailed Results </FONT> =


===Smoketests===
===Smoketests===
* {{Bug|430737}} – Update snippets sometimes don't propagate to the entire cluster.  this happens in 2.x releases also.  This delayed our website release for almost 1 1/2 hours.


==== Tracy's Results ====
==== Tracy's Results ====
Line 237: Line 244:
* Linux (FC7) - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0
* Linux (FC7) - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0
* Status: '''PASS''' results in Litmus
* Status: '''PASS''' results in Litmus
**{{bug|436521}} loop in plugin finder service says Flash is installed when it isn't


==== marcia's Results ====
==== marcia's Results ====
Line 257: Line 262:


=== BFT ===
=== BFT ===
==== hasham/marcia  Results ====
*marcia: Mac 10.4 - Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9) Gecko/2008053008 Firefox/3.0 and Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008053008 Firefox/3.0
* Status: '''PASS'''
* New bugs filed during testing
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436935 Bug 436935] NS_ERROR_NOT_IMPLEMENTED in nsLoginManager
* Bugs Confirmed during testing
**[https://bugzilla.mozilla.org/show_bug.cgi?id=435863 Bug 435863] Custom global shortcuts in Mac OS X do not work correctly with Firefox.
* Bugs Seen during testing
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436497 Bug 436497] Google favicon needs to be updated.
**[https://bugzilla.mozilla.org/show_bug.cgi?id=435485 Bug 435485] Can't reliably use "Move" command in Organize Bookmarks


==== Tomcat's Results ====
==== Tomcat's Results ====


* Mac 10.5 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008052903 Firefox/3.0
* Mac 10.5 Build 1 - Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008052903 Firefox/3.0
* Status: '''PASS''' results in Litmus
* Status: '''PASS''' results in Litmus
* Confirmed [https://bugzilla.mozilla.org/show_bug.cgi?id=432832 Bug 432832] during the tests
* Confirmed [https://bugzilla.mozilla.org/show_bug.cgi?id=432832 Bug 432832] during the tests
* Mac 10.5 Build 2- Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008053008 Firefox/3.0
* Status: '''PASS''' results in Litmus
* Windows XP : Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0
* Status: '''PASS''' results in Litmus


==== juanb's restuls ====
==== juanb's restuls ====
* BFT on Vista: ''in progress''
* BFT on Vista: '''90%'''
** Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0
** Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0
* Notes:
* Notes:
====tracy's results====
* Linux (FC7) - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0
* Status: '''PASS''' results in Litmus
**{{bug|436521}} loop in plugin finder service says Flash is installed when it isn't


=== Accessibility testing ===
=== Accessibility testing ===
* Windows: Pass results in Litmus.
* Windows: Pass results in Litmus.
* Verified {{bug|434002}} using ChatZilla 0.9.82.1, which exposed this bug reliably for me.
* Linux: Pass with the exception of [https://litmus.mozilla.org/show_test.cgi?id=5391 testcase 5391] which is documented in {{bug|435179}}. Should be relnoted, nominated for fixing and inclusion in a 3.0.x release.
* Verified {{bug|434002}} using ChatZilla 0.9.82.1, which exposed this bug reliably for me previously.
 
=== L10n Testing (tchung) ===


=== L10n Testing ===
* Filed {{bug|436589}} – Search plugin order differs on Linux / Windows versus Mac.
Tchung
* Filed bug 436589 – Search plugin order differs on Linux / Windows versus Mac.


= Hendrix Feedback ==
= Hendrix Feedback ==
Line 282: Line 313:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436356 Bug 436356] Bullet lists does not display correctly, works in FF 2  
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436356 Bug 436356] Bullet lists does not display correctly, works in FF 2  
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436139 Bug 436139] Top part of website renders too high
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436139 Bug 436139] Top part of website renders too high
**[https://bugzilla.mozilla.org/show_bug.cgi?id=437115 Bug 437115] Site lays out properly using FF 2 but not FF3
*Bugs with a lot of comments in hendrix
**[https://bugzilla.mozilla.org/show_bug.cgi?id=436686 Bug 436686] On occasion Flash video will start with no sound, then stop after 2-3 seconds
Tchung
Confirmed users
6,361

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/94900...95600"