QA/Firefox3/TestResults/RC1: Difference between revisions

Jump to navigation Jump to search
m
 
(34 intermediate revisions by 5 users not shown)
Line 25: Line 25:
;QA test signoff: ETA 5/26
;QA test signoff: ETA 5/26
* Smoketests  '''PASS'''  
* Smoketests  '''PASS'''  
* FFTs '''about 60% completed overall'''  
* FFTs '''PASS'''  
* RC1 and past focused Tests (ongoing) '''result'''   
* RC1 and past focused Tests (ongoing) '''PASS'''   
* Top Sites Testing '''66% Completed'''  
* Top Sites Testing '''PASS'''  
* Top Site Automation Pass (spidertests) '''result'''
* Top Site Automation Pass (spidertests) '''60% completed'''
* Top Extensions Testing '''PASS'''  
* Top Extensions Testing '''PASS'''  
* Top Themes Testing '''33% Completed'''  
* Top Themes Testing '''PASS'''  
* Top Plugins Testing '''75% Completed'''  
* Top Plugins Testing '''PASS'''  
* Update snippets from Alpha X, Beta X -> RC1  '''PASS'' betatest'', PASS ''releasetest'', PASS ''beta'''''  
* Update snippets from Alpha X, Beta X -> RC1  '''PASS'' betatest'', PASS ''releasetest'', PASS ''beta'''''  
* P1 L10N spotchecks  '''PASS'''  
* P1 L10N spotchecks  '''PASS'''  
* Accessibility Testing '''PASS'''
* Accessibility Testing '''PASS'''
* All P1/P2 bug verifications (ongoing)  '''PASS'''  
* All P1/P2 bug verifications (ongoing)  '''PASS'''  
* RC1 Testday '''PASS part 1'''  
* Testday
** '''5/16 - PASS part 1'''
** '''5/23 - PASS part 2'''
* Release notes, Websites, live tests '''PASS rc1'''
* Release notes, Websites, live tests '''PASS rc1'''


Line 46: Line 48:
=== Windows ===
=== Windows ===
* ftp://ftp.mozilla.org/pub/firefox/nightly/3.0rc1-candidates
* ftp://ftp.mozilla.org/pub/firefox/nightly/3.0rc1-candidates
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0 ID:2008051206 (XP)
** Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0 (XP)
**  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0 (VISTA)
**  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0 (VISTA)


Line 102: Line 104:
|-
|-
| BFT/FFT
| BFT/FFT
| Tomcat - '''PASS''', FFT - '''54% completed'''  
| Tomcat - '''PASS''', FFT - '''PASS'''  
| Tomcat BFT - '''PASS''', FFT - '''74% completed'''
| Tomcat BFT - '''PASS''', FFT - '''PASS'''
| Tracy - BFT-'''PASS''', Juan - FFT - '''40% completed'''
| Tracy - BFT-'''PASS''', Juan - FFT - '''PASS'''
| Marcia/juanb (Leopard test suite/PPC and Intel) BFT-'''PASS''', (Marcia/Stephend) FFT-'''68% completed'''   
| Marcia/juanb (Leopard test suite/PPC and Intel) BFT-'''PASS''', (Marcia/Stephend) FFT-'''PASS'''   
| Tracy/Abillings - BFT-'''PASS''', FFT - '''64% completed'''
| Tracy/Abillings - BFT-'''PASS''', FFT - '''PASS'''
|-
|-
| Updates Testing (see below)
| Updates Testing (see below)
Line 116: Line 118:
|-
|-
| Top Sites
| Top Sites
| Tchung - '''result'''   
| Tchung - '''PASS'''   
| N/A  
| N/A  
| Tracy - '''PASS'''
| Tracy - '''PASS'''
Line 132: Line 134:
| Marcia - '''result'''   
| Marcia - '''result'''   
| N/A  
| N/A  
| Tracy - '''result'''
| Tracy - '''PASS'''
| N/A
| Tomcat- '''in progress'''
| Abillings - '''PASS'''
| Abillings - '''PASS'''
|-
|-
Line 413: Line 415:
*** Build ID:  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0  
*** Build ID:  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0  
*** '''PASS'' - Was running into a known topcrash, but could provide the places.sqlite file to dietrich
*** '''PASS'' - Was running into a known topcrash, but could provide the places.sqlite file to dietrich
* FFT's
** Windows Vista
*** Build ID:  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0
*** '''PASS'''
* FFT
** Windows XP
*** Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008051206 Firefox/3.0 ID:2008051206
*** '''PASS'''


* Bugs filed
* Bugs filed
Line 464: Line 476:
** Status: '''in progress'''
** Status: '''in progress'''
** New Bugs Filed:
** New Bugs Filed:
***Crash Bugs
****[https://bugzilla.mozilla.org/show_bug.cgi?id=435521 Bug 435521]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=433605 Bug 433605]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=433605 Bug 433605]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=434765 Bug 434765]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=434765 Bug 434765]
Line 470: Line 484:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=435047 Bug 435047] 100% Reproducible crash
***[https://bugzilla.mozilla.org/show_bug.cgi?id=435047 Bug 435047] 100% Reproducible crash
***[https://bugzilla.mozilla.org/show_bug.cgi?id=435282 Bug 435282]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=435282 Bug 435282]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=435463 Bug 435463]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=434872 Bug 434872]


**Top Crashes seen during testing
**Top Crashes seen during testing
Line 478: Line 494:
***[https://bugzilla.mozilla.org/show_bug.cgi?id=324334 Bug 324334]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=324334 Bug 324334]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=426953 Bug 426953]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=426953 Bug 426953]
***[https://bugzilla.mozilla.org/show_bug.cgi?id=400227 Bug 400227] I nominated this bug since it apparently fell off the radar sometime in late 2007.


** PPC vs. Intel
** PPC vs. Intel
Line 486: Line 503:
* Full Functial Tests (FFTs) on '''Fx3rc1 Mac 10.4.11'''
* Full Functial Tests (FFTs) on '''Fx3rc1 Mac 10.4.11'''
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008051202 Firefox/3.0
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008051202 Firefox/3.0
** Status: '''in progress 40%, as of Fri, 23, @10:30am'''
** Status: '''Complete for all Mac applicable test cases (93%) as of Monday 26 @6:40pm'''
** Bugs found during FFT:
*** {{Bug|434624}} - safe browsing file not updated on first launch
*** {{Bug|434832}} - remove scroll bars from import wizard
*** {{Bug|434851}} - importing data from opera fails
*** {{Bug|434869}} - data not migrated from Seamonkey
*** {{Bug|434916}} - findbar "not found" sound causes crash
*** {{Bug|434947}} - redirect urls appear in location bar autocomplete
*** {{Bug|434951}} - tags not shown in autocomplete if title...
*** {{Bug|435287}} - scroll wheel scrolling does not switch search engines
*** {{Bug|435340}} - sidebar and bookmarks library behave differently
*** {{Bug|435470}} - switch in feed prefs not reflected in feed UI page
*** {{Bug|435485}} - organize tool should be disabled when selecting left pane..
*** {{Bug|435799}} - download does not resume where it left off
 
===Tracy's results===
* Linux
** Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008051202 Firefox/3.0
** Status: '''PASS''' - results in Litmus


== Hendrix Feedback ==
== Hendrix Feedback ==
Line 494: Line 529:
**Complaints from Windows users that youtube and other video content only plays for 2-3 seconds. Complaints come from both XP and Vista users.
**Complaints from Windows users that youtube and other video content only plays for 2-3 seconds. Complaints come from both XP and Vista users.
**I installed Flash but it does not work (This is likely the server side bug that is open - when PFS finds the missing flash plugin it goes out and get it and seemingly installs it, but actually doesn't)
**I installed Flash but it does not work (This is likely the server side bug that is open - when PFS finds the missing flash plugin it goes out and get it and seemingly installs it, but actually doesn't)
***Ebay Refresh Auction Button missing. This causes users to have to reload the page manually.
**Ebay Refresh Auction Button missing. This causes users to have to reload the page manually. [https://bugzilla.mozilla.org/show_bug.cgi?id=412128 Bug 412128] will be fixed after the release.
**Report of high CPU usage on Mac and Windows.
Confirmed users
4,072

edits

Navigation menu