MozillaWiki

QA/mozilla-aurora/fx5/Beta 3: Difference between revisions

Page Discussion

QA/mozilla-aurora/fx5/Beta 3 (view source)

Revision as of 21:12, 1 June 2011

7,221 bytes added ,  1 June 2011
→‎Updates
 
(24 intermediate revisions by 6 users not shown)
Line 3: Line 3:
== Beta 3 Test Results ==
== Beta 3 Test Results ==
The following spotchecks should be performed before signing off on the next weekly beta.
The following spotchecks should be performed before signing off on the next weekly beta.
* {{ok|'''In Progress'''}} Manual Testing - '''[[QA/mozilla-aurora/fx5/Beta_3/Manual_Testing|Manual Testing]]'''
* {{done|'''Signed-Off'''}} Manual Testing - '''[[QA/mozilla-aurora/fx5/Beta_3/Manual_Testing|Manual Testing]]'''
* {{ok|'''In Progress'''}} Automation (Mozmill BFTs) - '''[http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=5.0&platform=All&from=2011-05-27&to=2011-06-01 results]'''
* {{done|}} Automation (Mozmill BFTs) - [[QA/mozilla-aurora/fx5/Beta_3#Automation|'''PASS''']]
* {{ok|'''In Progress'''}} [[QA/mozilla-aurora/fx5/Beta_3/Updates_Testing|Updates Test Automation]] (Mozimill)
* {{done|}} Automation (Updates) - [[QA/mozilla-aurora/fx5/Beta_3#Updates|'''PASS''']] - betatest
* {{ok|'''In Progress'''}} Stability Report (crash-stats)
* {{done|'''Signed-Off'''}} Stability Report (crash-stats)
* {{ok|'''In Progress'''}} Bug Verifications
** No obvious top crash regressions
* {{ok|'''Signed-Off'''}} Bug Verifications
** Focused on bug verifications with high user impact, and those that could be verified.


== Platform Coverage ==
== Platform Coverage ==
Line 17: Line 19:
* Mac OSX 10.6
* Mac OSX 10.6
* Ubuntu 10.10 (32-bit and 64-bit)
* Ubuntu 10.10 (32-bit and 64-bit)
== Results ==
=== Automation ===
Run automated BFTs and link reports from dashboard
{| class="fullwidth-table"
| style="background:#EFEFEF; width:20%" | '''Platform'''
| style="background:#EFEFEF; width:25%" | '''Result'''
| style="background:#EFEFEF; width:25%" | '''General Tests'''
| style="background:#EFEFEF; width:25%" | '''Restart Tests'''
|-
| Windows 2000
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2c992d REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cd101 REPORT]
|-
| Windows XP
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cb159 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cf705 REPORT]
|-
| Windows Vista
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cb68e REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d00ba REPORT]
|-
| Windows 7
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2ca868 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d0097 REPORT]
|-
| Windows 7 64-bit
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cdd4f REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d1822 REPORT]
|-
| Mac OS X 10.6
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2cc4df REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d0e6a REPORT]
|-
| Ubuntu 10.10
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2c7ef8 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2ced07 REPORT]
|-
| Ubuntu 10.10 64-bit
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2ce998 REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d2ced REPORT] (x86_64)
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2ced07 REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/general/report/d5e6504a1bcd108073bcb3e1df2d399e REPORT] (x86_64)
|}
; Issues Found:
* n/a
=== Manual  ===
;Smoketests
:
{| class="fullwidth-table"
|-
| style="background:#EFEFEF; width:20%" | '''Platform'''
| style="background:#EFEFEF; width:25%" | '''Name of tester'''
| style="background:#EFEFEF; width:25%" | '''Results'''
|-
| Windows 2000
| AndreiD
| '''PASS'''
|-
| Windows XP
| Vlad Ghetiu
| '''PASS'''
|-
| Windows Vista
| Simona
| '''PASS'''
|-
| Windows 7
| AndreiD
| '''PASS'''
|-
| Windows 7 64-bit
| AndreiD
| '''PASS'''
|-
| Mac OS X 10.6
| Vlad Ghetiu
| '''PASS'''
|-
| Ubuntu 10.10
| George
| '''PASS'''
|-
| Ubuntu 10.10 64-bit
| Simona
| '''PASS'''
|}
;BFTs
:
*WinXP
*Testers: Andrei, George, Simona, Vlad
*Results: '''PASS''' in Litmus with known issues
;Issues Found
:
*n/a
=== Updates ===
; Mozmill Results
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Platform'''
| style="background:#EFEFEF; width:25%" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=betatest&from=2011-05-24&to=2011-05-31&target=5.0 report]
| style="background:#EFEFEF; width:25%" | '''Releasetest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=releasetest&from=2011-05-25&to=2011-06-01&target=5.0 report]
| style="background:#EFEFEF; width:25%" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=beta&from=2011-05-25&to=2011-06-01&target=5.0 report]
|-
| Windows 2000
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
|-
| Windows XP
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
|-
| Windows Vista
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
| en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
|-
| Windows 7
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
|-
| Windows 7 64-bit
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
|-
| Mac OS X 10.6
| en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
|-
| Ubuntu 10.10
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
|-
| Ubuntu 10.10 64-bit
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
| en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
|}
; Channel Switching Spotchecks
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Platform'''
| style="background:#EFEFEF; width:65%" | '''Build IDs'''
| style="background:#EFEFEF; width:10%" | '''Result'''
|-
| Windows XP
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Windows 7
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Mac OS X 10.6
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Ubuntu 10.10
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|}
; Known Failures
* Sporadic automation failures due to slow download times in conflict with timeout values in tests -- failed locales spotchecked ok.
* Desktop link/folder does not update to "beta" with channel switcher
; Issues Found
* n/a


== Problems Found ==
== Problems Found ==
List any found issues or bugs here:
List any found issues or bugs here. Use '''[5b3]''' whiteboard entry to keep track.
Ashughes
Confirmed users
14,525

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/313578...314785"