QA/mozilla-aurora/fx5/Beta 3: Difference between revisions

 
(6 intermediate revisions by 2 users not shown)
Line 3: Line 3:
== Beta 3 Test Results ==
== Beta 3 Test Results ==
The following spotchecks should be performed before signing off on the next weekly beta.
The following spotchecks should be performed before signing off on the next weekly beta.
* {{ok|'''In Progress'''}} Manual Testing - '''[[QA/mozilla-aurora/fx5/Beta_3/Manual_Testing|Manual Testing]]'''
* {{done|'''Signed-Off'''}} Manual Testing - '''[[QA/mozilla-aurora/fx5/Beta_3/Manual_Testing|Manual Testing]]'''
* {{ok|'''In Progress'''}} Automation (Mozmill BFTs) - [[QA/mozilla-aurora/fx5/Beta_3#Automation|'''Results''']]
* {{done|}} Automation (Mozmill BFTs) - [[QA/mozilla-aurora/fx5/Beta_3#Automation|'''PASS''']]
* {{ok|'''In Progress'''}} [[QA/mozilla-aurora/fx5/Beta_3/Updates_Testing|Updates Test Automation]] (Mozimill)
* {{done|}} Automation (Updates) - [[QA/mozilla-aurora/fx5/Beta_3#Updates|'''PASS''']] - betatest
* {{ok|'''In Progress'''}} Stability Report (crash-stats)
* {{done|'''Signed-Off'''}} Stability Report (crash-stats)
* {{ok|'''In Progress'''}} Bug Verifications
** No obvious top crash regressions
* {{ok|'''Signed-Off'''}} Bug Verifications
** Focused on bug verifications with high user impact, and those that could be verified.


== Platform Coverage ==
== Platform Coverage ==
Line 129: Line 131:


=== Updates ===
=== Updates ===
 
; Mozmill Results
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=betatest&from=2011-05-24&to=2011-05-31&target=5.0 report]
  | style="background:#EFEFEF; width:25%" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=betatest&from=2011-05-24&to=2011-05-31&target=5.0 report]
  | style="background:#EFEFEF; width:25%" | '''Releasetest'''
  | style="background:#EFEFEF; width:25%" | '''Releasetest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=releasetest&from=2011-05-25&to=2011-06-01&target=5.0 report]
  | style="background:#EFEFEF; width:25%" | '''Beta'''
  | style="background:#EFEFEF; width:25%" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=5.0&channel=beta&from=2011-05-25&to=2011-06-01&target=5.0 report]
  |-
  |-
  | Windows 2000
  | Windows 2000
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> ru: '''PASS'''
  |-
  |-
  | Windows XP
  | Windows XP
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |
  | en-US: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> ru: '''PASS'''
  |-
  |-
  | Windows 7
  | Windows 7
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> ru: '''PASS''' <br> zh-TW: '''PASS'''
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> fr: '''PASS'''
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  |
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
  |  
  | en-US: '''PASS''' <br> de: '''PASS''' <br> es-ES: '''PASS''' <br> fr: '''PASS''' <br> zh-TW: '''PASS'''
|}
 
; Channel Switching Spotchecks
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Platform'''
| style="background:#EFEFEF; width:65%" | '''Build IDs'''
| style="background:#EFEFEF; width:10%" | '''Result'''
|-
| Windows XP
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Windows 7
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Mac OS X 10.6
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
|-
| Ubuntu 10.10
| Firefox 6.0a2 20110601 -> Firefox 5.0b3 20110527
| '''PASS'''
  |}
  |}
; Known Failures
* Sporadic automation failures due to slow download times in conflict with timeout values in tests -- failed locales spotchecked ok.
* Desktop link/folder does not update to "beta" with channel switcher
; Issues Found
* n/a


== Problems Found ==
== Problems Found ==
List any found issues or bugs here. Use '''[5b3]''' whiteboard entry to keep track.
List any found issues or bugs here. Use '''[5b3]''' whiteboard entry to keep track.
Confirmed users
14,525

edits