MozillaWiki

Releases/Firefox 22/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 22/Test Plan (view source)

Revision as of 07:36, 20 June 2013

4,984 bytes added ,  20 June 2013
→‎Release Candidate
Line 1,355: Line 1,355:
The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.
The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.


== Release Candidate ==
== Release Candidate 1 ==
{| class="querytable" style="width:50%"
{| class="querytable" style="width:50%"
  | style="width:10%" | '''Builds'''
  | style="width:10%" | '''Builds'''
Line 1,471: Line 1,471:
* {{ok|}} {{bug|852436}} crash in XPCWrappedNative::GetNewOrUsed @ JSAutoCompartment::JSAutoCompartment (Simona Marcu)
* {{ok|}} {{bug|852436}} crash in XPCWrappedNative::GetNewOrUsed @ JSAutoCompartment::JSAutoCompartment (Simona Marcu)
* {{done|}} {{bug|856344}} Crash [@ js::Proxy::has] with adopted <form> (Simona Marcu)
* {{done|}} {{bug|856344}} Crash [@ js::Proxy::has] with adopted <form> (Simona Marcu)
=== Update Tests ===
The following is the results of the Mozmill automated update tests.
{| class="querytable"
| class="header" style="width:20%" | Platform
| class="header" | Betatest [[http://mozmill-ondemand.blargon7.com/#/update/detail?branch=22.0&channel=betatest&from=2013-06-18&to=2013-06-18&target=22.0 dashboard]]
| class="header" | Releasetest [[http://mozmill-ondemand.blargon7.com/#/update/detail?branch=22.0&channel=releasetest&from=2013-06-18&to=2013-06-18&target=22.0 dashboard]]
| class="header" | Beta [[http://mozmill-ondemand.blargon7.com/#/update/detail?branch=22.0&channel=beta&from=2013-06-19&to=2013-06-19&target=22.0 dashboard]]
|-
| Windows XP
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Windows Vista
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Windows 7 32-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Windows 7 64-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Windows 8 32-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Windows 8 64-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Mac OSX 10.6
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Mac OSX 10.7
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Mac OSX 10.8
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Ubuntu 12.04 32-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|-
| Ubuntu 12.04 64-bit
| {{ok|}} - RESULT
| {{ok|}} - RESULT
| {{ok|}} - RESULT
|}
=== New Issues ===
The following is a list of bugs found while testing this Beta. If you report a bug to bugzilla please list it below.
== Release Candidate 2 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/22.0-candidates/build2/ FTP], [http://ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/22.0-candidates/build2/ HTTP]
|-
| '''ID'''
| 20130619132145
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-release/rev/0d4b9c74be55 0d4b9c74be55] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=9f0d4fe5db55&tochange=0d4b9c74be55 pushlog])
|}
; Checklist
* {{ok|}} Automated Tests
* {{ok|}} Regression Tests
* {{ok|}} Bug Fix Verifications
* {{ok|}} Update Tests (betatest)
* {{ok|}} Update Tests (releasetest)
* {{ok|}} Update Tests (beta)
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{| class="querytable" style="width:40%"
| class="header" style="width:20%" | Platform
| class="header" style="width:20%" | Results [[http://mozmill-ci.blargon7.com/#/functional/reports?branch=22.0&platform=All&from=2013-06-18&to=2013-06-18 dashboard]]
|-
| Windows XP
| {{ok|}} en-US & da
|-
| Windows Vista
| {{ok|}} en-US & it
|-
| Windows 7 32-bit
| {{ok|}} en-US & zh-TW
|-
| Windows 7 64-bit
| {{ok|}} en-US & ro
|-
| Windows 8 32-bit
| {{ok|}} en-US & es-ES
|-
| Windows 8 64-bit
| {{ok|}} en-US & pt-BR
|-
| Mac OSX 10.6
| {{ok|}} en-US & de
|-
| Mac OSX 10.7
| {{ok|}} en-US & fr
|-
| Mac OSX 10.8
| {{ok|}} en-US & it
|-
| Ubuntu 12.04 32-bit
| {{ok|}} en-US & de
|-
| Ubuntu 12.04 64-bit
| {{ok|}} en-US & fr
|}
''Known test failures in [https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA bugzilla]''
=== Regression Tests ===
As per the [https://wiki.mozilla.org/QA/Desktop_Firefox/Releases/Beta_Checklist checklist] we will regression test the following areas.
{| class="querytable"
| class="header" | Test
| class="header" | Windows XP
| class="header" | Windows 7 32-bit
| class="header" | Mac OSX 10.8
| class="header" | Ubuntu 12.04 32-bit
|-
| Breakpad end-to-end functionality
| {{ok|}}
| {{ok|}}
| {{ok|}}
| {{ok|}}
|-
| Partner Repack Updates
| {{ok|}}
| {{ok|}}
| {{ok|}}
| {{ok|}}
|-
| Remote Profiles
| {{ok|}}
| {{ok|}}
| {{ok|}}
| {{ok|}}
|-
| WebRTC
| {{ok|}}
| {{ok|}}
| {{ok|}}
| {{ok|}}
|-
|}
Details:
* Breakpad end-to-end functionality
** ensure that crash reports are submitted with the current build,
** use this [https://moztrap.mozilla.org/manage/case/2525/ Moztrap test] as a rough guideline.
* Partner Repack Updates
** Ensure that updates are working on betatest (use this [https://moztrap.mozilla.org/manage/case/6785/ Moztrap test] as a rough guideline).
* Remote Profiles
** Ensure that Firefox works with remote profiles (use this [https://moztrap.mozilla.org/manage/case/7514/ Moztrap test] as a rough guideline).
* WebRTC
** Dogfood webRTC voice calling and video chat.
=== Bug Fix Verifications ===
List of fixed bugs in Firefox where the status for Firefox 22 is set to fixed and need verification: http://mzl.la/15LLemh
*


=== Update Tests ===
=== Update Tests ===
Ioana.budnar
Confirmed users
2,544

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/668803"