MozillaWiki

Releases/Firefox 16/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 16/Test Plan (view source)

Revision as of 21:23, 10 October 2012

5,168 bytes added ,  10 October 2012
→‎Release Candidate
Line 2,384: Line 2,384:
* [http://bit.ly/POyxuA WONTVERIFY]: 32/304
* [http://bit.ly/POyxuA WONTVERIFY]: 32/304
* [http://bit.ly/O09WSK HELPWANTED]: 5/304
* [http://bit.ly/O09WSK HELPWANTED]: 5/304
== 16.0.1 ==
{| class="querytable" style="width:30%"
| style="width:10%" |
| style="width:20%" |
|-
| '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/16.0.1-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/16.0.1-candidates/build1/ HTTP]
|-
| '''ID'''
|
|-
| '''Changeset'''
| [https://hg.mozilla.org/releases/mozilla-release/rev/7789ab68a99d 7789ab68a99d] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=10fe550fadc6&tochange=7789ab68a99d pushlog])
|}
; Checklist
* {{ok|}} [[Releases/Firefox_16/Test_Plan#Automated_Testing_7|Automated Testing]]
* {{ok|}} [[Releases/Firefox_16/Test_Plan#Manual_Testing_7|Manual Testing]]
* {{ok|}} [[Releases/Firefox_16/Test_Plan#Update_Testing_7|Update Testing]]
* {{ | }} Final sign-off sent and updates qualified on Beta channel
=== Automated Testing 7 ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:50%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | RESULT: [http://mozmill-ci.blargon7.com/#/functional/reports?branch=16.0&platform=All&from=2012-10-10&to=2012-10-11 report]
|-
| Windows XP
| '''RESULT''' - 2012-10-10
|-
| Windows Vista
| '''RESULT''' - 2012-10-10
|-
| Windows 7 32-bit
| '''RESULT''' - 2012-10-10
|-
| Windows 7 64-bit
| '''RESULT''' - 2012-10-10
|-
| Windows 8 32-bit
| '''RESULT''' - 2012-10-10
|-
| Windows 8 64-bit
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.6
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.7
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.8
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 32-bit
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 64-bit
| '''RESULT''' - 2012-10-10
|}
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
=== Manual Testing 7 ===
There will be four bug verifications and testing around these bugs
; Results
{| class="querytable"
| class="header" | Platform
| class="header" | Tester
| class="header" | 16.0.1 Candidates
|-
| Windows XP
| tester
| '''RESULT''' - 2012-10-10
|-
| Windows Vista
| tester
| '''RESULT''' - 2012-10-10
|-
| Windows 7 32-bit
| tester
| '''RESULT''' - 2012-10-10
|-
| Windows 7 64-bit
| tester
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.6
| tester
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.7
| tester
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.8
| tester
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 32-bit
| tester
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 64-bit
| tester
| '''RESULT''' - 2012-10-10
|}
; Issues Found
==== Breakpad End-to-End 7 ====
Test the end-to-end functionality in the crash reporting feature, across operating systems.
* Use the [http://ted.mielczarek.org/mozilla/crashme.html Crash Me add-on] to trigger a crash
* Set up a dirty profile with lots of history, bookmarks, add-ons, themes, tabs, app-tabs, plugin content loaded, etc
* Repeatedly crash Firefox and submit your reports
* Verify that your session restores properly
* Verify your crash reports are submitted properly by going through about:crashes and clicking the reports
* Try adding comments to your crash report and verify the crash-stats.com report shows the comment
=== Update Testing 7 ===
* Partial: 13.0.1, 14.0.1, 15.0.1
* Complete: 12.0, 13.0
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest: [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=16.0&channel=releasetest&from=2012-10-02&to=2012-10-03&target=16.0 report]
| class="header" | Beta: [http://mozmill-ondemand.blargon7.com/#/update/detail?branch=16.0&channel=beta&from=2012-10-02&to=2012-10-03&target=16.0 report]
|-
| Windows XP
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Windows Vista
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Windows 7 32-bit
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Windows 7 64-bit
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Windows 8 32-bit
| '''manual'''-see below - 2012-10-02
| '''Results''' - yyyy-mm-dd
|-
| Windows 8 64-bit
| '''manual'''-see below - 2012-10-02
| '''Results''' - yyyy-mm-dd
|-
| Mac OS X 10.6
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.7
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Mac OS X 10.8
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 32-bit
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|-
| Ubuntu 12.04 64-bit
| '''RESULT''' - 2012-10-10
| '''RESULT''' - 2012-10-10
|}
''Windows 8: manual spotcheck until automation in place''
* RELEASETEST
** '''RESULT''' - Firefox 16.0 en-US (partial)
** '''RESULT''' - Firefox 13.0 de (complete)
* RELEASE
** '''RESULT''' - Firefox 16.0 en-US (partial)
** '''RESULT''' - Firefox 12.0 fr (complete)
; Issues


== Issues ==
== Issues ==
Jbecerra
canmove, Confirmed users
7,810

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/478512"