Releases/Firefox 17/Test Plan: Difference between revisions

Line 1,844: Line 1,844:
* Windows 8 VMs failed with "cannot connect to jsbridge extension, port 24242"
* Windows 8 VMs failed with "cannot connect to jsbridge extension, port 24242"
** Manual spotchecks succeeded
** Manual spotchecks succeeded
== 17.0.1 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ HTTP]
|-
| '''ID'''
| id
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-release/rev/id id] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=919435c6f654&tochange=id pushlog])
|}
; Checklist (respin for {{bug|813264}})
* {{|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_9|Automated Testing]]
* {{|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_9|Manual Testing]]
* {{|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on betatest
* {{|}} Functional sign-off
* {{|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on release
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Build#1 Results ([ report])
|-
| Windows XP
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''result''' - YYYY-MM-DD
|-
| Windows 8 32-bit
| '''result''' - YYYY-MM-DD
|-
| Windows 8 64-bit
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.8
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''result''' - YYYY-MM-DD
|}
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
=== Manual Testing ===
==== Regression Tests ====
Run the [https://moztrap.mozilla.org/runtests/environment/395/ Firefox 17 Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
; Build 1 Results
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=395 report])
|class="header" style="width:40%" | Bugs
|-
| Windows XP
| tester
| '''result''' - YYYY-MM-DD
|
|-
| Windows 8
| tester
| '''result''' - YYYY-MM-DD
|
|-
| Mac OSX 10.8
| tester
| '''result''' - YYYY-MM-DD
|
|-
| Ubuntu 12.04
| tester
| '''result''' - YYYY-MM-DD
|
|-
| Mac OSX 10.5 de-support
| tester
| '''result''' - YYYY-MM-DD
|
|-
| Update regression tests
| tester
| '''result''' - YYYY-MM-DD
|
|}
Additional Spotchecks
* ['''result'''] Mac OSX 10.5 Desupport (tester)
=== Bug Fix Verifications ===
* bug 806192
* bug 815042
* bug 815743
* bug 814101
* bug 813264
* bug 814554
* bug 816197
=== Update Testing ===
* Partial:
* Complete:
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | betatest ([ report])
| class="header" | release ([ report])
|-
| Windows XP
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 8 32-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 8 64-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.8
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|}
; Issues


== Bugs ==
== Bugs ==
Confirmed users
14,525

edits