Releases/Firefox 17/Test Plan: Difference between revisions

Releases/Firefox 17/Test Plan (view source)

Revision as of 22:53, 28 November 2012

4,238 bytes added , 28 November 2012

→‎Release Candidate

Ashughes

Confirmed users

14,525

edits

@@ Line 1,844: / Line 1,844: @@
 * Windows 8 VMs failed with "cannot connect to jsbridge extension, port 24242"
 ** Manual spotchecks succeeded
+== 17.0.1 ==
+{| class="querytable" style="width:50%"
+ | style="width:10%" | '''Builds'''
+ | [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ HTTP]
+ |-
+ | '''ID'''
+ | id
+ |-
+ | '''Changeset'''
+ | [http://hg.mozilla.org/releases/mozilla-release/rev/id id] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=919435c6f654&tochange=id pushlog])
+ |}
+; Checklist (respin for {{bug|813264}})
+* {{|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_9|Automated Testing]]
+* {{|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_9|Manual Testing]]
+* {{|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on betatest
+* {{|}} Functional sign-off
+* {{|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on release
+=== Automated Testing ===
+The following are the detailed results of the automated Mozmill test runs.
+{|class="querytable" style="width:60%"
+ |-
+ | class="header" style="width:20%" | Platform
+ | class="header" style="width:30%" | Build#1 Results ([ report])
+ |-
+ | Windows XP
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows Vista
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 32-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 64-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 8 32-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 8 64-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.6
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.7
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.8
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 12.04 32-bit
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 12.04 64-bit
+ | '''result''' - YYYY-MM-DD
+ |}
+; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
+=== Manual Testing ===
+==== Regression Tests ====
+Run the [https://moztrap.mozilla.org/runtests/environment/395/ Firefox 17 Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
+; Build 1 Results
+{|class="querytable"
+ |class="header" style="width:20%" | Platform
+ |class="header" style="width:20%" | Tester
+ |class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=395 report])
+ |class="header" style="width:40%" | Bugs
+ |-
+ | Windows XP
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |-
+ | Windows 8
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |-
+ | Mac OSX 10.8
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |-
+ | Ubuntu 12.04
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |-
+ | Mac OSX 10.5 de-support
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |-
+ | Update regression tests
+ | tester
+ | '''result''' - YYYY-MM-DD
+ |
+ |}
+Additional Spotchecks
+* ['''result'''] Mac OSX 10.5 Desupport (tester)
+=== Bug Fix Verifications ===
+* bug 806192
+* bug 815042
+* bug 815743
+* bug 814101
+* bug 813264
+* bug 814554
+* bug 816197
+=== Update Testing ===
+* Partial:
+* Complete:
+{|class="querytable" style="width:60%"
+ |-
+ | class="header" | Platform
+ | class="header" | betatest ([ report])
+ | class="header" | release ([ report])
+ |-
+ | Windows XP
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows Vista
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 32-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 7 64-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 8 32-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Windows 8 64-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.6
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.7
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Mac OS X 10.8
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 12.04 32-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |-
+ | Ubuntu 12.04 64-bit
+ | '''result''' - YYYY-MM-DD
+ | '''result''' - YYYY-MM-DD
+ |}
+; Issues
 == Bugs ==