MozillaWiki

Releases/Firefox 17/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 17/Test Plan (view source)

Revision as of 23:43, 30 November 2012

65,585 bytes added ,  30 November 2012
→‎Update Testing
 
(461 intermediate revisions by 9 users not shown)
Line 9: Line 9:
  |-
  |-
  | '''Status'''
  | '''Status'''
  | Currently in '''Aurora''' -- merging to Beta on October 9, 2012
  | '''Released''' on Tuesday, November 20, 2012
  |-
  |-
  | '''Lead'''
  | '''Lead'''
Line 27: Line 27:
== Details ==
== Details ==
The following is a description of the tasks which need to be completed throughout this release.
The following is a description of the tasks which need to be completed throughout this release.
* 2012-07-16: {{|}} Nightly Merge
* 2012-07-16: {{done|}} Nightly Merge
* 2012-08-27: {{|}} Aurora Merge
* 2012-08-27: {{done|}} Aurora Merge
* 2012-10-08: {{|}} Pre-Beta feature sign-offs
* 2012-10-08: {{done|}} Pre-Beta feature sign-offs
* 2012-10-11: {{|}} Beta 1
* 2012-10-11: {{done|}} Beta 1
* 2012-10-18: {{|}} Beta 2
* 2012-10-18: {{|}} Beta 2
* 2012-10-25: {{|}} Beta 3
* 2012-10-25: {{|}} Beta 3
Line 65: Line 65:
  | Anthony Hughes
  | Anthony Hughes
  | On track
  | On track
|
|-
| [[DevTools/Features/HTMLTreeEditor| HTML Tree Editor]]
| Mihaela Velimiroviciu
|
  |  
  |  
  |-
  |-
Line 113: Line 118:
# Notify [mailto:ahughes@mozilla.com Anthony Hughes] of the NEW issue
# Notify [mailto:ahughes@mozilla.com Anthony Hughes] of the NEW issue


; Current Status (Vlad Ghetiu / Virgil Dicu) - Last Updated
; Current Status (SoftVision) - Last Updated
[http://bit.ly/z2MmKE Result Spreadsheet]
[http://bit.ly/z2MmKE Result Spreadsheet]


== Aurora Merge ==
== Aurora Merge ==
Line 132: Line 136:


; Checklist
; Checklist
* {{ |}} [[Releases/Firefox_16/Test_Plan#Automated_Testing|Automated Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Automated_Testing|Automated Testing]]
* {{ok|}} [[Releases/Firefox_16/Test_Plan#Manual_Testing|Manual Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Manual_Testing|Manual Testing]]
* {{ |}} [[Releases/Firefox_16/Test_Plan#Update_Testing|Update Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Update_Testing|Update Testing]]
* {{ |}} [[Releases/Firefox_16/Test_Plan#Bug_Triage|Bug Triage]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Bug_Triage|Bug Triage]]
* {{ |}} Peer Sign-off
* {{done|}} Peer Sign-off
* {{ |}} Final sign-off sent and updates qualified on Beta channel
* {{ok|}} Final sign-off sent and updates qualified on Beta channel


=== Automated Testing ===
=== Automated Testing ===
Line 192: Line 196:
  | Windows XP
  | Windows XP
  | Simona
  | Simona
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-29
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-29
  | '''N/A'''
  | '''N/A'''
  |-
  |-
Line 204: Line 208:
  | Windows 8
  | Windows 8
  | Paul
  | Paul
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''N/A'''
  | '''N/A'''
  |-
  |-
  | Mac OS X
  | Mac OS X
  | VladG
  | VladG
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-30
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-30
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-30
  |-
  |-
  | Ubuntu 12.04
  | Ubuntu 12.04
  | Ioana
  | Ioana
  | '''PASS''' - 2012-08-30
  | '''PASS''' - 2012-08-30
  | '''In progress''' - 2012-08-30
  | '''PASS''' - 2012-08-30
  | '''N/A'''
  | '''N/A'''
  |}
  |}
Line 243: Line 247:
# Mac OSX 10.5 cannot start Firefox 17
# Mac OSX 10.5 cannot start Firefox 17
# Mac OSX 10.5 cannot update to Firefox 17
# Mac OSX 10.5 cannot update to Firefox 17
*The build can be downloaded and installed
*Aurora didn't start, showing a incompatibility message
*The update channel seems to be close so I didn't manage to perform an update


=== Feature Sign-offs ===
=== Feature Sign-offs ===
Line 260: Line 268:
  | [[Improve display of location bar results | Improve display of location bar results]]
  | [[Improve display of location bar results | Improve display of location bar results]]
  | Virgil Dicu
  | Virgil Dicu
  | '''result'''
  | '''PASS'''
  | '''result'''
  | '''PASS'''
  | '''result'''
  | '''PASS'''
  |-
  |-
  | [[Firefox Social Integration| Firefox Social Integration]]
  | [[Firefox Social Integration| Firefox Social Integration]]
  | Anthony Hughes
  | Anthony Hughes
  | '''result'''
  | '''PASS'''
  | '''result'''
  | '''PASS'''
  | '''result'''
  | '''PASS'''
  |-
  |-
  |}
  |}
Line 285: Line 293:
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  |-
  |-
  | Windows 8 64-bit
  | Windows 8 64-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  |-
  |-
  | Ubuntu 12.04 64-bit
  | Ubuntu 12.04 64-bit
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  | '''result''' - YYYY-MM-DD
  | '''PASS''' - 2012-08-30
  |}
  |}


Line 314: Line 322:
* [http://bit.ly/PZmJHO HELPWANTED]:  9/139
* [http://bit.ly/PZmJHO HELPWANTED]:  9/139


== New Issues ==
== Beta 1 ==
<bugzilla>
{| class="querytable" style="width:50%"
{
| style="width:10%" | '''Builds'''
  "id": "786970"
| <strike>#1: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build1/ HTTP]</strike> #2: [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build2/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build2/ HTTP]
}
|-
</bugzilla>
| '''ID'''
| <strike>#1: 20121009144933</strike> #2: 20121010150351
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/6b83222781e3 6b83222781e3] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=8a8a932fbef4&tochange=6b83222781e3 pushlog])
|}
 
; Advisory
RelEng issues in generating the builds (see [https://bugzilla.mozilla.org/show_bug.cgi?id=796959#c5 bug 796959 comment 5])
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_2|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_2|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_2|Update Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{done|}} Peer Sign-off
* {{done|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Build #1 Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-10-09&to=2012-10-10 report])
| class="header" style="width:30%" | Build #2 Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-10-10&to=2012-10-11 report])
|-
| Windows XP
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Windows Vista
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-09
| '''PASS''' - 2012-10-10
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
 
=== Manual Testing ===
Run the [https://moztrap.mozilla.org/manage/cases/?filter-suite=114 Desktop Firefox Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
{|class="querytable"
|class="header" | Platform
|class="header" | Tester
|class="header" | Result
|-
| Windows 7
| Manuela, Ioana
| '''PASS''' - 2012-10-11
|-
| Windows 8
| Virgil
| '''PASS''' - 2012-10-11
|-
| Mac OSX 10.7
| Ioana, Mihaela
| '''PASS''' - 2012-10-11
|-
| Mac OSX 10.8
| Virgil
| '''PASS''' - 2012-10-11
|-
| Ubuntu 12.04
| Manuela
| '''PASS''' - 2012-10-11
|-
| colspan="3" | '''Special Cases'''
|-
| Mac OSX 10.5 de-support
| Virgil
| '''PASS''' - 2012-10-11
|-
| Update regression tests (requires updates on releasetest)
| ashughes
| '''PASS''' - 2012-10-11
|}
 
=== Update Testing ===
* Partial: 16.0b6, 16.0b5
* Complete: <= 16.0b4
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-10-11&to=2012-10-11&target=17.0 report])
| class="header" | Beta ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=beta&from=2012-10-11&to=2012-10-12&target=17.0 report])
|-
| Windows XP
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Windows Vista
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|}
 
; Issues
 
=== Feature Sign-off ===
Feature owners to test and sign-off overall quality of their features following uplift to Beta.
 
{| class="querytable"
| class="header" | Feature
| class="header" | Owner
| class="header" | Win32
| class="header" | Mac
| class="header" | Linux
|-
|[https://wiki.mozilla.org/Improve_display_of_location_bar_results Improve display of location bar results]
| Virgil Dicu
| ''n/a'' release target should be updated
| ''n/a'' release target should be updated
| ''n/a'' release target should be updated
|-
|[https://wiki.mozilla.org/DevTools/Features/HTMLTreeEditor HTML tree editor]
| Mihaela Velimiroviciu
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
| '''PASS''' - 2012-10-11
|-
|[https://wiki.mozilla.org/Firefox_Social_Integration Firefox Social Integration]
| Anthony Hughes
| '''n/a''' - delayed to Beta 2
| '''n/a''' - delayed to Beta 2
| '''n/a''' - delayed to Beta 2
|-
|}
 
=== Build #2 Verifications ===
* '''VERIFIED FIXED''' {{bug|799952}}
* '''VERIFIED FIXED''' {{bug|720619}}
* '''RESOLVED FIXED''' {{bug|798045}} (could not verify because could not be reproduced)
 
== Beta 2 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b2-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b2-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121017073013
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/2ba4becf6e35 2ba4becf6e35] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=6b83222781e3&tochange=2ba4becf6e35 pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_3|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_3|Manual Testing]]
* {{ok|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_3|Update Testing]]
* {{ok|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{ok|}} Peer Sign-off
* {{ok|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-10-16&to=2012-10-17 report])
|-
| Windows XP
| '''PASS''' - 2012-10-17
|-
| Windows Vista
| '''PASS''' - 2012-10-17
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-17
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-17
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-17
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-17
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-17
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-17
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-17
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-17
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-17
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* testPrivateBrowsing/testDownloadManagerClosed.js (known)
 
=== Manual Testing ===
Run the ''Firefox 17b2 Regression Tests'' in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
[https://moztrap.mozilla.org/runtests/ Moztrap] > Desktop Firefox > 17 > Firefox 17b2 Regression Tests > Operating System > Platform > Run Tests
 
{|class="querytable"
|class="header" | Platform
|class="header" | Tester
|class="header" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=270 report])
|-
| Windows 7
| Manuela
| '''PASS''' - 2012-10-18
|-
| Windows 8
| Simona
| '''PASS''' - 2012-10-18
|-
| Mac OSX 10.7
| Paul
| '''PASS''' - 2012-10-18
|-
| Mac OSX 10.8
| Mihaela
| '''PASS''' - 2012-10-18
|-
| Ubuntu 12.04
| Virgil
| '''PASS''' - 2012-10-18
|-
| colspan="3" | '''Special Cases'''
|-
| Mac OSX 10.5 de-support
| Virgil
| '''PASS''' - 2012-10-18
|-
| Update regression tests (requires updates on releasetest)
| ashughes
| '''PASS''' - 2012-10-18
|}
 
=== Update Testing ===
* Partial: 17.0b1, 16.0b6
* Complete: <=16.0b5
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-10-17&to=2012-10-18&target=17.0 report])
| class="header" | Beta ([ report])
|-
| Windows XP
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-18
| '''result''' - YYYY-MM-DD
|}
 
; Manual Spotchecks (due to Jenkins outage)
{|class="querytable"
|class="header" | Update
|class="header" | Windows 7
|class="header" | Windows 8
|class="header" | Mac OSX 10.7
|class="header" | Mac OSX 10.8
|class="header" | Ubuntu 12.04
|-
| 17.0b1 -> 17.0b2 en-US
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 17.0b1 -> 17.0b2 de
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 16.0b6 -> 17.0b2 en-US
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 16.0b6 -> 17.0b2 zh-TW
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 16.0b1 -> 17.0b2 en-US
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 16.0b1 -> 17.0b2 es-ES
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 15.0b6 -> 17.0b2 en-US
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
| 15.0b6 -> 17.0b2 pt-BR
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
| '''PASS''' - 2012-10-22
|-
|}
 
; Issues
 
=== Feature Sign-off ===
Feature owners to test and sign-off overall quality of their features following uplift to Beta.
 
{| class="querytable"
| class="header" | Feature
| class="header" | Owner
| class="header" | Win32
| class="header" | Mac
| class="header" | Linux
|-
|[https://wiki.mozilla.org/Firefox_Social_Integration Firefox Social Integration]
| Anthony Hughes
| '''PASS''' - 2012-10-18
| '''PASS''' - 2012-10-18
| '''PASS''' - 2012-10-18
|-
|}
 
; Issues
* Server-side issues not blocking 17b2 (should be fixed with next server-side push)
** Like button activity not pushing to website
** Full page loading within panel (friends and notifications button)
 
== Beta 3 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b3-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b3-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121023124120
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/f8a6138bcfba f8a6138bcfba] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=2ba4becf6e35&tochange=f8a6138bcfba pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_4|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_4|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_4|Update Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{done|}} Peer Sign-off
* {{done|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-10-23&to=2012-10-24 report])
|-
| Windows XP
| '''PASS''' - 2012-10-24
|-
| Windows Vista
| '''PASS''' - 2012-10-24
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-24
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-24
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-24
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-24
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-24
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-24
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-24
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-24
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-24
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* testPrivateBrowsing/testDownloadManagerClosed.js (known)
 
=== Manual Testing ===
Run the ''Firefox 17b3 Regression Tests'' in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
[https://moztrap.mozilla.org/runtests/ Moztrap] > Desktop Firefox > 17 > Firefox 17b3 Regression Tests > Operating System > Platform > Run Tests
 
{|class="querytable"
|class="header" | Platform
|class="header" | Tester
|class="header" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=278 report])
|-
| Windows 7
| Simona
| '''PASS''' - 2012-10-24
|-
| Windows 8
| Manuela
| '''PASS''' - 2012-10-24
|-
| Mac OSX 10.7
| Virgil
| '''PASS''' - 2012-10-24
|-
| Mac OSX 10.8
| Mihaela
| '''PASS''' - 2012-10-24
|-
| Ubuntu 12.04
| Ioana
| '''PASS''' - 2012-10-24
|-
| colspan="3" | '''Special Cases'''
|-
| Mac OSX 10.5 de-support
| Virgil
| '''PASS''' - 2012-10-24
|-
| Update regression tests (requires updates on releasetest)
| ashughes
| '''result''' - YYYY-MM-DD
|}
 
=== Bug Fix Verifications ===
* {{bug|793969}} - '''verified''' (mwobensmith)
* {{bug|801305}} - '''verified''' (mwobensmith)
* {{bug|802557}} - '''verified''' (mwobensmith)
* {{bug|803583}} - '''delayed to 17b4''' (juanb)
* {{bug|803181}} - '''verified''' (virgil)
 
=== Update Testing ===
* Partial: 17.0b2, 17.0b1
* Complete: <=16.0b6
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-10-23&to=2012-10-24&target=17.0 report])
| class="header" | Beta ([ report])
|-
| Windows XP
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Windows 8 32-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Windows 8 64-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.8
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-10-24
| '''result''' - YYYY-MM-DD
|}
 
; Issues
 
== Beta 4 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b4-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b4-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121031065642
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/486335dcb4a2 486335dcb4a2] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=f8a6138bcfba&tochange=486335dcb4a2 pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_5|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_5|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_5|Update Testing]]
* {{ok|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{done|}} Peer Sign-off
* {{done|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results ([http://mozmill-ondemand.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-11-01&to=2012-11-01 report])
|-
| Windows XP
| '''PASS''' - 2012-11-01
|-
| Windows Vista
| '''PASS''' - 2012-11-01
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-01
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-01
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-01
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-01
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-01
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-01
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-01
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-01
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-01
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* testPrivateBrowsing/testDownloadManagerClosed.js (known)
 
=== Manual Testing ===
Run the ''Firefox 17b4 Regression Tests'' in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
[https://moztrap.mozilla.org/runtests/ Moztrap] > Desktop Firefox > 17 > Firefox 17b4 Regression Tests > Operating System > Platform > Run Tests
 
; If you have an AMD or NVIDIA graphics card, please install the Beta drivers during your testing
* AMD Catalyst 12.11 Beta ([http://support.amd.com/us/kbarticles/Pages/AMDCatalyst1211betadriver.aspx download])
** AMD Catalyst 12.11 Beta  graphics driver is not available for Mac OS X.
* NVidia GeForce 310.33 Beta ([http://www.geforce.com/drivers/results/50291 download])
** NVidia GeForce 310.33 Beta graphics driver is not compatible with Windows 8.
** NVidia GeForce 310.33 Beta graphics driver is not available for Mac OS X.
* ''keep your eye out for rendering issues and crashes''
 
{|class="querytable"
|class="header" | Platform
|class="header" | Tester
|class="header" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=295 report])
|-
| Windows 7
| Paul
| '''PASS''' - 2012-11-01
|-
| Windows 8
| Simona
| '''PASS''' - 2012-11-02
|-
| Mac OSX 10.7
| Virgil
| '''PASS''' - 2012-11-01
|-
| Mac OSX 10.8
| Mihaela
| '''PASS''' - 2012-11-01
|-
| Ubuntu 12.04
| Ioana
| '''PASS''' - 2012-11-02
|-
| colspan="3" | '''Special Cases'''
|-
| Mac OSX 10.5 de-support
| Virgil
| '''PASS''' - 2012-11-01
|-
| Update regression tests (requires updates on releasetest)
| ashughes
| '''PASS''' - 2012-11-02
|}
 
=== Bug Fix Verifications ===
* {{bug|803583}} - '''verified''' (juanb)
* {{bug|776247}} - '''verified''' (jsmith)
* {{bug|806991}} - '''n/a''' - to be tested after 17b4 is live (ashughes)
 
=== Update Testing ===
* Partial: 17.0b3, 17.0b2
* Complete: <=17.0b1
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-11-02&to=2012-11-02&target=17.0 report])
| class="header" | Beta ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=beta&from=2012-11-02&to=2012-11-02&target=17.0 report])
|-
| Windows XP
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Windows Vista
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-02
| '''PASS''' - 2012-11-02
|}
 
; Issues
 
== Beta 5 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b5-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b5-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121106195758
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/036da70b61f9 036da70b61f9] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=486335dcb4a2&tochange=036da70b61f9 pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_6|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_6|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_6|Update Testing]]
* {{ok|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{done|}} Peer Sign-off
* {{done|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-11-06&to=2012-11-07 report])
|-
| Windows XP
| '''PASS''' - 2012-11-06
|-
| Windows Vista
| '''PASS''' - 2012-11-06
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-06
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-06
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-06
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-06
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-06
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-06
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-06
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-06
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-06
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
 
=== Manual Testing ===
; Special Instructions
While testing this Beta, please install the latest [http://support.amd.com/us/gpudownload/Pages/index.aspx AMD] or [http://www.geforce.com/drivers/beta-legacy NVidia] beta drivers (if you have a GPU) and [http://download.macromedia.com/pub/flashplayer/installers/archive/fp_11.5.502.110_archive.zip Flash 11.5] (if you are on Windows). Report any visual problems, crashes, or hangs in Bugzilla and add them to the New Issues section below.
 
==== Regression Tests ====
Run the ''Firefox 17b5 Regression Tests'' in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
[https://moztrap.mozilla.org/runtests/ Moztrap] > Desktop Firefox > 17 > Firefox 17b5 Regression Tests > Operating System > Platform > Run Tests
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=316 report])
|class="header" style="width:40%" | Bugs
|-
| Windows 7
| Manuela
| '''PASS''' - 2012-11-07
|
|-
| Windows 8
| Simona
| '''PASS''' - 2012-11-07
|
|-
| Mac OSX 10.8
| Virgil
| '''PASS''' - 2012-11-07
|
|-
| Ubuntu 12.04
| Mihaela
| '''PASS''' - 2012-11-07
|
|-
| Mac OSX 10.5 de-support
| Paul
| '''PASS''' - 2012-11-07
|
|-
| Update regression tests
| ashughes
| '''PASS''' - 2012-11-07
|
|}
 
==== Social API ====
In addition to normal dogfooding (sidebar, activity stream, chat, toolbar), please heavily focus on testing around Private Browsing. In this Beta, the Social API should be disabled in Private Browsing mode. Test to make sure Social API cannot be enabled in Private Browsing, your Social API session is restored when exiting Private Browsing, and that Private Browsing mode works as per normal for all other use cases (Bookmarks, History, Cache, Logins, Cookies, etc)
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result
|class="header" style="width:40%" | Bugs
|-
| Windows 7
| Simona
| '''PASS''' - 2012-11-08
| [https://bugzilla.mozilla.org/show_bug.cgi?id=807217#c43 807217#c43] [https://bugzilla.mozilla.org/show_bug.cgi?id=807675#c3 807675#c3]
|-
| Mac OSX 10.8
| Virgil
| '''PASS''' - 2012-11-08
|
|-
| Ubuntu 12.04
| Ioana
| '''PASS''' - 2012-11-08
| [https://bugzilla.mozilla.org/show_bug.cgi?id=807217#c45 807217#c45]
|}
 
==== Click-to-Play ====
Firefox 17 includes a click-to-play blocking feature which should show an overlay when plug-in content loads. Clicking the overlay should play the content. This feature has not been deployed for all plug-ins however. Flash <=11.3, Java 7 <=7u8, Java 6 <=6u36, Reader <=10.1.3, Silverlight <=5.1.10410.0 should all be CTP blocked. All the latest versions of the plug-ins should not be blocked.
 
Recent regressions indicate not all sites respect CTP blocking (CNN and LA Times for example). Please check various websites with plug-in content. If you can, work through the [https://wiki.mozilla.org/QA/Plugins/CTP_TopSites#Test_results top-100 list] and fill in that table with your results. However, don't be afraid to go outside that list if there are other sites you can think of.
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result
|class="header" style="width:40%" | Bugs
|-
| Windows 7
| Virgil, Manuela
| '''FAIL''' - 2012-11-07
| [https://bugzilla.mozilla.org/show_bug.cgi?id=809792 809792], [https://bugzilla.mozilla.org/show_bug.cgi?id=809858 809858]
|-
| Mac OSX 10.8
| Manuela, Paul
| '''FAIL''' - 2012-11-07
| [https://bugzilla.mozilla.org/show_bug.cgi?id=809792 809792]
|-
| Ubuntu 12.04
| Ioana, Paul
| '''FAIL''' - 2012-11-08
| [https://bugzilla.mozilla.org/show_bug.cgi?id=809785 809785], [https://bugzilla.mozilla.org/show_bug.cgi?id=809793 809793], [https://bugzilla.mozilla.org/show_bug.cgi?id=809860 809860]
|}
 
=== Bug Fix Verifications ===
* '''Reopened''' {{bug|788423}} (ioanab)
* '''Verified''' {{bug|796039}} (psilaghi)
* '''Verified''' {{bug|797163}} (mwobensmith)
* '''Pending''' {{bug|807217}} (ashughes) -- Facebook outage, should be resolved by 5pm Wednesday
 
=== Update Testing ===
* Partial: 17.0b4, 17.0b3
* Complete: <=17.0b2
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-11-07&to=2012-11-08&target=17.0 report])
| class="header" | Beta ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=All&channel=beta&from=2012-11-07&to=2012-11-08&target=17.0 report])
|-
| Windows XP
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Windows Vista
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-07
| '''PASS''' - 2012-11-08
|}
 
; Issues
 
== Beta 6 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b6-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b6-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121113065533
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-beta/rev/0dbbf9b3175c 0dbbf9b3175c] ([http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=036da70b61f9&tochange=0dbbf9b3175c pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_7|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_7|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_7|Update Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Bugs|Bug Triage]]
* {{done|}} Peer Sign-off
* {{|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-11-12&to=2012-11-13 report])
|-
| Windows XP
| '''4 failures''' - 2012-11-12
|-
| Windows Vista
| '''0 failures''' - 2012-11-12
|-
| Windows 7 32-bit
| '''0 failures''' - 2012-11-12
|-
| Windows 7 64-bit
| '''0 failures''' - 2012-11-12
|-
| Windows 8 32-bit
| '''0 failures''' - 2012-11-12
|-
| Windows 8 64-bit
| '''0 failures''' - 2012-11-12
|-
| Mac OS X 10.6
| '''0 failures''' - 2012-11-12
|-
| Mac OS X 10.7
| '''0 failures''' - 2012-11-12
|-
| Mac OS X 10.8
| '''0 failures''' - 2012-11-12
|-
| Ubuntu 12.04 32-bit
| '''0 failures''' - 2012-11-12
|-
| Ubuntu 12.04 64-bit
| '''0 failures''' - 2012-11-12
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* {{bug|811407}} Awesomebar tests failed for 17.0b6 candidate on Windows XP resulting in Disconnect error
 
=== Manual Testing ===
; Special Instructions
While testing this Beta, please install the latest [http://support.amd.com/us/gpudownload/Pages/index.aspx AMD] or [http://www.geforce.com/drivers/beta-legacy NVidia] beta drivers (if you have a GPU) and [http://download.macromedia.com/pub/flashplayer/installers/archive/fp_11.5.502.110_archive.zip Flash 11.5] (if you are on Windows). Report any visual problems, crashes, or hangs in Bugzilla and add them to the New Issues section below.
 
==== Regression Tests ====
Run the ''Firefox 17b6 Regression Tests'' in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
[https://moztrap.mozilla.org/runtests/ Moztrap] > Desktop Firefox > 17 > Firefox 17b6 Regression Tests > Operating System > Platform > Run Tests
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=327 report])
  |class="header" style="width:40%" | Bugs
|-
| Windows 7
| Virgil
| '''PASS''' - 2012-11-14
|
|-
| Windows 8
| Simona
| '''PASS''' - 2012-11-14
|
|-
| Mac OSX 10.8
| Ioana
| '''PASS''' - 2012-11-14
|
|-
| Ubuntu 12.04
| Manuela
| '''PASS''' - 2012-11-14
|
|-
| Mac OSX 10.5 de-support
| Mihaela
| '''PASS''' - 2012-11-14
|
|-
| Update regression tests
| ashughes
| '''PASS''' - 2012-11-14
|
|}
 
==== Awesomebar ====
Check the Awesomebar for potential regressions. In particular, bookmarking, searching, filtering, security information, and switch-to-tab.
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result
|class="header" style="width:40%" | Bugs
|-
| Windows XP
| Virgil
| '''PASS''' - 2012-11-14
|
|-
| Windows 8
| Simona
| '''PASS''' - 2012-11-14
|
|-
| Mac OSX 10.8
| Mihaela
| '''PASS''' - 2012-11-14
|
|-
| Ubuntu 12.04
| Manuela
| '''PASS''' - 2012-11-14
|
|}
 
==== Private Browsing ====
Test Private Browsing mode and check for any potential regressions. In particular history, session and cache leaking into the normal browsing session.
 
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result
|class="header" style="width:40%" | Bugs
|-
| Windows XP
| Paul
| '''PASS''' - 2012-11-14
|
|-
| Windows 8
| Virgil
| '''PASS''' - 2012-11-14
|
|-
| Mac OSX 10.8
| Mihaela
| '''PASS''' - 2012-11-14
|
|-
| Ubuntu 12.04
| Manuela
| '''PASS''' - 2012-11-14
|
|}
 
=== Bug Fix Verifications ===
Downloads Panel
* '''verified''' {{bug|809022}} (simonab)
 
Social API
* '''verified''' {{bug|808116}} (ashughes)
 
VERIFYME ([http://bit.ly/OXHDtn bugs]) - ''aiming to verify all blocker/critical/major bugs''
* '''verified''' {{bug|766616}} (ioana)
* '''verified''' {{bug|680644}} (virgil)
* '''verified''' {{bug|774250}} (paul)
 
=== Update Testing ===
* Partial: 17.0b5, 17.0b4
* Complete: <=17.0b3
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=releasetest&from=2012-11-14&to=2012-11-14&target=17.0 report])
| class="header" | Beta ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=beta&from=2012-11-14&to=2012-11-14&target=17.0 report])
|-
| Windows XP
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Windows Vista
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-14
| '''PASS''' - 2012-11-14
|}
 
; Issues
 
== Release Candidate ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| <strike>[ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build1/ HTTP]</strike> [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build2/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build2/ HTTP]
|-
| '''ID'''
| <strike>20121116115405</strike> 20121119183901
|-
| '''Changeset'''
| <strike>[http://hg.mozilla.org/releases/mozilla-release/rev/0af23f8db35d 0af23f8db35d] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=3995ff235342&tochange=0af23f8db35d pushlog])</strike> [http://hg.mozilla.org/releases/mozilla-release/rev/919435c6f654 919435c6f654] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=0af23f8db35d&tochange=919435c6f654 pushlog])
|}
 
; Checklist (respin for {{bug|813264}})
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_8|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_8|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_8|Update Testing]] on betatest
* {{done|}} Functional sign-off
* {{|}} Update testing on releasetest
* {{|}} Update testing on release
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Build#1 Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-11-16&to=2012-11-17 report])
| class="header" style="width:30%" | Build#2 Results ([http://mozmill-ci.blargon7.com/#/functional/reports?branch=All&platform=All&from=2012-11-20&to=2012-11-20 report])
|-
| Windows XP
| '''PASS''' - 2012-11-16
| '''1 failure''' - 2012-11-19
|-
| Windows Vista
| '''PASS''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Mac OS X 10.6
| '''1 failure''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Mac OS X 10.7
| '''1 failure''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Mac OS X 10.8
| '''2 failures''' - 2012-11-16
| '''1 failure''' - 2012-11-19
|-
| Ubuntu 12.04 32-bit
| '''1 failure''' - 2012-11-16
| '''PASS''' - 2012-11-19
|-
| Ubuntu 12.04 64-bit
| '''1 failure''' - 2012-11-16
| '''PASS''' - 2012-11-19
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* Build 1
** /restartTests/testAddons_uninstallExtension/test4.js - Shutdown expected but none detected before end of test ({{bug|783484}})
** /testPreferences/testPreferredLanguage.js -could not find element Link: Documenti ({{bug|812435}})
* Build 2
** /testAwesomeBar/testSuggestHistory.js ({{bug|813449}})
** /restartTests/testAddons_uninstallExtension/test4.js ({{bug|783484}})
 
=== Manual Testing ===
==== Regression Tests ====
Run the [https://moztrap.mozilla.org/runtests/environment/395/ Firefox 17 Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
; Build 1 Results
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=395 report])
|class="header" style="width:40%" | Bugs
|-
| Windows 7
| Manuela
| '''PASS''' - 2012-11-19
|
|-
| Windows 8
| Simona
| '''PASS''' - 2012-11-19
|
|-
| Mac OSX 10.8
| Paul
| '''PASS''' - 2012-11-19
|
|-
| Ubuntu 12.04
| Mihaela
| '''PASS''' - 2012-11-19
|
|-
| Mac OSX 10.5 de-support
| Ioana
| '''PASS''' - 2012-11-19
|
|-
| Update regression tests
|
| '''PASS''' - 2012-11-19
|
|}
 
; Build 2 Results
Conduct focused regression testing around third-party binary add-ons and exploratory testing around web compatibility.
Yandex, AVG, Bandoo, and Skype are some add-ons to test, but try to test outside that scope and find some other third-party binary add-ons. In terms of websites, try some of the [http://www.alexa.com/topsites Alexa Top-sites] but also try to visit sites you might normally use outside of that scope (banking, video, webmail, news, games, etc).
* ['''FAIL'''] Windows 7 (Manuela, Ioana)
** Addons Tested:
***Hotspot Shield - PASS
***Bandoo for Firefox - PASS
***Skype Click to Call - '''FAIL''': this addon is present in Firefox, but it doesn't work at all (after being forced as compatible and enabled). No phone numbers are highlighted (although they were when opening the same profile/pages etc in Firefox 15.0.1).
***Yandex Toolbar - PASS
** Websites Tested: facebook.com, amazon.com, twitter.com, qq.com, live.com, wikipedia.org, google.com, yahoo.com, baidu.com, youtube.com, miniclip.com, trailers.apple.com - PASS
** Scenarios Tested: tested the addons for basic functionality, tested the websites for functionality, rendering and performance issues (with the addons installed).
* ['''PASS'''] Windows 8 (Simona)
** Addons Tested:
***BitTorrentBar - Pass
***Facebook Toolbar - Pass
***IncrediMail MediaBar 2 - Pass
***Yahoo! Toolbar - Pass
***Yandex Community Toolbar - Pass
***Bandoo for Firefox 5.1 - Pass
***Skype Click to call - I could not install Skype for Windows 8 - FAIL
** Websites Tested:
*** http://www.google.ro/
*** http://www.facebook.com
*** http://ro.yahoo.com/?p=us
*** http://www.baidu.com/
*** http://www.wikipedia.org/
*** https://snt139.mail.live.com/default.aspx?rru=home&livecom=1
*** http://www.msn.com/
*** http://www.bing.com/
** Scenarios Tested: tested the add-ons basic functionality and websites rendering issue having all the add-ons enabled
* ['''FAIL'''] Mac OSX 10.8 (Paul)
** Addons Tested:
***Skype Click to Call - N/A for Firefox on Mac
***Bandoo - N/A on Mac
***http://www.siteadvisor.com/download/ff_preinstall.html - Pass
***http://bittorrentbar.ourtoolbar.com/ - Pass
***http://pages.tvunetworks.com/downloads/player.html - Pass
***Facebook Toolbar - Pass
***Yahoo! Toolbar - Pass
***http://downloadmytoolbar.com/4shared/LP/download.html - FAIL (firefox totally freezes)
***http://incredimailmediabar2.ourtoolbar.com/ - FAIL (firefox totally freezes)
***yandex http://ct57527.ourtoolbar.com/ - FAIL (firefox totally freezes)
***http://hotspotshield.ourtoolbar.com/ - FAIL (firefox totally freezes)
** Websites Tested:
** Scenarios Tested: 
* ['''FAIL'''] Ubuntu 12.04 (Mihaela)
** Addons Tested:
*** 4shared.com Community Toolbar3.15.1.0 - unstable (sometimes new tabs opened from + button are not shown until a browser restart)
*** BitTorrentBar Community Toolbar3.15.1.0 - PASS
*** Facebook Toolbar1.8.2 - PASS
*** Hotspot Shield Community Toolbar3.15.1.0 - breaks session restore (restore previous session button not displayed in about:home page, nor under History menu)
*** IncrediMail MediaBar 2 Community Toolbar3.15.1.0 - unstable (sometimes new tabs opened from + button are not shown until a browser restart)
*** McAfee SiteAdvisor28.0 - PASS
*** Yahoo! Toolbar2.5.1.20121012015120 - PASS
*** Yandex Community Toolbar3.15.1.0 - unstable (sometimes new tabs opened from + button are not shown until a browser restart), breaks session restore (restore previous session button not displayed in about:home page, nor under History menu)
** Websites Tested: google.com, facebook.com, www.youtube.com (flash and html), maps.google.com, mail.yahoo.com, yahoo.com
** Scenarios Tested: install/enable/disable add-on, enable/disable toolbar, add-ons basic functionality, websites basic functionality, pinned tabs
* Issues Found:
**
 
Additional Spotchecks
* ['''PASS'''] Mac OSX 10.5 Desupport (Virgil)
 
=== Bug Fix Verifications ===
VERIFYME ([http://bit.ly/OXHDtn bugs]) - ''aiming to verify all blocker/critical/major bugs''
 
QAWANTED
* {{bug|675260}} crash in DefaultFreeEntry coming from ShutdownNSS (ashughes)
* {{bug|770238}} Fatal jemalloc assertion in js::gc::Arena::finalize<JSString> (marcia)
* {{bug|812307}} crash in DataMngrHlpFF17.dll @ nsVoidArray::~nsVoidArray (juanb)
* {{bug|812456}} Extension block request: DataMngr (virgil)
* {{bug|812683}} Win7 startup crash in d3d11.dll (after installing IE10?) (ioana)
 
=== Update Testing ===
* Partial: 16.0.2, 15.0.1, 14.0.1
* Complete: 16.0
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | betatest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=betatest&from=2012-11-19&to=2012-11-20&target=17.0 report])
| class="header" | release ([http://mozmill-ondemand.blargon7.com/#/update/overview?branch=17.0&channel=release&from=2012-11-20&to=2012-11-20 report])
|-
| Windows XP
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Windows Vista
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Windows 8 32-bit
| '''FAIL''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Windows 8 64-bit
| '''FAIL''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-20
| '''PASS''' - 2012-11-20
|}
 
; Issues
* Windows 8 VMs failed with "cannot connect to jsbridge extension, port 24242"
** Manual spotchecks succeeded
 
== 17.0.1 ==
{| class="querytable" style="width:50%"
| style="width:10%" | '''Builds'''
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ FTP], [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0.1-candidates/build1/ HTTP]
|-
| '''ID'''
| 20121128204232
|-
| '''Changeset'''
| [http://hg.mozilla.org/releases/mozilla-release/rev/c23c45132139 c23c45132139] ([http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=919435c6f654&tochange=c23c45132139 pushlog])
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_17/Test_Plan#Automated_Testing_9|Automated Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_9|Manual Testing]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Manual_Testing_9|Bug Fix Verifications]]
* {{done|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on betatest
* {{done|}} Sign-off email sent to drivers
* {{|}} [[Releases/Firefox_17/Test_Plan#Update_Testing_9|Update Testing]] on release
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:60%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Build#1 Results
|-
| Windows XP
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716718499d functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716718b5ca restart])
|-
| Windows Vista
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717e614 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d37167187a06 restart])
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717cb86 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d371671815ed restart])
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717cac0 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717f43d restart])
|-
| Windows 8 32-bit
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717deed functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d37167181013 restart])
|-
| Windows 8 64-bit
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717da97 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d371671800a9 restart])
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716716a9ef functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d371671725a9 restart])
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716716edf4 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716717372a restart])
|-
| Mac OS X 10.8
| '''1 failure''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d371671688af functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716716fa4b restart])
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d37167168403 functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d3716716dea6 restart])
|-
| Ubuntu 12.04 64-bit
| '''1 failure''' - 2012-11-29 ([http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d371671667fd functional], [http://mozmill-ci.blargon7.com/#/functional/report/352218d7e3125c857fc1d37167169a92 restart])
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
* '''[known]''' restartTests/testAddons_uninstallExtension/test4.js ({{bug|783484}})
* '''[known]''' restartTests/testAddons_pluginDisabledAfterRestart/test2.js ({{bug|780957}})
 
=== Manual Testing ===
==== Regression Tests ====
Run the [https://moztrap.mozilla.org/runtests/environment/440/ Firefox 17 Regression Tests] in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
 
; Build 1 Results
{|class="querytable"
|class="header" style="width:20%" | Platform
|class="header" style="width:20%" | Tester
|class="header" style="width:20%" | Result ([https://moztrap.mozilla.org/results/cases/?filter-run=440 report])
|class="header" style="width:40%" | Bugs
|-
| Windows XP
| Paul
| '''PASS''' - 2012-11-29
|
|-
| Windows 8
| Ioana
| '''PASS''' - 2012-11-29
|
|-
| Mac OSX 10.8
| Virgil
| '''PASS''' - 2012-11-29
|
|-
| Ubuntu 12.04
| Simona
| '''PASS''' - 2012-11-29
|
|-
| Mac OSX 10.5 de-support
| Paul
| '''PASS''' - 2012-11-29
|
|-
| Update regression tests
|
| '''PASS''' - 2012-11-29
|
|}
 
=== Bug Fix Verifications ===
==== [VERIFIED FIXED] {{bug|806192}} crash in inDOMUtils::GetBindingURLs with Firebug and ShareMeNot ====
{| class="querytable"
| class="header" style="width:55% |
| class="header" style="width:15% | Windows 7
| class="header" style="width:15% | Mac OSX
| class="header" style="width:15% | Ubuntu
|-
| Firefox does not crash when loading Firebug scripts
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| colspan="4" | '''Test'''
* Start Firefox with a new profile
* Install Firebug from addons.mozilla.org
* Install Sharemenot from addons.mozilla.org
* Navigate to http://asu.edu
* Activate Firebug
* Click the ''Scripts'' panel
* Click the ''enable'' link in Firebug
* Click the ''reload'' link in Firebug
* '''''Note: broken behaviour can be observed in Firefox 17.0b6'''''
|-
| colspan="4" | '''Notes'''
*
|}
 
==== [VERIFIED FIXED] {{bug|815042}} leaving private browsing with social enabled doesn't reset all social components ====
{| class="querytable"
| class="header" style="width:55% |
| class="header" style="width:15% | Windows 7
| class="header" style="width:15% | Mac OSX
| class="header" style="width:15% | Ubuntu
|-
| Social API usable in normal and private browsing modes
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| Social API does not automatically restore state when switching modes
| PASS (Manuela)
| PASS( Virgil)
| PASS (Simona)
|-
| colspan="4" | '''Notes'''
* Social API can't be enabled from the Facebook activation page. Commented and reopened {{bug|807915}}. Social API can be enabled only by setting the preferences social.active and social.enabled to true in about:config.
* When exiting Private Browsing mode, Social API restores to the state it was in before entering PB mode.
|}
 
==== [VERIFIED FIXED] {{bug|815743}} Backout the UA changes in bug 588909 ====
{| class="querytable"
| class="header" style="width:55% |
| class="header" style="width:15% | Windows 7
| class="header" style="width:15% | Mac OSX
| class="header" style="width:15% | Ubuntu
|-
| UA string contains Gecko/20100101 in about:
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| general.useragent.complexOverride.moodle defaults to false in about:config
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| opensourcecms.com shoes rich-text textareas
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| moodle.org maintains authenticated session
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| colspan="4" | '''Test'''
* Open about: and check the UA string contains Gecko/20100101
* Open about:config and check general.useragent.complexOverride.moodle defaults to false
* Navigate to http://www.opensourcecms.com/scripts/details.php?name=Moodle&scriptid=137
** Click ''Demo Admin Page'' button
** Log in with username admin, password Demo123!
** Click ''Edit Settings'' in the menu on the left
** Verify the ''Full page description'' textarea is a rich-text editor
* Navigate to http://dev.moodle.org
** Clear all cookies
** Navigate to https://moodle.org/login/index.php
** Log in with username mozqatest, password Mozilla123!
** Navigate to https://moodle.org/network/
** Click on 'Moodle Developer Courses' link
** Verify you are still logged in
* '''''Note: broken behaviour can be observed in Firefox 17.0'''''
|-
| colspan="4" | '''Notes'''
* Didn't find the "Full page description" textarea, did find the "Front page description" textarea instead.
|}
 
==== [VERIFIED FIXED] {{bug|814101}} Font Issue in FF 17 ====
{| class="querytable"
| class="header" |
| class="header" | Windows 7 (ATI)
| class="header" | Windows 7 (NVidia)
| class="header" | Windows 8 (ATI)
| class="header" | Windows 8 (NVidia)
|-
| about:support shows Direct2D enabled = true
| PASS (Mihaela)
| PASS(Paul)
| PASS (Mihaela)
| PASS(Paul)
|-
| about:support shows GPU Accelerated Windows = 1/1 Direct3D 10
| PASS(Mihaela)
| PASS(Paul)
| PASS (Mihaela)
| PASS(Paul)
|-
| ClearType ON displays anti-aliased text
| PASS (Mihaela)
| PASS(Paul)
| PASS (Mihaela)
| PASS(Paul)
|-
| ClearType OFF does not display anti-aliased text
| PASS (Mihaela)
| PASS(Paul)
| PASS (Mihaela)
| PASS(Paul)
|-
| colspan="5" | '''Test'''
* Open about:config and make sure to set layers.acceleration.disabled=false, gfx.content.azure.enabled=true
* Open Windows Control Panel > Appearance and Personalization > Display > Adjust ClearType Text
* Turn on ClearType and go to a website
* Use the Magnifier tool in Windows to zoom in on the text (500% worked for me)
* Check for anti-aliased text (might appear blurry)
* Go back to Control Panel and turn off ClearType
* Use the Magnifier tool in Windows to zoom in on the text (500% worked for me)
* Check for un-anti-aliased text (no blurring)
* '''''Note: broken behaviour can be observed in Firefox 17.0'''''
|-
| colspan="4" | '''Notes'''
* Environments:
** Win 7 32 bit, AMD Radeon HD 6450
** Win 7 64bit, Nvidia GeForce 210
** Win 8 64bit, AMD Radeon HD 6450
** Win 8 32bit, Nvidia GeForce 210
|}
 
==== [VERIFIED FIXED] {{bug|814554}} Firefox 17 silently stops processing permissions.sqlite ====
{| class="querytable"
| class="header" style="width:55% |
| class="header" style="width:15% | Windows 7
| class="header" style="width:15% | Mac OSX
| class="header" style="width:15% | Ubuntu
|-
| Cookies permissions persist across Firefox restart
| PASS (Manuela)
| PASS (Virgil)
| PASS (Simona)
|-
| colspan="4" | '''Test'''
* Start Firefox 17.0.1 with a new profile
* Select Options > Privacy > History > Firefox will: use custom settings for history
* Change ''cookies'' pref to Keep until: ask me every time
* Quit Firefox and replace the permissions.sqlite in your profile folder with [https://bugzilla.mozilla.org/attachment.cgi?id=684953 this one]
* Start Firefox and verify Options > Privacy > History > Cookies Exceptions shows only "schafmail.de - Allow for Session"
* Visit http://www.openstreetmap.org/
* Check the box for "use my choice for all cookies from this site" and click Allow
* Verify Options > Privacy > History > Cookies Exceptions has added "www.openstreetmap.org - Allow" to the list
* Restart Firefox and verify that both schafmail.de and www.openstreetmap.org are listed
* Visit http://www.openstreetmap.org/ and verify you are not prompted to accept the cookie again
* '''''Note: broken behaviour can be seen in Firefox 17.0''''
|-
| colspan="4" | '''Notes'''
*Please see more details about how the verification was done here: https://bugzilla.mozilla.org/show_bug.cgi?id=814554#c33
|}
 
=== Update Testing ===
* Partial: 17.0, 16.0.2, 15.0.1
* Complete: 16.0
 
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | betatest ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=betatest&from=2012-11-29&to=2012-11-29&target=17.0.1 report])
| class="header" | release ([http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&channel=release&from=2012-11-30&to=2012-11-30&target=17.0.1 report])
|-
| Windows XP
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Windows Vista
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Windows 7 32-bit
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Windows 7 64-bit
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Windows 8 32-bit (manual re:{{bug|803489}})
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Windows 8 64-bit (manual re:{{bug|803489}})
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Mac OS X 10.6
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Mac OS X 10.7
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Mac OS X 10.8
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-11-29
| '''PASS''' - 2012-11-30
|}
; Spotchecks
* {{done|}} Verify background updates still work (chunk size and ping interval changed for 17.0.1)
 
; Issues
* Very intermittent issue with 15.0.1->17.0.1 fallback updates resulting in connection error to update server
 
== Bugs ==
=== Triage ===
# [http://bit.ly/RDJfWT VERIFYME]: verify the fix and do some exploratory testing around the issue
# [http://bit.ly/T9y4sq FIXED]: triage these bugs and test to ensure the fix is effective
# [http://bit.ly/RllnZw QAWANTED]: triage these bugs and test to fulfill the QA request
# [http://bit.ly/SUINkj UNCONFIRMED]: triage these bugs for potential new regressions
 
=== New Issues ===
Anything in '''bold''' is a potential blocker.
 
* {{bug|813531}} An unknown error while printing SVG file
* {{bug|813553}} [Mac OS] Firefox freezes after installing add-ons which launch a pop-up after installation
* {{bug|813563}} Cannot restore previous session (with Yandex Community Toolbar3.15.1.0 and Hotspot Shield Community Toolbar3.15.1.0)
* {{bug|813566}} [Mac OS] Mouse cursor disappears when switching tabs
* {{bug|813568}} Skype Click to Call doesn't work on Firefox 17, although it is enabled
* {{bug|813572}} New tab is not added to the tabs strip (with 4shared.com Community Toolbar, IncrediMail MediaBar 2 Community Toolbar)
* {{bug|813594}} Gaping tabs strip after installing Facebook Toolbar
 
=== Known Issues ===
Anything in '''bold''' is a potential blocker.
 
Click-to-Play
* {{bug|809785}} Plugin content can't be activated on sohu.com because it is covered by an <a> element
* {{bug|809793}} The Click-to-Play message is cropped on taobao.com
* {{bug|809858}} Click to play overlay not working on paypal.com
 
Graphics
* {{bug|686782}} GFX glitches on Windows 8 with D2D
* {{bug|772837}} Content of drop-down lists (awesomebar history) blink on secondary monitor with HWA
 
HTML5 Video
* {{bug|760417}} Full-screen button visible in pop-out full-screen mode
* {{bug|786972}} Can't replay video by clicking on the progress bar after playback ends
* {{bug|803057}} HTML5 videos continues to play after Pop Out
* {{bug|708557}} Html5 youtube context menu not persistent when right clicking
 
Layout
* '''FIXED''' {{bug|785754}} Buttons on some sites are not rendered correctly
* '''FIXED''' {{bug|803074}} Rendering is broken after restoring skew() support
 
Plugins
* {{bug|667399}} RealPlayer G2 LiveConnect plugin crash
* WFM {{bug|786655}} Flash context menu does not own focus
* {{bug|786970}} Windowed plugin content gets displayed out of it's container when scrolling the browser window
* '''FIXED?''' {{bug|788423}} [adbe 3325067] Flash hang in F_1152915508 on dropbox.com (test Nov 7, 2012)
* {{bug|797116}} Win8 Flash hang in F_1152915508 while playing Knight Hunters
* WFM {{bug|798295}} Copy actions are sometimes unresponsive in Flash
* {{bug|800928}} Incorrect display of Vimeo context menu in a tab dragged to a new window
* {{bug|800940}} Incorrect positioning of IMDB video player in a tab dragged to a new window
* {{bug|797830}} [flash 11.5] Right clicking the Flash content pauses the video when using the 11.5 beta version
Printing
* {{bug|638796}} Non-functional print button in Firefox Menu when viewing a PDF file
 
Social API
* {{bug|789707}} Make sure we're handling offline mode
* '''FIXED''' {{bug|799856}} crash in mozilla::InternalInvalidateThebesLayersInSubtree, canceled login to Facebook
* {{bug|804622}} Sidebar asks me to log in even though I'm logged in
* {{bug|807673}} Social chat panels are not displayed right when resizing Firefox vertically
* {{bug|807675}} Friends in the Social sidebar are sometimes marked as offline without actually going offline
* {{bug|807915}} Can't activate Social API from the Facebook activation page
* {{bug|807935}} The chat window persists in DOM full-screen mode
* '''FIXED?''' {{bug|807981}} Facebook new friend request notification link is not opened in new tab (test Nov 14)
* {{bug|807997}} Nothing happens when attempting to open a contact in Facebook sidebar with about: page open
* {{bug|808001}} Clicking on notification pop-ups opens them in the focused tab, not in a new tab
* {{bug|811727}} Can't turn on facebook messenger from facebook notification
 
Switch-to-Tab
* {{bug|811668}} "Switch to tab" switches to other tab group even if the same page is opened in current group
 
WebGL
* {{bug|787056}} Google MapsGL blurry on machines where Chrome MapsGL isn't supported


== Known Issues ==
Toolbars
<bugzilla>
* {{bug|518089}} A hidden state of the toolbar which user added does not persist after reboot, When a multi-byte letter is included in a name of the toolbar
{
  "id": "468855, 778819"
}
</bugzilla>
Ashughes
Confirmed users
14,525

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/465708...491289"