Releases/Firefox 17/Test Plan: Difference between revisions

Jump to navigation Jump to search

Releases/Firefox 17/Test Plan (view source)

Revision as of 13:42, 20 November 2012

21,632 bytes added ,  20 November 2012
→‎Regression Tests
Line 1: Line 1:
<small>[[Releases/Firefox_16/Test_Plan|« Firefox 16]] | [[Releases/Firefox_17/Test_Plan|Firefox 17]] | [[Releases/Firefox_18/Test_Plan|Firefox 18 »]] </small>  
<p><small><a href="Releases/Firefox 16/Test Plan">« Firefox 16</a> | <a href="Releases/Firefox_17/Test_Plan" class="selflink">Firefox 17</a> | <a href="Releases/Firefox 18/Test Plan">Firefox 18 »</a> </small>
</p>
<h1> Firefox 17 Test Plan </h1>
<h2> Summary </h2>
<table class="fullwidth-table">


= Firefox 17 Test Plan =
<tr>
== Summary ==
<td style="width:15%"> <b>Milestone</b>
{| class="fullwidth-table"
</td>
|-
<td> <a href="https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_17">Firefox 17</a>
| style="width:15%" | '''Milestone'''
</td></tr>
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_17 Firefox 17]
<tr>
|-
<td> <b>Status</b>
| '''Status'''
</td>
| Currently in '''Beta''' -- merging to Released on November 20, 2012
<td> Currently in <b>Beta</b> -- merging to Released on November 20, 2012
|-
</td></tr>
| '''Lead'''
<tr>
| [mailto:ahughes@mozilla.com Anthony Hughes] (irc: ashughes)
<td> <b>Lead</b>
|-
</td>
| '''2nd'''
<td> <a href="mailto:ahughes@mozilla.com">Anthony Hughes</a> (irc: ashughes)
| [mailto:jbecerra@mozilla.com Juan Becerra] (irc: juanb)
</td></tr>
|-
<tr>
| '''Builds'''
<td> <b>2nd</b>
| [ftp] [http] [web]
</td>
|}
<td> <a href="mailto:jbecerra@mozilla.com">Juan Becerra</a> (irc: juanb)
</td></tr>
<tr>
<td> <b>Builds</b>
</td>
<td> [ftp] [http] [web]
</td></tr></table>
<p>The following is the test plan for Firefox 17 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 17. After the release this document will be used as an archive of what was done to validate this release.
</p><p><i>If you have some free time, please pick a task below and get in touch with one of the leads.</i>
</p>
<h2> Details </h2>
<p>The following is a description of the tasks which need to be completed throughout this release.
</p>
<ul><li> 2012-07-16: <span class="fck_mw_template">{{done|}}</span> Nightly Merge
</li><li> 2012-08-27: <span class="fck_mw_template">{{done|}}</span> Aurora Merge
</li><li> 2012-10-08: <span class="fck_mw_template">{{done|}}</span> Pre-Beta feature sign-offs
</li><li> 2012-10-11: <span class="fck_mw_template">{{done|}}</span> Beta 1
</li><li> 2012-10-18: <span class="fck_mw_template">{{|}}</span> Beta 2
</li><li> 2012-10-25: <span class="fck_mw_template">{{|}}</span> Beta 3
</li><li> 2012-11-01: <span class="fck_mw_template">{{|}}</span> Beta 4
</li><li> 2012-11-08: <span class="fck_mw_template">{{|}}</span> Beta 5
</li><li> 2012-11-15: <span class="fck_mw_template">{{|}}</span> Beta 6
</li><li> 2012-11-19: <span class="fck_mw_template">{{|}}</span> Release Candidate
</li><li> 2012-11-20: <span class="fck_mw_template">{{|}}</span> Final
</li></ul>
<h2> Nightly </h2>
<h3> Merge </h3>
<dl><dt> Functional Automation - result
</dt></dl>
<dl><dt> Update Spotchecks - result
</dt></dl>
<h3> Features </h3>
<p><i>See the <a href="https://wiki.mozilla.org/Features/Release_Tracking">Feature Release Tracking</a> wiki for a general overview</i>
</p>
<h2> Features </h2>
<p><i>See the <a href="https://wiki.mozilla.org/Features/Release_Tracking">Feature Release Tracking</a> wiki for a general overview</i>
</p>
<table class="querytable">
<tr>
<td class="header"> Feature
</td>
<td class="header"> Owner
</td>
<td class="header"> Status
</td>
<td class="header"> Tests
</td></tr>
<tr>
<td> <a href="Improve display of location bar results"> Improve display of location bar results</a>
</td>
<td> Virgil Dicu
</td>
<td> On track
</td>
<td>
</td></tr>
<tr>
<td> <a href="Firefox Social Integration"> Firefox Social Integration</a>
</td>
<td> Anthony Hughes
</td>
<td> On track
</td>
<td>
</td></tr>
<tr>
<td> <a href="DevTools/Features/HTMLTreeEditor"> HTML Tree Editor</a>
</td>
<td> Mihaela Velimiroviciu
</td>
<td>
</td>
<td>
</td></tr>
<tr>
<td> <a href="Silent Update not now prompt"> Silent Update not now prompt</a>
</td>
<td> Ioana Budnar
</td>
<td> Release target removed.
</td>
<td>
</td></tr>
</table>
<h3> Endurance Automation </h3>
<p>The purpose of this section is to track any potential memory regressions via spikes reported in the dashboard.
</p>
<dl><dt> What to Do
</dt></dl>
<ol><li> Check the <a href="http://mozmill-ci.blargon7.com/#/endurance/charts?platform=All&amp;from=2012-07-17&amp;to=2012-08-27Endurance">Charts</a>
</li><li> If you see an anomalous event (ie. spike or dip), get the report for the specific event
</li><li> If the event happens twice in a row, file a bug under Mozmill Tests
</li><li> Notify <a href="mailto:ahughes@mozilla.com">Anthony Hughes</a> of the issue
</li><li> Record the event in this wiki below
</li></ol>
<dl><dt> Current Status (Mihaela Velimiroviciu) - Last Updated
</dt></dl>
<table class="bugzilla ui-helper-reset">
    <thead>
        <tr>
            <th>ID</th>
            <th>Summary</th>
            <th>Status</th>
            <th>Priority</th>
        </tr>
    </thead>
    <tbody>
           
    </tbody>
</table>
<p><br />
</p>
<h3> Functional Automation </h3>
<p>The purpose of this section is to track any potential functional regressions via results reported in the dashboard.
</p>
<dl><dt> What to Do
</dt></dl>
<ol><li> Check the <a href="http://mozmill-release.blargon7.com/#/functional/reports?branch=13.0&amp;platform=All&amp;from=2012-07-17&amp;to=2012-08-27">testrun reports</a>
</li><li> If you see any failing tests, check that there are not any <a href="http://bit.ly/wZL8zF">bugs on file</a> for it already
</li><li> If not, file a bug under Mozmill Tests
</li><li> Notify <a href="mailto:ahughes@mozilla.com">Anthony Hughes</a> of the issue
</li><li> Record the event in this wiki below
</li></ol>
<dl><dt> Current Status (Vlad Maniac / Alex Lakatos) - Last Updated
</dt></dl>
<p><br />
</p>
<h3> Bug Triage </h3>
<p>The purpose of this section is to triage UNCONFIRMED incoming bugs.
</p>
<dl><dt> What to Do
</dt></dl>
<ol><li> Check the <a href="http://bit.ly/Nk41Kd">UNCONFIRMED</a> bugs
</li><li> Test the bugs in the latest Firefox Nightly
</li><li> If you can't reproduce the bug, ask for the reporter to provide more information
</li><li> If you reproduce the bug, add your testing information and mark the bug NEW
</li><li> Notify <a href="mailto:ahughes@mozilla.com">Anthony Hughes</a> of the NEW issue
</li></ol>
<dl><dt> Current Status (SoftVision) - Last Updated
</dt></dl>
<p><a href="http://bit.ly/z2MmKE">Result Spreadsheet</a>
</p>
<h2> Aurora Merge </h2>
<dl><dt> NOTE - OSX 10.5 should not be able to install nor update to Firefox 17
</dt></dl>
<table class="querytable" style="width:30%">
<tr>
<td style="width:10%">
</td>
<td style="width:20%">
</td></tr>
<tr>
<td> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora">nightly</a>
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="https://hg.mozilla.org/releases/mozilla-aurora/tip">tip</a> (<a href="http://hg.mozilla.org/releases/mozilla-aurora/pushloghtml?fromchange=3317e776a8fa">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 16/Test Plan#Automated_Testing">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 16/Test Plan#Manual_Testing">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 16/Test Plan#Update_Testing">Update Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 16/Test Plan#Bug_Triage">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{ok|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:50%">


The following is the test plan for Firefox 17 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 17. After the release this document will be used as an archive of what was done to validate this release.
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> PASS: <a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-08-28&amp;to=2012-08-28">report</a>
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>N/A</b> (pending IT)
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>N/A</b> (pending IT)
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-08-28
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<h3> Manual Testing </h3>
<table class="querytable">
<tr>
<td class="header"> Operating System
</td>
<td class="header"> Tester
</td>
<td class="header"> Plug-in Compatibility
</td>
<td class="header"> Web Compatibility
</td>
<td class="header"> OSX 10.5 EOL
</td></tr>
<tr>
<td> Windows XP
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-08-29
</td>
<td> <b>PASS</b> - 2012-08-29
</td>
<td> <b>N/A</b>
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-08-29
</td>
<td> <b>PASS</b> - 2012-08-29
</td>
<td> <b>N/A</b>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>N/A</b>
</td></tr>
<tr>
<td> Mac OS X
</td>
<td> VladG
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>N/A</b>
</td></tr></table>
<h4> Plug-in Compatibility </h4>
<p>Install the following plug-ins and go to websites which use them, looking for rendering issues, functional issues, performance issues, and crashes.
</p>
<ul><li> Adobe Flash Player
<ul><li><a href="http://get.adobe.com/flashplayer/">11.4 Release</a> (make sure you can autoupdate)
</li></ul>
</li><li> <a href="http://www.microsoft.com/silverlight/">Microsoft Silverlight</a>
</li><li> <a href="http://www.real.com/">RealPlayer</a>
</li><li> <a href="http://www.apple.com/quicktime/download/">QuickTime</a>
</li></ul>
<h4> Web Compatibility </h4>
<p>Test the following websites for rendering issues, functional issues, performance issues, and crashes
</p>
<ol><li> <a href="http://www.alexa.com/topsites">Overall Top 10</a>
</li><li> <a href="http://www.alexa.com/topsites/countries">Top by Country</a> (pick a random site from three random countries)
</li><li> <a href="http://www.alexa.com/topsites/category">Top by Category</a> (pick a random site from three random categories)
</li><li> Webmail clients like gmail, hotmail, and yahoo mail (pay particular attention to any built in web messenger software)
</li><li> Try Google's <a href="http://support.google.com/maps/bin/answer.py?hl=en&amp;answer=1630790">MapsGL demo</a>
</li><li> Try YouTube's <a href="http://www.youtube.com/html5">HTML5 demo</a>
</li></ol>
<h4> OSX 10.5 EOL </h4>
<p>Verify the following:
</p>
<ol><li> Mac OSX 10.5 cannot download Firefox 17 (I'm not sure if this is scoped but try it anyway)
</li><li> Mac OSX 10.5 cannot start Firefox 17
</li><li> Mac OSX 10.5 cannot update to Firefox 17
</li></ol>
<ul><li>The build can be downloaded and installed
</li><li>Aurora didn't start, showing a incompatibility message
</li><li>The update channel seems to be close so I didn't manage to perform an update
</li></ul>
<h3> Feature Sign-offs </h3>
<ul><li> Log in to <a href="https://moztrap.mozilla.org">moztrap.mozilla.org</a>
</li><li> Select <i>Run Tests</i>
</li><li> Select <i>Product: Desktop Firefox</i>
</li><li> Select <i>Versions: 17</i>
</li><li> Select <i>Runs: Firefox 17 Aurora Merge Feature sign off</i>
</li></ul>
<table class="querytable">
<tr>
<td class="header"> Feature
</td>
<td class="header"> Owner
</td>
<td class="header"> Win32
</td>
<td class="header"> Mac
</td>
<td class="header"> Linux
</td></tr>
<tr>
<td> <a href="Improve display of location bar results"> Improve display of location bar results</a>
</td>
<td> Virgil Dicu
</td>
<td> <b>PASS</b>
</td>
<td> <b>PASS</b>
</td>
<td> <b>PASS</b>
</td></tr>
<tr>
<td> <a href="Firefox Social Integration"> Firefox Social Integration</a>
</td>
<td> Anthony Hughes
</td>
<td> <b>PASS</b>
</td>
<td> <b>PASS</b>
</td>
<td> <b>PASS</b>
</td></tr>
</table>
<dl><dt> Details
</dt></dl>
<p>Report any detailed results or bugs here...
</p>
<h3> Update Testing </h3>
<p>Spotcheck updates from a previous Aurora to Aurora 17.
</p>
<table class="querytable" style="width:60%">


''If you have some free time, please pick a task below and get in touch with one of the leads.''
<tr>
<td class="header"> Platform
</td>
<td class="header"> Auroratest
</td>
<td class="header"> Aurora
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-08-30
</td>
<td> <b>PASS</b> - 2012-08-30
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h3> Bug Triage </h3>
<ol><li> <a href="http://bit.ly/PpSpYM">VERIFYME</a> (5): verify the fix and do some exploratory testing around the issue
</li><li> <a href="http://bit.ly/Oo2Fx5">FIXED</a> (139): triage these bugs and test to ensure the fix is effective
</li><li> <a href="http://bit.ly/PMvtS3">QAWANTED</a> (6): triage these bugs and test to fulfill the QA request
</li><li> <a href="http://bit.ly/O0BA23">UNCONFIRMED</a> (8): triage these bugs for potential new regressions
</li></ol>
<dl><dt> Results
</dt></dl>
<ul><li> <a href="http://bit.ly/NvvsTU">VERIFIED</a>: 24/139
</li><li> <a href="http://bit.ly/OrtwXq">WONTVERIFY</a>: 3/139
</li><li> <a href="http://bit.ly/PZmJHO">HELPWANTED</a>:  9/139
</li></ul>
<h2> Beta 1 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <strike>#1: <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build1/">HTTP</a></strike> #2: <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build2/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b1-candidates/build2/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> <strike>#1: 20121009144933</strike> #2: 20121010150351
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/6b83222781e3">6b83222781e3</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=8a8a932fbef4&amp;tochange=6b83222781e3">pushlog</a>)
</td></tr></table>
<dl><dt> Advisory
</dt></dl>
<p>RelEng issues in generating the builds (see <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=796959#c5">bug 796959 comment 5</a>)
</p>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_2">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_2">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_2">Update Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{done|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


== Details ==
<tr>
The following is a description of the tasks which need to be completed throughout this release.
<td class="header" style="width:20%"> Platform
* 2012-07-16: {{done|}} Nightly Merge
</td>
* 2012-08-27: {{done|}} Aurora Merge
<td class="header" style="width:30%"> Build #1 Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-10-09&amp;to=2012-10-10">report</a>)
* 2012-10-08: {{done|}} Pre-Beta feature sign-offs
</td>
* 2012-10-11: {{done|}} Beta 1
<td class="header" style="width:30%"> Build #2 Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-10-10&amp;to=2012-10-11">report</a>)
* 2012-10-18: {{|}} Beta 2
</td></tr>
* 2012-10-25: {{|}} Beta 3
<tr>
* 2012-11-01: {{|}} Beta 4
<td> Windows XP
* 2012-11-08: {{|}} Beta 5
</td>
* 2012-11-15: {{|}} Beta 6
<td> <b>PASS</b> - 2012-10-09
* 2012-11-19: {{|}} Release Candidate
</td>
* 2012-11-20: {{|}} Final
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-09
</td>
<td> <b>PASS</b> - 2012-10-10
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<h3> Manual Testing </h3>
<p>Run the <a href="https://moztrap.mozilla.org/manage/cases/?filter-suite=114">Desktop Firefox Regression Tests</a> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p>
<table class="querytable">
<tr>
<td class="header"> Platform
</td>
<td class="header"> Tester
</td>
<td class="header"> Result
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Manuela, Ioana
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Mac OSX 10.7
</td>
<td> Ioana, Mihaela
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td colspan="3"> <b>Special Cases</b>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Update regression tests (requires updates on releasetest)
</td>
<td> ashughes
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr></table>
<h3> Update Testing </h3>
<ul><li> Partial: 16.0b6, 16.0b5
</li><li> Complete: &lt;= 16.0b4
</li></ul>
<table class="querytable" style="width:60%">


== Nightly ==
<tr>
=== Merge ===
<td class="header"> Platform
; Functional Automation - result
</td>
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-10-11&amp;to=2012-10-11&amp;target=17.0">report</a>)
</td>
<td class="header"> Beta (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=beta&amp;from=2012-10-11&amp;to=2012-10-12&amp;target=17.0">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h3> Feature Sign-off </h3>
<p>Feature owners to test and sign-off overall quality of their features following uplift to Beta.
</p>
<table class="querytable">
<tr>
<td class="header"> Feature
</td>
<td class="header"> Owner
</td>
<td class="header"> Win32
</td>
<td class="header"> Mac
</td>
<td class="header"> Linux
</td></tr>
<tr>
<td><a href="https://wiki.mozilla.org/Improve_display_of_location_bar_results">Improve display of location bar results</a>
</td>
<td> Virgil Dicu
</td>
<td> <i>n/a</i> release target should be updated
</td>
<td> <i>n/a</i> release target should be updated
</td>
<td> <i>n/a</i> release target should be updated
</td></tr>
<tr>
<td><a href="https://wiki.mozilla.org/DevTools/Features/HTMLTreeEditor">HTML tree editor</a>
</td>
<td> Mihaela Velimiroviciu
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td>
<td> <b>PASS</b> - 2012-10-11
</td></tr>
<tr>
<td><a href="https://wiki.mozilla.org/Firefox_Social_Integration">Firefox Social Integration</a>
</td>
<td> Anthony Hughes
</td>
<td> <b>n/a</b> - delayed to Beta 2
</td>
<td> <b>n/a</b> - delayed to Beta 2
</td>
<td> <b>n/a</b> - delayed to Beta 2
</td></tr>
</table>
<h3> Build #2 Verifications </h3>
<ul><li> <b>VERIFIED FIXED</b> <span class="fck_mw_template">{{bug|799952}}</span>
</li><li> <b>VERIFIED FIXED</b> <span class="fck_mw_template">{{bug|720619}}</span>
</li><li> <b>RESOLVED FIXED</b> <span class="fck_mw_template">{{bug|798045}}</span> (could not verify because could not be reproduced)
</li></ul>
<h2> Beta 2 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b2-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b2-candidates/build1/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> 20121017073013
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/2ba4becf6e35">2ba4becf6e35</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=6b83222781e3&amp;tochange=2ba4becf6e35">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_3">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_3">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{ok|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_3">Update Testing</a>
</li><li> <span class="fck_mw_template">{{ok|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{ok|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{ok|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


; Update Spotchecks - result
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-10-16&amp;to=2012-10-17">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-17
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<ul><li> testPrivateBrowsing/testDownloadManagerClosed.js (known)
</li></ul>
<h3> Manual Testing </h3>
<p>Run the <i>Firefox 17b2 Regression Tests</i> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p><p><a href="https://moztrap.mozilla.org/runtests/">Moztrap</a> &gt; Desktop Firefox &gt; 17 &gt; Firefox 17b2 Regression Tests &gt; Operating System &gt; Platform &gt; Run Tests
</p>
<table class="querytable">
<tr>
<td class="header"> Platform
</td>
<td class="header"> Tester
</td>
<td class="header"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=270">report</a>)
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td> Mac OSX 10.7
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td colspan="3"> <b>Special Cases</b>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
<tr>
<td> Update regression tests (requires updates on releasetest)
</td>
<td> ashughes
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr></table>
<h3> Update Testing </h3>
<ul><li> Partial: 17.0b1, 16.0b6
</li><li> Complete: &lt;=16.0b5
</li></ul>
<table class="querytable" style="width:60%">


=== Features ===
<tr>
''See the [https://wiki.mozilla.org/Features/Release_Tracking Feature Release Tracking] wiki for a general overview''
<td class="header"> Platform
</td>
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-10-17&amp;to=2012-10-18&amp;target=17.0">report</a>)
</td>
<td class="header"> Beta ([ report])
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr></table>
<dl><dt> Manual Spotchecks (due to Jenkins outage)
</dt></dl>
<table class="querytable">
<tr>
<td class="header"> Update
</td>
<td class="header"> Windows 7
</td>
<td class="header"> Windows 8
</td>
<td class="header"> Mac OSX 10.7
</td>
<td class="header"> Mac OSX 10.8
</td>
<td class="header"> Ubuntu 12.04
</td></tr>
<tr>
<td> 17.0b1 -&gt; 17.0b2 en-US
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 17.0b1 -&gt; 17.0b2 de
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 16.0b6 -&gt; 17.0b2 en-US
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 16.0b6 -&gt; 17.0b2 zh-TW
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 16.0b1 -&gt; 17.0b2 en-US
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 16.0b1 -&gt; 17.0b2 es-ES
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 15.0b6 -&gt; 17.0b2 en-US
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
<tr>
<td> 15.0b6 -&gt; 17.0b2 pt-BR
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td>
<td> <b>PASS</b> - 2012-10-22
</td></tr>
</table>
<dl><dt> Issues
</dt></dl>
<h3> Feature Sign-off </h3>
<p>Feature owners to test and sign-off overall quality of their features following uplift to Beta.
</p>
<table class="querytable">
<tr>
<td class="header"> Feature
</td>
<td class="header"> Owner
</td>
<td class="header"> Win32
</td>
<td class="header"> Mac
</td>
<td class="header"> Linux
</td></tr>
<tr>
<td><a href="https://wiki.mozilla.org/Firefox_Social_Integration">Firefox Social Integration</a>
</td>
<td> Anthony Hughes
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>PASS</b> - 2012-10-18
</td>
<td> <b>PASS</b> - 2012-10-18
</td></tr>
</table>
<dl><dt> Issues
</dt></dl>
<ul><li> Server-side issues not blocking 17b2 (should be fixed with next server-side push)
<ul><li> Like button activity not pushing to website
</li><li> Full page loading within panel (friends and notifications button)
</li></ul>
</li></ul>
<h2> Beta 3 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b3-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b3-candidates/build1/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> 20121023124120
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/f8a6138bcfba">f8a6138bcfba</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=2ba4becf6e35&amp;tochange=f8a6138bcfba">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_4">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_4">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_4">Update Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{done|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


== Features ==
<tr>
''See the [https://wiki.mozilla.org/Features/Release_Tracking Feature Release Tracking] wiki for a general overview''
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-10-23&amp;to=2012-10-24">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<ul><li> testPrivateBrowsing/testDownloadManagerClosed.js (known)
</li></ul>
<h3> Manual Testing </h3>
<p>Run the <i>Firefox 17b3 Regression Tests</i> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p><p><a href="https://moztrap.mozilla.org/runtests/">Moztrap</a> &gt; Desktop Firefox &gt; 17 &gt; Firefox 17b3 Regression Tests &gt; Operating System &gt; Platform &gt; Run Tests
</p>
<table class="querytable">
<tr>
<td class="header"> Platform
</td>
<td class="header"> Tester
</td>
<td class="header"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=278">report</a>)
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Mac OSX 10.7
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td colspan="3"> <b>Special Cases</b>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-10-24
</td></tr>
<tr>
<td> Update regression tests (requires updates on releasetest)
</td>
<td> ashughes
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr></table>
<h3> Bug Fix Verifications </h3>
<ul><li> <span class="fck_mw_template">{{bug|793969}}</span> - <b>verified</b> (mwobensmith)
</li><li> <span class="fck_mw_template">{{bug|801305}}</span> - <b>verified</b> (mwobensmith)
</li><li> <span class="fck_mw_template">{{bug|802557}}</span> - <b>verified</b> (mwobensmith)
</li><li> <span class="fck_mw_template">{{bug|803583}}</span> - <b>delayed to 17b4</b> (juanb)
</li><li> <span class="fck_mw_template">{{bug|803181}}</span> - <b>verified</b> (virgil)
</li></ul>
<h3> Update Testing </h3>
<ul><li> Partial: 17.0b2, 17.0b1
</li><li> Complete: &lt;=16.0b6
</li></ul>
<table class="querytable" style="width:60%">


{| class="querytable"
<tr>
| class="header" | Feature
<td class="header"> Platform
| class="header" | Owner
</td>
| class="header" | Status
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-10-23&amp;to=2012-10-24&amp;target=17.0">report</a>)
| class="header" | Tests
</td>
|-
<td class="header"> Beta ([ report])
| [[Improve display of location bar results| Improve display of location bar results]]
</td></tr>
| Virgil Dicu
<tr>
| On track
<td> Windows XP
|
</td>
|-
<td> <b>PASS</b> - 2012-10-24
| [[Firefox Social Integration| Firefox Social Integration]]
</td>
| Anthony Hughes
<td> <b>result</b> - YYYY-MM-DD
| On track
</td></tr>
|
<tr>
|-
<td> Windows Vista
| [[DevTools/Features/HTMLTreeEditor| HTML Tree Editor]]
</td>
| Mihaela Velimiroviciu
<td> <b>PASS</b> - 2012-10-24
|
</td>
|
<td> <b>result</b> - YYYY-MM-DD
|-
</td></tr>
| [[Silent Update not now prompt| Silent Update not now prompt]]
<tr>
| Ioana Budnar
<td> Windows 7 32-bit
| Release target removed.
</td>
|
<td> <b>PASS</b> - 2012-10-24
|-
</td>
|}
<td> <b>result</b> - YYYY-MM-DD
=== Endurance Automation ===
</td></tr>
The purpose of this section is to track any potential memory regressions via spikes reported in the dashboard.
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-10-24
</td>
<td> <b>result</b> - YYYY-MM-DD
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h2> Beta 4 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b4-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b4-candidates/build1/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> 20121031065642
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/486335dcb4a2">486335dcb4a2</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=f8a6138bcfba&amp;tochange=486335dcb4a2">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_5">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_5">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_5">Update Testing</a>
</li><li> <span class="fck_mw_template">{{ok|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{done|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


; What to Do
<tr>
# Check the [http://mozmill-ci.blargon7.com/#/endurance/charts?platform=All&from=2012-07-17&to=2012-08-27Endurance Charts]
<td class="header" style="width:20%"> Platform
# If you see an anomalous event (ie. spike or dip), get the report for the specific event
</td>
# If the event happens twice in a row, file a bug under Mozmill Tests
<td class="header" style="width:30%"> Results (<a href="http://mozmill-ondemand.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-11-01&amp;to=2012-11-01">report</a>)
# Notify [mailto:ahughes@mozilla.com Anthony Hughes] of the issue
</td></tr>
# Record the event in this wiki below
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<ul><li> testPrivateBrowsing/testDownloadManagerClosed.js (known)
</li></ul>
<h3> Manual Testing </h3>
<p>Run the <i>Firefox 17b4 Regression Tests</i> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p><p><a href="https://moztrap.mozilla.org/runtests/">Moztrap</a> &gt; Desktop Firefox &gt; 17 &gt; Firefox 17b4 Regression Tests &gt; Operating System &gt; Platform &gt; Run Tests
</p>
<dl><dt> If you have an AMD or NVIDIA graphics card, please install the Beta drivers during your testing
</dt></dl>
<ul><li> AMD Catalyst 12.11 Beta (<a href="http://support.amd.com/us/kbarticles/Pages/AMDCatalyst1211betadriver.aspx">download</a>)
<ul><li> AMD Catalyst 12.11 Beta  graphics driver is not available for Mac OS X.
</li></ul>
</li><li> NVidia GeForce 310.33 Beta (<a href="http://www.geforce.com/drivers/results/50291">download</a>)
<ul><li> NVidia GeForce 310.33 Beta graphics driver is not compatible with Windows 8.
</li><li> NVidia GeForce 310.33 Beta graphics driver is not available for Mac OS X.
</li></ul>
</li><li> <i>keep your eye out for rendering issues and crashes</i>
</li></ul>
<table class="querytable">
<tr>
<td class="header"> Platform
</td>
<td class="header"> Tester
</td>
<td class="header"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=295">report</a>)
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Mac OSX 10.7
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td colspan="3"> <b>Special Cases</b>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-01
</td></tr>
<tr>
<td> Update regression tests (requires updates on releasetest)
</td>
<td> ashughes
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr></table>
<h3> Bug Fix Verifications </h3>
<ul><li> <span class="fck_mw_template">{{bug|803583}}</span> - <b>verified</b> (juanb)
</li><li> <span class="fck_mw_template">{{bug|776247}}</span> - <b>verified</b> (jsmith)
</li><li> <span class="fck_mw_template">{{bug|806991}}</span> - <b>n/a</b> - to be tested after 17b4 is live (ashughes)
</li></ul>
<h3> Update Testing </h3>
<ul><li> Partial: 17.0b3, 17.0b2
</li><li> Complete: &lt;=17.0b1
</li></ul>
<table class="querytable" style="width:60%">


; Current Status (Mihaela Velimiroviciu) - Last Updated
<tr>
<bugzilla>
<td class="header"> Platform
{
</td>
"id":
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-11-02&amp;to=2012-11-02&amp;target=17.0">report</a>)
}
</td>
</bugzilla>
<td class="header"> Beta (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=beta&amp;from=2012-11-02&amp;to=2012-11-02&amp;target=17.0">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-11-02
</td>
<td> <b>PASS</b> - 2012-11-02
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h2> Beta 5 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b5-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b5-candidates/build1/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> 20121106195758
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/036da70b61f9">036da70b61f9</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=486335dcb4a2&amp;tochange=036da70b61f9">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_6">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_6">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_6">Update Testing</a>
</li><li> <span class="fck_mw_template">{{ok|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{done|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


=== Functional Automation ===
<tr>
The purpose of this section is to track any potential functional regressions via results reported in the dashboard.  
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-11-06&amp;to=2012-11-07">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-11-06
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<h3> Manual Testing </h3>
<dl><dt> Special Instructions
</dt></dl>
<p>While testing this Beta, please install the latest <a href="http://support.amd.com/us/gpudownload/Pages/index.aspx">AMD</a> or <a href="http://www.geforce.com/drivers/beta-legacy">NVidia</a> beta drivers (if you have a GPU) and <a href="http://download.macromedia.com/pub/flashplayer/installers/archive/fp_11.5.502.110_archive.zip">Flash 11.5</a> (if you are on Windows). Report any visual problems, crashes, or hangs in Bugzilla and add them to the New Issues section below.
</p>
<h4> Regression Tests </h4>
<p>Run the <i>Firefox 17b5 Regression Tests</i> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p><p><a href="https://moztrap.mozilla.org/runtests/">Moztrap</a> &gt; Desktop Firefox &gt; 17 &gt; Firefox 17b5 Regression Tests &gt; Operating System &gt; Platform &gt; Run Tests
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=316">report</a>)
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr>
<tr>
<td> Update regression tests
</td>
<td> ashughes
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td>
</td></tr></table>
<h4> Social API </h4>
<p>In addition to normal dogfooding (sidebar, activity stream, chat, toolbar), please heavily focus on testing around Private Browsing. In this Beta, the Social API should be disabled in Private Browsing mode. Test to make sure Social API cannot be enabled in Private Browsing, your Social API session is restored when exiting Private Browsing, and that Private Browsing mode works as per normal for all other use cases (Bookmarks, History, Cache, Logins, Cookies, etc)
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-08
</td>
<td> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=807217#c43">807217#c43</a> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=807675#c3">807675#c3</a>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-08
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-11-08
</td>
<td> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=807217#c45">807217#c45</a>
</td></tr></table>
<h4> Click-to-Play </h4>
<p>Firefox 17 includes a click-to-play blocking feature which should show an overlay when plug-in content loads. Clicking the overlay should play the content. This feature has not been deployed for all plug-ins however. Flash &lt;=11.3, Java 7 &lt;=7u8, Java 6 &lt;=6u36, Reader &lt;=10.1.3, Silverlight &lt;=5.1.10410.0 should all be CTP blocked. All the latest versions of the plug-ins should not be blocked.
</p><p>Recent regressions indicate not all sites respect CTP blocking (CNN and LA Times for example). Please check various websites with plug-in content. If you can, work through the <a href="https://wiki.mozilla.org/QA/Plugins/CTP_TopSites#Test_results">top-100 list</a> and fill in that table with your results. However, don't be afraid to go outside that list if there are other sites you can think of.
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Virgil, Manuela
</td>
<td> <b>FAIL</b> - 2012-11-07
</td>
<td> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809792">809792</a>, <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809858">809858</a>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Manuela, Paul
</td>
<td> <b>FAIL</b> - 2012-11-07
</td>
<td> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809792">809792</a>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Ioana, Paul
</td>
<td> <b>FAIL</b> - 2012-11-08
</td>
<td> <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809785">809785</a>, <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809793">809793</a>, <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=809860">809860</a>
</td></tr></table>
<h3> Bug Fix Verifications </h3>
<ul><li> <b>Reopened</b> <span class="fck_mw_template">{{bug|788423}}</span> (ioanab)
</li><li> <b>Verified</b> <span class="fck_mw_template">{{bug|796039}}</span> (psilaghi)
</li><li> <b>Verified</b> <span class="fck_mw_template">{{bug|797163}}</span> (mwobensmith)
</li><li> <b>Pending</b> <span class="fck_mw_template">{{bug|807217}}</span> (ashughes) -- Facebook outage, should be resolved by 5pm Wednesday
</li></ul>
<h3> Update Testing </h3>
<ul><li> Partial: 17.0b4, 17.0b3
</li><li> Complete: &lt;=17.0b2
</li></ul>
<table class="querytable" style="width:60%">


; What to Do
<tr>
# Check the [http://mozmill-release.blargon7.com/#/functional/reports?branch=13.0&platform=All&from=2012-07-17&to=2012-08-27 testrun reports]
<td class="header"> Platform
# If you see any failing tests, check that there are not any [http://bit.ly/wZL8zF bugs on file] for it already
</td>
# If not, file a bug under Mozmill Tests
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-11-07&amp;to=2012-11-08&amp;target=17.0">report</a>)
# Notify [mailto:ahughes@mozilla.com Anthony Hughes] of the issue
</td>
# Record the event in this wiki below
<td class="header"> Beta (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=All&amp;channel=beta&amp;from=2012-11-07&amp;to=2012-11-08&amp;target=17.0">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-11-07
</td>
<td> <b>PASS</b> - 2012-11-08
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h2> Beta 6 </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b6-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0b6-candidates/build1/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> 20121113065533
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <a href="http://hg.mozilla.org/releases/mozilla-beta/rev/0dbbf9b3175c">0dbbf9b3175c</a> (<a href="http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=036da70b61f9&amp;tochange=0dbbf9b3175c">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist
</dt></dl>
<ul><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_7">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_7">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_7">Update Testing</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{done|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{|}}</span> Final sign-off sent and updates qualified on Beta channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


; Current Status (Vlad Maniac / Alex Lakatos) - Last Updated
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-11-12&amp;to=2012-11-13">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>4 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>0 failures</b> - 2012-11-12
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<ul><li> <span class="fck_mw_template">{{bug|811407}}</span> Awesomebar tests failed for 17.0b6 candidate on Windows XP resulting in Disconnect error
</li></ul>
<h3> Manual Testing </h3>
<dl><dt> Special Instructions
</dt></dl>
<p>While testing this Beta, please install the latest <a href="http://support.amd.com/us/gpudownload/Pages/index.aspx">AMD</a> or <a href="http://www.geforce.com/drivers/beta-legacy">NVidia</a> beta drivers (if you have a GPU) and <a href="http://download.macromedia.com/pub/flashplayer/installers/archive/fp_11.5.502.110_archive.zip">Flash 11.5</a> (if you are on Windows). Report any visual problems, crashes, or hangs in Bugzilla and add them to the New Issues section below.
</p>
<h4> Regression Tests </h4>
<p>Run the <i>Firefox 17b6 Regression Tests</i> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p><p><a href="https://moztrap.mozilla.org/runtests/">Moztrap</a> &gt; Desktop Firefox &gt; 17 &gt; Firefox 17b6 Regression Tests &gt; Operating System &gt; Platform &gt; Run Tests
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=327">report</a>)
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Update regression tests
</td>
<td> ashughes
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr></table>
<h4> Awesomebar </h4>
<p>Check the Awesomebar for potential regressions. In particular, bookmarking, searching, filtering, security information, and switch-to-tab.
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows XP
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr></table>
<h4> Private Browsing </h4>
<p>Test Private Browsing mode and check for any potential regressions. In particular history, session and cache leaking into the normal browsing session.
</p>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows XP
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Virgil
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td>
</td></tr></table>
<h3> Bug Fix Verifications </h3>
<p>Downloads Panel
</p>
<ul><li> <b>verified</b> <span class="fck_mw_template">{{bug|809022}}</span> (simonab)
</li></ul>
<p>Social API
</p>
<ul><li> <b>verified</b> <span class="fck_mw_template">{{bug|808116}}</span> (ashughes)
</li></ul>
<p>VERIFYME (<a href="http://bit.ly/OXHDtn">bugs</a>) - <i>aiming to verify all blocker/critical/major bugs</i>
</p>
<ul><li> <b>verified</b> <span class="fck_mw_template">{{bug|766616}}</span> (ioana)
</li><li> <b>verified</b> <span class="fck_mw_template">{{bug|680644}}</span> (virgil)
</li><li> <b>verified</b> <span class="fck_mw_template">{{bug|774250}}</span> (paul)
</li></ul>
<h3> Update Testing </h3>
<ul><li> Partial: 17.0b5, 17.0b4
</li><li> Complete: &lt;=17.0b3
</li></ul>
<table class="querytable" style="width:60%">


<tr>
<td class="header"> Platform
</td>
<td class="header"> Releasetest (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=releasetest&amp;from=2012-11-14&amp;to=2012-11-14&amp;target=17.0">report</a>)
</td>
<td class="header"> Beta (<a href="http://mozmill-ondemand.blargon7.com/#/update/detail?branch=17.0&amp;channel=beta&amp;from=2012-11-14&amp;to=2012-11-14&amp;target=17.0">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>PASS</b> - 2012-11-14
</td>
<td> <b>PASS</b> - 2012-11-14
</td></tr></table>
<dl><dt> Issues
</dt></dl>
<h2> Release Candidate </h2>
<table class="querytable" style="width:50%">
<tr>
<td style="width:10%"> <b>Builds</b>
</td>
<td> <strike><a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build1/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build1/">HTTP</a></strike> <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build2/">FTP</a>, <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/17.0-candidates/build2/">HTTP</a>
</td></tr>
<tr>
<td> <b>ID</b>
</td>
<td> <strike>20121116115405</strike> 20121119183901
</td></tr>
<tr>
<td> <b>Changeset</b>
</td>
<td> <strike><a href="http://hg.mozilla.org/releases/mozilla-release/rev/0af23f8db35d">0af23f8db35d</a> (<a href="http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=3995ff235342&amp;tochange=0af23f8db35d">pushlog</a>)</strike> <a href="http://hg.mozilla.org/releases/mozilla-release/rev/919435c6f654">919435c6f654</a> (<a href="http://hg.mozilla.org/releases/mozilla-release/pushloghtml?fromchange=0af23f8db35d&amp;tochange=919435c6f654">pushlog</a>)
</td></tr></table>
<dl><dt> Checklist (respin for <span class="fck_mw_template">{{bug|813264}}</span>)
</dt></dl>
<ul><li> <span class="fck_mw_template">{{|}}</span> <a href="Releases/Firefox 17/Test Plan#Automated_Testing_8">Automated Testing</a>
</li><li> <span class="fck_mw_template">{{|}}</span> <a href="Releases/Firefox 17/Test Plan#Manual_Testing_8">Manual Testing</a>
</li><li> <span class="fck_mw_template">{{|}}</span> <a href="Releases/Firefox 17/Test Plan#Update_Testing_8">Update Testing</a>
</li><li> <span class="fck_mw_template">{{|}}</span> <a href="Releases/Firefox 17/Test Plan#Bugs">Bug Triage</a>
</li><li> <span class="fck_mw_template">{{|}}</span> Peer Sign-off
</li><li> <span class="fck_mw_template">{{|}}</span> Final sign-off sent and updates qualified on Release channel
</li></ul>
<h3> Automated Testing </h3>
<p>The following are the detailed results of the automated Mozmill test runs.
</p>
<table class="querytable" style="width:60%">


=== Bug Triage ===
<tr>
The purpose of this section is to triage UNCONFIRMED incoming bugs.  
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:30%"> Build#1 Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&amp;platform=All&amp;from=2012-11-16&amp;to=2012-11-17">report</a>)
</td>
<td class="header" style="width:30%"> Build#2 Results (<a href="http://mozmill-ci.blargon7.com/#/functional/reports?branch=All&amp;platform=All&amp;from=2012-11-20&amp;to=2012-11-20">report</a>)
</td></tr>
<tr>
<td> Windows XP
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>1 failure</b> - 2012-11-19
</td></tr>
<tr>
<td> Windows Vista
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Windows 7 32-bit
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Windows 7 64-bit
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Windows 8 32-bit
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Windows 8 64-bit
</td>
<td> <b>PASS</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Mac OS X 10.6
</td>
<td> <b>1 failure</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Mac OS X 10.7
</td>
<td> <b>1 failure</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Mac OS X 10.8
</td>
<td> <b>2 failures</b> - 2012-11-16
</td>
<td> <b>1 failure</b> - 2012-11-19
</td></tr>
<tr>
<td> Ubuntu 12.04 32-bit
</td>
<td> <b>1 failure</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr>
<tr>
<td> Ubuntu 12.04 64-bit
</td>
<td> <b>1 failure</b> - 2012-11-16
</td>
<td> <b>PASS</b> - 2012-11-19
</td></tr></table>
<dl><dt> Test Failures (<a href="https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA">known bugs</a>)
</dt></dl>
<ul><li> Build 1
<ul><li> /restartTests/testAddons_uninstallExtension/test4.js - Shutdown expected but none detected before end of test (<span class="fck_mw_template">{{bug|783484}}</span>)
</li><li> /testPreferences/testPreferredLanguage.js -could not find element Link: Documenti (<span class="fck_mw_template">{{bug|812435}}</span>)
</li></ul>
</li><li> Build 2
<ul><li> /testAwesomeBar/testSuggestHistory.js (<span class="fck_mw_template">{{bug|813449}}</span>)
</li><li> /restartTests/testAddons_uninstallExtension/test4.js (<span class="fck_mw_template">{{bug|783484}}</span>)
</li></ul>
</li></ul>
<h3> Manual Testing </h3>
<h4> Regression Tests </h4>
<p>Run the <a href="https://moztrap.mozilla.org/runtests/environment/395/">Firefox 17 Regression Tests</a> in MozTrap and report the results below. Do some exploratory testing around the testcases to try to exercise some edge-cases.
</p>
<dl><dt> Build 1 Results
</dt></dl>
<table class="querytable">
<tr>
<td class="header" style="width:20%"> Platform
</td>
<td class="header" style="width:20%"> Tester
</td>
<td class="header" style="width:20%"> Result (<a href="https://moztrap.mozilla.org/results/cases/?filter-run=395">report</a>)
</td>
<td class="header" style="width:40%"> Bugs
</td></tr>
<tr>
<td> Windows 7
</td>
<td> Manuela
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr>
<tr>
<td> Windows 8
</td>
<td> Simona
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.8
</td>
<td> Paul
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr>
<tr>
<td> Ubuntu 12.04
</td>
<td> Mihaela
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr>
<tr>
<td> Mac OSX 10.5 de-support
</td>
<td> Ioana
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr>
<tr>
<td> Update regression tests
</td>
<td>
</td>
<td> <b>PASS</b> - 2012-11-19
</td>
<td>
</td></tr></table>
<dl><dt> Build 2 Results
</dt></dl>
<p>Conduct focused regression testing around third-party binary add-ons and exploratory testing around web compatibility.
Yandex, AVG, Bandoo, and Skype are some add-ons to test, but try to test outside that scope and find some other third-party binary add-ons. In terms of websites, try some of the <a href="http://www.alexa.com/topsites">Alexa Top-sites</a> but also try to visit sites you might normally use outside of that scope (banking, video, webmail, news, games, etc).
</p>
<ul><li> [<b>FAIL</b>] Windows 7 (Manuela, Ioana)
<ul><li> Addons Tested:
<ul><li>Hotspot Shield - PASS
</li><li>Bandoo for Firefox - PASS
</li><li>Skype Click to Call - <b>FAIL</b>: this addon is present in Firefox, but it doesn't work at all (after being forced as compatible and enabled). No phone numbers are highlighted (although they were when opening the same profile/pages etc in Firefox 15.0.1).
</li><li>Yandex Toolbar - PASS
<ul><li>Although none of the addons provoked problems by themselves, using Firefox with all the above addons installed is very difficult: Firefox, or sometimes the whole OS, freezes intermittently.
</li></ul>
</li></ul>
</li><li> Websites Tested: facebook.com, amazon.com, twitter.com, qq.com, live.com, wikipedia.org, google.com, yahoo.com, baidu.com, youtube.com, miniclip.com, trailers.apple.com - PASS
</li><li> Scenarios Tested: tested the addons for basic functionality, tested the websites for functionality, rendering and performance issues (with the addons installed).
</li></ul>
</li><li> [<b>result</b>] Windows 8 (Simona)
<ul><li> Addons Tested:
<ul><li>BitTorrentBar - Pass
</li><li>Facebook Toolbar - Pass
</li><li>IncrediMail MediaBar 2 - Pass
</li><li>Yahoo! Toolbar - Pass
</li><li>Yandex Community Toolbar - Pass
</li><li>Bandoo for Firefox 5.1.
</li></ul>
</li><li> Websites Tested:
<ul><li> http://www.google.ro/
</li><li> http://www.facebook.com
</li><li> http://ro.yahoo.com/?p=us
</li><li> http://www.baidu.com/
</li><li> http://www.wikipedia.org/
</li><li> https://snt139.mail.live.com/default.aspx?rru=home&amp;livecom=1
</li><li> http://www.msn.com/
</li><li> http://www.bing.com/
</li></ul>
</li><li> Scenarios Tested: tested the add-ons basic functionality and websites rendering issue having all the add-ons enabled
</li></ul>
</li><li> [<b>FAIL</b>] Mac OSX 10.8 (Paul)
<ul><li> Addons Tested:
<ul><li>Skype Click to Call - N/A for Firefox on Mac
</li><li>Bandoo - N/A on Mac
</li><li>http://www.siteadvisor.com/download/ff_preinstall.html - Pass
</li><li>http://bittorrentbar.ourtoolbar.com/ - Pass
</li><li>http://pages.tvunetworks.com/downloads/player.html - Pass
</li><li>Facebook Toolbar - Pass
</li><li>Yahoo! Toolbar - Pass
</li><li>http://downloadmytoolbar.com/4shared/LP/download.html - FAIL (firefox totally freezes)
</li><li>http://incredimailmediabar2.ourtoolbar.com/ - FAIL (firefox totally freezes)
</li><li>yandex http://ct57527.ourtoolbar.com/ - FAIL (firefox totally freezes)
</li><li>http://hotspotshield.ourtoolbar.com/ - FAIL (firefox totally freezes)
</li></ul>
</li><li> Websites Tested:
</li><li> Scenarios Tested: 
</li></ul>
</li><li> [<b>FAIL</b>] Ubuntu 12.04 (Mihaela)
<ul><li> Addons Tested:
<ul><li> 4shared.com Community Toolbar3.15.1.0 - unstable, new tabs opened from + button are not shown until a browser restart
</li><li> BitTorrentBar Community Toolbar3.15.1.0 - PASS
</li><li> Facebook Toolbar1.8.2 - PASS
</li><li> Hotspot Shield Community Toolbar3.15.1.0 - breaks session restore (restore previous session button not displayed in about:home page, nor under History menu)
</li><li> IncrediMail MediaBar 2 Community Toolbar3.15.1.0 - unstable, new tabs opened from + button are not shown until a browser restart
</li><li> McAfee SiteAdvisor28.0
</li><li> Yahoo! Toolbar2.5.1.20121012015120 - PASS
</li><li> Yandex Community Toolbar3.15.1.0
</li></ul>
</li><li> Websites Tested: google.com, facebook.com, www.youtube.com (flash and html), maps.google.com, mail.yahoo.com, yahoo.com
</li><li> Scenarios Tested: install/enable/disable add-on, enable/disable toolbar, add-ons basic functionality, websites basic functionality, pinned tabs
</li></ul>
</li><li> Issues Found:
<ul><li>
</li></ul>
</li></ul>
<p>Additional Spotchecks
</p>
<ul><li> [<b>result</b>] Mac OSX 10.5 Desupport (tester)
</li></ul>
<h3> Bug Fix Verifications </h3>
<p>VERIFYME (<a href="http://bit.ly/OXHDtn">bugs</a>) - <i>aiming to verify all blocker/critical/major bugs</i>
</p><p>QAWANTED
</p>
<ul><li> <span class="fck_mw_template">{{bug|675260}}</span> crash in DefaultFreeEntry coming from ShutdownNSS (ashughes)
</li><li> <span class="fck_mw_template">{{bug|770238}}</span> Fatal jemalloc assertion in js::gc::Arena::finalize&lt;JSString&gt; (marcia)
</li><li> <span class="fck_mw_template">{{bug|812307}}</span> crash in DataMngrHlpFF17.dll @ nsVoidArray::~nsVoidArray (juanb)
</li><li> <span class="fck_mw_template">{{bug|812456}}</span> Extension block request: DataMngr (virgil)
</li><li> <span class="fck_mw_template">{{bug|812683}}</span> Win7 startup crash in d3d11.dll (after installing IE10?) (ioana)
</li></ul>
<h3> Update Testing </h3>
<ul><li> Partial:
</li><li> Complete:
</li></ul>
<table class="querytable" style="width:60%">


; What to Do
<tr>
# Check the [http://bit.ly/Nk41Kd UNCONFIRMED] bugs
<td class="header"> Platform
# Test the bugs in the latest Firefox Nightly
</td>
# If you can't reproduce the bug, ask for the reporter to provide more information
<td class="header"> betatest ([ report])
# If you reproduce the bug, add your testing information and mark the bug NEW
</td>
# Notify [mailto:ahughes@mozilla.com Anthony Hughes] of the NEW issue
<td class="header"> releasetest ([ report])
 
</td>
; Current Status (SoftVision) - Last Updated
<td class="header"> release ([ report])
[http://bit.ly/z2MmKE Result Spreadsheet]
</td></tr>
 
<tr>
== Aurora Merge ==
<td> Windows XP
; NOTE - OSX 10.5 should not be able to install nor update to Firefox 17
</td>
 
<td> <b>result</b> - YYYY-MM-DD
{| class="querytable" style="width:30%"
</td>
| style="width:10%" |
<td> <b>result</b> - YYYY-MM-DD
| style="width:20%" |
</td>
|-
<td> <b>result</b> - YYYY-MM-DD
| '''Builds'''
</td></tr>
| [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora nightly]
<tr>
|-
<td> Windows Vista
| '''Changeset'''
</td>
| [https://hg.mozilla.org/releases/mozilla-aurora/tip tip] ([http://hg.mozilla.org/releases/mozilla-aurora/pushloghtml?fromchange=3317e776a8fa pushlog])
<
|}
 
; Checklist
* {{done|}} [[Releases/Firefox_16/Test_Plan#Automated_Testing|Automated Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Manual_Testing|Manual Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Update_Testing|Update Testing]]
* {{done|}} [[Releases/Firefox_16/Test_Plan#Bug_Triage|Bug Triage]]
* {{done|}} Peer Sign-off
* {{ok|}} Final sign-off sent and updates qualified on Beta channel
 
=== Automated Testing ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:50%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | PASS: [http://mozmill-ci.blargon7.com/#/functional/reports?branch=17.0&platform=All&from=2012-08-28&to=2012-08-28 report]
|-
| Windows XP
| '''PASS''' - 2012-08-28
|-
| Windows Vista
| '''PASS''' - 2012-08-28
|-
| Windows 7 32-bit
| '''PASS''' - 2012-08-28
|-
| Windows 7 64-bit
| '''PASS''' - 2012-08-28
|-
| Windows 8 32-bit
| '''N/A''' (pending IT)
|-
| Windows 8 64-bit
| '''N/A''' (pending IT)
|-
| Mac OS X 10.6
| '''PASS''' - 2012-08-28
|-
| Mac OS X 10.7
| '''PASS''' - 2012-08-28
|-
| Mac OS X 10.8
| '''PASS''' - 2012-08-28
|-
| Ubuntu 12.04 32-bit
| '''PASS''' - 2012-08-28
|-
| Ubuntu 12.04 64-bit
| '''PASS''' - 2012-08-28
|}
 
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
 
=== Manual Testing ===
{| class="querytable"
| class="header" | Operating System
| class="header" | Tester
| class="header" | Plug-in Compatibility
| class="header" | Web Compatibility
| class="header" | OSX 10.5 EOL
|-
| Windows XP
| Simona
| '''PASS''' - 2012-08-29
| '''PASS''' - 2012-08-29
| '''N/A'''
|-
| Windows 7
| Ioana
| '''PASS''' - 2012-08-29
| '''PASS''' - 2012-08-29
| '''N/A'''
|-
| Windows 8
| Paul
| '''PASS''' - 2012-08-30
| '''PASS''' - 2012-08-30
| '''N/A'''
|-
| Mac OS X
| VladG
| '''PASS''' - 2012-08-30
| '''PASS''' - 2012-08-30
| '''PASS''' - 2012-08-30
|-
| Ubuntu 12.04
| Ioana
| '''PASS''' - 2012-08-30
| '''PASS''' - 2012-08-30
| '''N/A'''
|}
 
==== Plug-in Compatibility ====
Install the following plug-ins and go to websites which use them, looking for rendering issues, functional issues, performance issues, and crashes.
* Adobe Flash Player
**[http://get.adobe.com/flashplayer/ 11.4 Release] (make sure you can autoupdate)
* [http://www.microsoft.com/silverlight/ Microsoft Silverlight]
* [http://www.real.com/ RealPlayer]
* [http://www.apple.com/quicktime/download/ QuickTime]
 
==== Web Compatibility ====
Test the following websites for rendering issues, functional issues, performance issues, and crashes
# [http://www.alexa.com/topsites Overall Top 10]
# [http://www.alexa.com/topsites/countries Top by Country] (pick a random site from three random countries)
# [http://www.alexa.com/topsites/category Top by Category] (pick a random site from three random categories)
# Webmail clients like gmail, hotmail, and yahoo mail (pay particular attention to any built in web messenger software)
# Try Google's [http://support.google.com/maps/bin/answer.py?hl=en&answer=1630790 MapsGL demo]
# Try YouTube's [http://www.youtube.com/html5 HTML5 demo]
 
==== OSX 10.5 EOL ====
Verify the following:
# Mac OSX 10.5 cannot download Firefox 17 (I'm not sure if this is scoped but try it anyway)
# Mac OSX 10.5 cannot start Firefox 17
# Mac OSX 10.5 cannot update to Firefox 17
 
*The build can be downloaded and installed
*Aurora didn't start, showing a incompatibility message
*The update channel seems to be close so I didn't manage to perform an update
 
=== Feature Sign-offs ===
* Log in to [https://moztrap.mozilla.org moztrap.mozilla.org]
* Select ''Run Tests''
* Select ''Product: Desktop Firefox''
* Select ''Versions: 17''
* Select ''Runs: Firefox 17 Aurora Merge Feature sign off''
 
{| class="querytable"
| class="header
MihaelaV
Confirmed users
1,107

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/488836"

Navigation menu