Releases/Firefox 17 ESR/Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 100: Line 100:
* '''NEW''' {{bug|760417}} - Full-screen button visible in pop-out full-screen mode (ioana)
* '''NEW''' {{bug|760417}} - Full-screen button visible in pop-out full-screen mode (ioana)
* '''NEW''' {{bug|708557}} - Html5 youtube context menu not persistent when right clicking (virgil)
* '''NEW''' {{bug|708557}} - Html5 youtube context menu not persistent when right clicking (virgil)
== Firefox ''17.0.1'' ESR ==
{| class="querytable" style="width:30%"
| style="width:10%" |
| style="width:20%" |
|-
| '''Builds'''
| [ftp://link_to_candidate_builds FTP], [http://link_to_candidate_builds HTTP]
|-
| '''ID'''
| numeric build id
|-
| '''Changeset'''
| [http://link_to_hg_changeset changesetID] ([http://link_to_hg_pushlog pushlog])
|}
; Checklist
* {{ |}} Functional automation
* {{ |}} Manual tests
* {{ |}} Bug fix verifications
* {{ |}} Update automation
* {{ |}} Peer sign-off
* {{ |}} Updates pushed/tested on ESR channel
=== Automated Tests ===
The following are the detailed results of the automated Mozmill test runs.
{|class="querytable" style="width:50%"
|-
| class="header" style="width:20%" | Platform
| class="header" style="width:30%" | Results: [http://link_to_mozmill_ci_report report]
|-
| Windows 2000
| '''result''' - YYYY-MM-DD
|-
| Windows XP
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''result''' - YYYY-MM-DD
|}
; Test Failures ([https://bugzilla.mozilla.org/buglist.cgi?list_id=3007328;status_whiteboard_type=allwordssubstr;query_format=advanced;status_whiteboard=mozmill-test-failure;bug_status=NEW;bug_status=ASSIGNED;component=Mozmill%20Tests;product=Mozilla%20QA known bugs])
=== Manual Smoketests ===
Run the '''[https://moztrap.mozilla.org/runtests/ Firefox ESR ''version'' Smoketests]''' in MozTrap and report the results below.
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Assignee
| class="header" | Result: [https://link_to_moztrap_report report]
|-
| Windows 2000
| tester
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| tester
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| tester
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| tester
| '''result''' - YYYY-MM-DD
|}
=== Update Testing ===
* Partial: ''versions receiving partial updates''
* Complete: ''versions receiving complete updates''
{|class="querytable" style="width:60%"
|-
| class="header" | Platform
| class="header" | Releasetest: [https://link_to_mozmill_ondemand_report report]
| class="header" | ESR: [https://link_to_mozmill_ondemand_report report]
|-
| Windows 2000
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows XP
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows Vista
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 7 32-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Windows 7 64-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.6
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Mac OS X 10.7
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 32-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|-
| Ubuntu 12.04 64-bit
| '''result''' - YYYY-MM-DD
| '''result''' - YYYY-MM-DD
|}
; Issues
=== Bug Fix Verifications ===
The following bugs require testing and verification of fixes before signing off the release.
* {{bug|number}} - '''testing status''' (QA contact)
=== Issues ===
==== New ====
* {{bug|number}} - summary (reporter)
==== Known ====
* '''[status]''' {{bug|number}} - summary (reporter)

Revision as of 22:47, 27 November 2012

Firefox 17 ESR

Builds FTP, HTTP FTP, HTTP
ID 20121116114610 20121119074111
Changeset id (pushlog) 2e686aeb0f22 (pushlog)
Checklist (respin for bug 812989)
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results (report)
Windows XP PASS - 2012-11-19
Windows Vista PASS - 2012-11-19
Windows 7 32-bit PASS - 2012-11-19
Windows 7 64-bit PASS - 2012-11-19
Windows 8 32-bit PASS - 2012-11-19
Windows 8 64-bit PASS - 2012-11-19
Mac OS X 10.6 PASS - 2012-11-19
Mac OS X 10.7 PASS - 2012-11-19
Mac OS X 10.8 1 failure - 2012-11-19
Ubuntu 12.04 32-bit PASS - 2012-11-19
Ubuntu 12.04 64-bit PASS - 2012-11-19
Test Failures (known bugs)
  • /restartTests/testAddons_uninstallExtension/test4.js (known)

Manual Smoketests

Run the Firefox ESR 17 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 7 Virgil PASS - 2012-11-20
Mac OS X 10.8 Virgil PASS - 2012-11-20
Ubuntu 12.04 Ioana PASS - 2012-11-20
Additional Spotchecks
  • Check that builds do NOT work on Mac OSX 10.5 - PASS - 2012-11-20
  • Check that builds do NOT work on Windows 2000 - PASS - 2012-11-20
    • Firefox 17 esr can't be installed on Windows 2000, as expected - the error 'Microsoft Windows XP SP2 is required' is displayed at installation.

Bug Fix Verifications

status-firefox-esr17:fixed (11 bugs)

Issues

New
  • NEW bug 813531 - An unknown error while printing SVG file (Virgil)
Known
  • NEW bug 803057 - HTML5 videos continues to play after Pop Out (simonab)
  • NEW bug 760417 - Full-screen button visible in pop-out full-screen mode (ioana)
  • NEW bug 708557 - Html5 youtube context menu not persistent when right clicking (virgil)

Firefox 17.0.1 ESR

Builds FTP, HTTP
ID numeric build id
Changeset changesetID (pushlog)
Checklist
  • {{ |}} Functional automation
  • {{ |}} Manual tests
  • {{ |}} Bug fix verifications
  • {{ |}} Update automation
  • {{ |}} Peer sign-off
  • {{ |}} Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD
Mac OS X 10.7 result - YYYY-MM-DD
Ubuntu 12.04 32-bit result - YYYY-MM-DD
Ubuntu 12.04 64-bit result - YYYY-MM-DD
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR version Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 tester result - YYYY-MM-DD
Windows 7 64-bit tester result - YYYY-MM-DD
Mac OS X 10.7 tester result - YYYY-MM-DD
Ubuntu 12.04 32-bit tester result - YYYY-MM-DD

Update Testing

  • Partial: versions receiving partial updates
  • Complete: versions receiving complete updates
Platform Releasetest: report ESR: report
Windows 2000 result - YYYY-MM-DD result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.7 result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Issues

Bug Fix Verifications

The following bugs require testing and verification of fixes before signing off the release.

Issues

New

Known

Retrieved from "https://wiki.allizom.org/index.php?title=Releases/Firefox_17_ESR/Test_Plan&oldid=490344"