QA/Desktop Firefox/Test Plan Templates/Firefox ESR: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 41: Line 41:
  | Check the results dashboard for test failures. In the event there are no failures or that the failure is already known, change '''result''' to '''PASS''' and change YYYY-MM-DD to the date of the report. Consult the included bug query to determine which is and isn't known.  
  | Check the results dashboard for test failures. In the event there are no failures or that the failure is already known, change '''result''' to '''PASS''' and change YYYY-MM-DD to the date of the report. Consult the included bug query to determine which is and isn't known.  
  |}
  |}
=== Subsection: Manual Tests ===


== Firefox ''version'' ESR ==
== Firefox ''version'' ESR ==

Revision as of 23:21, 5 November 2012

Firefox ESR Test Plan Template

Use the following template when creating a Firefox ESR Test Plan.

How To Guide

Copy and paste the template below to a new section of the current major ESR version test plan. For example, if you were creating a test plan for Firefox 10.0.10esr, you would copy the template to a new section called Firefox 10.0.10 ESR in the Firefox 10 ESR Test Plan found at https://wiki.mozilla.org/Releases/Firefox_10_ESR/Test_Plan. All release test plans follow a similar nomenclature.

Anywhere you see an italicized version, replace it with the version number you are testing.

Main Header: Firefox version ESR

This section details a summary of information about the build.

version The version number you are testing, 10.0.10 for example.
Builds Link to the folder where candidate builds are located on ftp.mozilla.org, usually something like ftp://ftp.mozilla.org/pub/firefox/nightly/10.0.10esr-candidates/build1/
ID 12-digit numeric build ID, you can usually get this from any one of the txt files in the FTP folder. Alternatively, you can get this by installing the build and looking for it on the about:support page.
Changeset Link to the changelog and pushlog on hg.mozilla.org. You can get the changeset ID from one of the txt files in the FTP folder.
Checklist Tasks to be signed off before a release can be pushed live. Status is tracked using the built-in wiki templates, [ON TRACK] if the task is active, [DONE] if the task is complete

Subsection: Automated Tests

This section details the results of the functional automation. These tests are run automatically once builds appear on the FTP server. Status emails are sent to the mozmill-ci mailing list. Results are reported to the mozmill-ci dashboard.

Platforms Automation is run across all supported platforms for that release.
Report Link to the Functional Tests :: Reports for the specific branch and all platforms between the dates of the testrun. For Firefox 10.0.10esr you would select the 10 branch, all platforms, between Oct 24 and Oct 25.
Results Check the results dashboard for test failures. In the event there are no failures or that the failure is already known, change result to PASS and change YYYY-MM-DD to the date of the report. Consult the included bug query to determine which is and isn't known.

Subsection: Manual Tests

Firefox version ESR

Builds FTP, HTTP
ID numeric build id
Changeset changesetID (pushlog)
Checklist
  • {{ |}} Functional automation
  • {{ |}} Manual tests
  • {{ |}} Bug fix verifications
  • {{ |}} Update automation
  • {{ |}} Peer sign-off
  • {{ |}} Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD
Mac OS X 10.7 result - YYYY-MM-DD
Ubuntu 12.04 32-bit result - YYYY-MM-DD
Ubuntu 12.04 64-bit result - YYYY-MM-DD
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR version Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 tester result - YYYY-MM-DD
Windows 7 64-bit tester result - YYYY-MM-DD
Mac OS X 10.7 tester result - YYYY-MM-DD
Ubuntu 12.04 32-bit tester result - YYYY-MM-DD

Update Testing

  • Partial: versions receiving partial updates
  • Complete: versions receiving complete updates
Platform Releasetest: report ESR: report
Windows 2000 result - YYYY-MM-DD result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.7 result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Issues

Bug Fix Verifications

The following bugs require testing and verification of fixes before signing off the release.

Issues

New

Known

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Desktop_Firefox/Test_Plan_Templates/Firefox_ESR&oldid=485107"