Firefox:3.0.3:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
m (New page: == General Firefox 3.0.3 Test Plan == This is the basic set of tests we run for every security & maintenance release. == Description of Release == 3.0.3 is a...)
 
Line 42: Line 42:
|-
|-
| style="background:#ffdead;" | '''Smoketests'''
| style="background:#ffdead;" | '''Smoketests'''
| Tomcat '''PASS'''
| tester '''result'''
| Tomcat '''PASS'''
| tester '''result'''
| Marcia  - '''PASS'''
| tester '''result'''
|-
| style="background:#ffdead;" | '''BFTs (carry over from the older Build Test'''
| Tracy '''PASS'''
| Tomcat '''PASS'''
| Marcia '''PASS'''
|-
|-
| style="background:#ffdead;" | '''L10n'''
| style="background:#ffdead;" | '''L10n'''
| Tchung '''PASS'''
| Tchung '''result'''
| Tchung '''PASS'''
| Tchung '''result'''
| Tchung '''PASS'''
| Tchung '''result'''
|-
|-
| style="background:#ffdead;" | '''Updates'''
| style="background:#ffdead;" | '''Updates'''
| Tomcat <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result'''  <BR> '''Release - tbd''' <BR>
| tester <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result'''  <BR> '''Release - result''' <BR>
| Tomcat <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result'''  <BR> '''Release - tbd''' <BR>
| tester <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result'''  <BR> '''Release - result''' <BR>
| Tchung <BR> '''Betatest - PASS''' <BR> '''Release - PASS''' <BR>  '''Releasetest - PASS''' <BR> '''Release - PASS''' <BR>
| tester <BR> '''Betatest - result''' <BR> '''Release - result''' <BR>  '''Releasetest - result''' <BR> '''Release - result''' <BR>
|-
|-
|}
|}
Line 71: Line 66:
=== P1 Spotchecks ===
=== P1 Spotchecks ===
Check out the builds for sanity and regressions.  Pay attention especially to the password manager code.
Check out the builds for sanity and regressions.  Pay attention especially to the password manager code.


== Bug Verifications ==
== Bug Verifications ==

Revision as of 18:35, 24 September 2008

General Firefox 3.0.3 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

3.0.3 is a normal security release for Firefox.

Specific Test Plan for this Release

  • Verify the fixed bugs that are going into this release
  • Run smoketest, BFTs, updates, and l10n tests

Assumptions

Current Tasks

  • Ongoing: Bug Reproduction

Schedule

This is an estimated schedule as a normal security release.

  • Code freeze: Sept 24
  • Builds start: Sept 25
  • QA starts: Sept 25 (4 testers)
    • Smoketests: 1 1/2 day
    • Feature Spotchecks (focus on Password Manager): 1/2 day
    • l10n Testing: 4 hours
    • Betatest & Beta Channel Testing: 1 day
  • Release to beta channel: Sept 29
    • Releasetest & Release Channel Testing: TBD
  • Final Release: TBD

Builds

Test Results

Build 6
Windows Mac Linux
Smoketests tester result tester result tester result
L10n Tchung result Tchung result Tchung result
Updates tester
Betatest - result
Release - result
Releasetest - result
Release - result
tester
Betatest - result
Release - result
Releasetest - result
Release - result
tester
Betatest - result
Release - result
Releasetest - result
Release - result

Detailed Test Results

P1 Spotchecks

Check out the builds for sanity and regressions. Pay attention especially to the password manager code.

Bug Verifications

When you verify the bug is fixed:

  • Mark the whiteboard from fixed1.9.0.2 to verified1.9.0.2
  • Affected Bugs:
    • bug 451155 - Password manager does not work correctly on IDN site whose name contains any character over U+0100
    • bug 454708 - storage-Legacy can throw when calling ConvertToUnicode
    • bug 454993 - saved passwords lost/gone on migration/update from 3.0.1 to 3.0.2

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.