Firefox:1.5.0.4:Test Plan

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & mainenance release.

Current Tasks

I am including all end game tasks including build, security notifications, etc. If anyone doesn't like this, I can create a separate cross-functional tasks page at a higher level.

Monday - May 15th

Build Tbird L10n Win/Linux/PPC - rhelmer - DONE
Build TBird L10n UB - rhelmer - delayed
Test locales that have changes for 1.5.0.4 - juan
- See the signoff page (see link above)
Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 30 more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Tuesday - May 16th

Respin TBird for bug 327037 - rhelmer - DONE
Test locales that have changes for 1.5.0.4 - juan - fr, it, ru - PASSED
- See the signoff page (see link above)
Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 20(?) more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Wednesday - May 17th

Finish L10n testing of changed locals for FFx
- pl - juanb
- nb-BO - timr
Test the new FFx LT locale - timr
Verify fix for bug 327037 - tracy
L10n testing of changed locals for TBird - tracy - done
Run metadiff on locale files - davel
Spot check P1 locales for FFx and TBird - tracy, juan, timr
- Results page TBD
Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 10 (?) more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Friday - May 19th

End of official Release Candidiate testing

Monday - May 22nd

Start creating updates and signing builds - preed

Wednesday - May 24th

Start testing updates
- update checker tool - davel?
- Spot check updates - juan, tracy, timr
  - Results page TBD

Specific Testing for 1.5.0.4

There are a few areas not covered by the general test plan above, and we will track that testing here. A few things to think about and test/verify with 1.5.0.4 include:

MacOS X Universal Binaries (Marcia/DaveL)
- both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.2 are properly updated to 1.5.0.3 (both PPC and UB users).
- more investigation into profile migration problems with users moving a PPC profile to a UB build (see Bug 331511)
Greasemonkey testing (Jesse/Jay)
- a few bugs fixed for 1.5.0.4 change the way Greasemonkey scripts work, so we need to make sure things don't break (e.g. Bug 321101 and all dependencies)
- Dveditz said we should focus on scripts that use array extras and those that try to look into different frames.
Form Controls Bugs
- see [https://bugzilla.mozilla.org/show_bug.cgi?id=334977 Bug 334977 and all dependencies

Please add any other bugs/areas that need special attention for this release. Thanks!

Test Results

Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.

Basic Functional Tests (BFTs) - In Progress (Monday 5/8 - Wednesday 5/10)
MacOS X UB testing
l10n related testing
Software Update Testing

The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!