Firefox:1.5.0.4:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(15 intermediate revisions by 5 users not shown)
Line 26: Line 26:
** Update the [[Firefox:1.5.0.4:Test_Plan#Bug_Verifications|bug verification section of the test plan]] for bugs that cannot be verified or that are pending verification
** Update the [[Firefox:1.5.0.4:Test_Plan#Bug_Verifications|bug verification section of the test plan]] for bugs that cannot be verified or that are pending verification


=== Wednesday - May 17th ===
=== Wednesday - May 17th and Thursday - May 18th ===
* Finish L10n testing of changed locals for FFx
* Finish L10n testing of changed locals for FFx
** pl - '''juanb'''
** pl - '''juanb'''
** nb-BO - '''timr'''
** nb-BO - '''timr'''
* Test the new FFx LT locale - '''timr'''
* Test the new FFx LT locale - '''timr'''
* Verify fix for {{bug|327037}} - '''tracy''' tracy - '''done'''
* Verify fix for {{bug|327037}} - tracy - '''done'''
* L10n testing of changed locals for TBird - '''tracy'''
* L10n testing of changed locals for TBird - tracy - '''done'''
* Run metadiff on locale files - '''davel'''
* Run metadiff on locale files - '''davel'''
* Spot check P1 locales for FFx and TBird - '''tracy, juan, timr'''
* Spot check P1 locales for FFx and TBird:
** Results page TBD
** [[QA:FF1.5.0.4:L10n Spot Check Results|Firefox L10n Spot Check Results]] - tracy - '''done - PASS'''
** [[QA:TB1.5.0.4:L10n Spot Check Results|Thunderbird L10n Spot Check Results]] - '''juan, timr'''
* Verify 10 more FFx bugs - '''QA-ALL - TBD'''
* Verify 10 more FFx bugs - '''QA-ALL - TBD'''
** The goal is to  verify all security specific, severity=blocker, or Severity=critical
** The goal is to  verify all security specific, severity=blocker, or Severity=critical
Line 51: Line 52:
** update checker tool - '''davel?'''
** update checker tool - '''davel?'''
** Spot check updates - '''juan, tracy, timr'''
** Spot check updates - '''juan, tracy, timr'''
*** Results page TBD
*** Results page:  [[Firefox:1.5.0.4:Test_Plan:Software Update | Software Update Testing]]
 
* Official Build IDs
** Firefox RC4 = 2006050817 (for all platforms and locales)
** [http://bclary.com/log/2006/02/24/builds.html Bob's Magic Build Info Page]


== Specific Testing for 1.5.0.4 ==
== Specific Testing for 1.5.0.4 ==
Line 70: Line 75:
Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.
Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.


* [[Firefox:1.5.0.4:Test_Plan:BFT | Basic Functional Tests (BFTs)]] - In Progress (Monday 5/8 - Wednesday 5/10)
* [[Firefox:1.5.0.4:Test_Plan:BFT | Basic Functional Tests (BFTs)]]
* [[Firefox:1.5.0.4:Test_Plan:UB | MacOS X UB testing]]
* [[Firefox:1.5.0.4:Test_Plan:UB | MacOS X UB testing]]
* [[Firefox:1.5.0.4:Test_Plan:l10n | l10n related testing]]
* [[Firefox:1.5.0.4:Test_Plan:l10n | l10n related testing]]
Line 84: Line 89:


* "no verification necessary":
* "no verification necessary":
** https://bugzilla.mozilla.org/show_bug.cgi?id=327712
** {{bug|327712}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=330900 (would be nice to have testcase)
** {{bug|330900}} (would be nice to have testcase)
** https://bugzilla.mozilla.org/show_bug.cgi?id=326931
** {{bug|326931}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=328897
** {{bug|328897}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=330169
** {{bug|330169}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331678
** {{bug|331678}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331719
** {{bug|331719}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331786
** {{bug|331786}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331787
** {{bug|331787}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331793
** {{bug|331793}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=331820
** {{bug|331820}}
** {{bug|334464}} fix for HP-UX and SPARC platforms only
** {{bug|323526}} OS/2 only, verified by code inspection
** {{bug|316845}} build bug for cairo on linux, verified by code inspection


'''Pending'''
'''Pending'''
* added [need testcase]:
* added [need testcase]:
** https://bugzilla.mozilla.org/show_bug.cgi?id=329219
** {{bug|329219}}


* need help with testcase:
* need help with testcase:
** https://bugzilla.mozilla.org/show_bug.cgi?id=330897
** {{bug|330897}}
** https://bugzilla.mozilla.org/show_bug.cgi?id=324918 (need to make build and check assertion)
** {{bug|324918}} (need to make build and check assertion)
** https://bugzilla.mozilla.org/show_bug.cgi?id=321101 (need help with setting up and testing PAC scripts)
** {{bug|321101}} (need help with setting up and testing PAC scripts)
** {{bug|330169}}
** {{bug|331678}}
** {{bug|331820}}
** {{bug|335535}}
** {{bug|327708}}
** {{bug|328897}}


== [http://wiki.mozilla.org/Firefox:1.5.0.4:Community Back to Firefox 1.5.0.4 Community Home] ==
== [http://wiki.mozilla.org/Firefox:1.5.0.4:Community Back to Firefox 1.5.0.4 Community Home] ==

Latest revision as of 20:54, 30 May 2006

General Firefox 1.5.0.x Test Plan

This is the basic set of tests we run for every security & mainenance release.

Current Tasks

I am including all end game tasks including build, security notifications, etc. If anyone doesn't like this, I can create a separate cross-functional tasks page at a higher level.


Monday - May 15th

  • Build Tbird L10n Win/Linux/PPC - rhelmer - DONE
  • Build TBird L10n UB - rhelmer - delayed
  • Test locales that have changes for 1.5.0.4 - juan
    • See the signoff page (see link above)
  • Verify 10 more FFx bugs - QA-ALL - TBD
    • The goal is to verify all security specific, severity=blocker, or Severity=critical
    • Approximalte 30 more remain to be verified
    • Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Tuesday - May 16th

  • Respin TBird for bug 327037 - rhelmer - DONE
  • Test locales that have changes for 1.5.0.4 - juan - fr, it, ru - PASSED
    • See the signoff page (see link above)
  • Verify 10 more FFx bugs - QA-ALL - TBD
    • The goal is to verify all security specific, severity=blocker, or Severity=critical
    • Approximalte 20(?) more remain to be verified
    • Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Wednesday - May 17th and Thursday - May 18th

  • Finish L10n testing of changed locals for FFx
    • pl - juanb
    • nb-BO - timr
  • Test the new FFx LT locale - timr
  • Verify fix for bug 327037 - tracy - done
  • L10n testing of changed locals for TBird - tracy - done
  • Run metadiff on locale files - davel
  • Spot check P1 locales for FFx and TBird:
  • Verify 10 more FFx bugs - QA-ALL - TBD
    • The goal is to verify all security specific, severity=blocker, or Severity=critical
    • Approximalte 10 (?) more remain to be verified
    • Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification

Friday - May 19th

  • End of official Release Candidiate testing

Monday - May 22nd

  • Start creating updates and signing builds - preed

Wednesday - May 24th

  • Start testing updates

Specific Testing for 1.5.0.4

There are a few areas not covered by the general test plan above, and we will track that testing here. A few things to think about and test/verify with 1.5.0.4 include:

  • MacOS X Universal Binaries (Marcia/DaveL)
    • both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.2 are properly updated to 1.5.0.3 (both PPC and UB users).
    • more investigation into profile migration problems with users moving a PPC profile to a UB build (see Bug 331511)
  • Greasemonkey testing (Jesse/Jay)
    • a few bugs fixed for 1.5.0.4 change the way Greasemonkey scripts work, so we need to make sure things don't break (e.g. Bug 321101 and all dependencies)
    • Dveditz said we should focus on scripts that use array extras and those that try to look into different frames.
  • Form Controls Bugs

Please add any other bugs/areas that need special attention for this release. Thanks!

Test Results

Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.

The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!

Bug Verifications

fixed1.8.0.4 Bugs (need verification)

Verified

Pending

Back to Firefox 1.5.0.4 Community Home

Retrieved from "https://wiki.allizom.org/index.php?title=Firefox:1.5.0.4:Test_Plan&oldid=26938"