MozillaWiki

Firefox:1.5.0.4:Test Plan: Difference between revisions

Page Discussion

Firefox:1.5.0.4:Test Plan (view source)

Revision as of 20:54, 30 May 2006

4,548 bytes added ,  30 May 2006
→‎Wednesday - May 24th
 
(37 intermediate revisions by 6 users not shown)
Line 2: Line 2:
This is the basic set of tests we run for every security & mainenance release.
This is the basic set of tests we run for every security & mainenance release.


== Specific Testing for 1.5.0.3 ==
== Current Tasks ==
There are a few areas not covered by the general test plan above, and we will track that testing here.  A few things to think about and test/verify with 1.5.0.3 include:


* '''MacOS X Universal Binaries''' - both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.2 are properly updated to 1.5.0.3 (both PPC and UB users).
I am including all end game tasks including build, security notifications, etc.  If anyone doesn't like this, I can create a separate cross-functional tasks page at a higher level.
 
 
=== Monday - May 15th ===
* Build Tbird L10n Win/Linux/PPC - '''rhelmer - DONE'''
* Build TBird L10n UB - rhelmer - delayed
* Test [[Firefox:1.5.0.4:Community#Locale_sign-offs | locales that have changes for 1.5.0.4]] - '''juan'''
** See the signoff page (see link above)
* Verify 10 more FFx bugs - '''QA-ALL - TBD'''
** The goal is to  verify all security specific, severity=blocker, or Severity=critical
** Approximalte 30 more remain to be verified
** Update the [[Firefox:1.5.0.4:Test_Plan#Bug_Verifications|bug verification section of the test plan]]  for bugs that cannot be verified or that are pending verification
 
=== Tuesday - May 16th ===
* Respin TBird for {{bug|327037}} - '''rhelmer - DONE'''
* Test  locales that have changes for 1.5.0.4 - '''juan''' - fr, it, ru - PASSED
** See the signoff page (see link above)
* Verify 10 more FFx bugs - '''QA-ALL - TBD'''
** The goal is to  verify all security specific, severity=blocker, or Severity=critical
** Approximalte 20(?) more remain to be verified
** Update the [[Firefox:1.5.0.4:Test_Plan#Bug_Verifications|bug verification section of the test plan]] for bugs that cannot be verified or that are pending verification
 
=== Wednesday - May 17th and Thursday - May 18th ===
* Finish L10n testing of changed locals for FFx
** pl - '''juanb'''
** nb-BO - '''timr'''
* Test the new FFx LT locale - '''timr'''
* Verify fix for {{bug|327037}} - tracy - '''done'''
* L10n testing of changed locals for TBird - tracy - '''done'''
* Run metadiff on locale files - '''davel'''
* Spot check P1 locales for FFx and TBird:
** [[QA:FF1.5.0.4:L10n Spot Check Results|Firefox L10n Spot Check Results]] - tracy - '''done - PASS'''
** [[QA:TB1.5.0.4:L10n Spot Check Results|Thunderbird L10n Spot Check Results]] - '''juan, timr'''
* Verify 10 more FFx bugs - '''QA-ALL - TBD'''
** The goal is to  verify all security specific, severity=blocker, or Severity=critical
** Approximalte 10 (?) more remain to be verified
** Update the [[Firefox:1.5.0.4:Test_Plan#Bug_Verifications|bug verification section of the test plan]] for bugs that cannot be verified or that are pending verification
 
=== Friday - May 19th ===
* End of official Release Candidiate testing
 
=== Monday - May 22nd ===
* Start creating updates and signing builds - '''preed'''
 
=== Wednesday - May 24th ===
* Start testing updates
** update checker tool - '''davel?'''
** Spot check updates - '''juan, tracy, timr'''
*** Results page:  [[Firefox:1.5.0.4:Test_Plan:Software Update | Software Update Testing]]
 
* Official Build IDs
** Firefox RC4 = 2006050817 (for all platforms and locales)
** [http://bclary.com/log/2006/02/24/builds.html Bob's Magic Build Info Page]
 
== Specific Testing for 1.5.0.4 ==
There are a few areas not covered by the general test plan above, and we will track that testing here.  A few things to think about and test/verify with 1.5.0.4 include:
 
* '''MacOS X Universal Binaries (Marcia/DaveL)'''
** both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.2 are properly updated to 1.5.0.3 (both PPC and UB users).
** more investigation into profile migration problems with users moving a PPC profile to a UB build (see [https://bugzilla.mozilla.org/show_bug.cgi?id=331511 Bug 331511])
* '''Greasemonkey testing (Jesse/Jay)'''
** a few bugs fixed for 1.5.0.4 change the way Greasemonkey scripts work, so we need to make sure things don't break (e.g. [https://bugzilla.mozilla.org/show_bug.cgi?id=321101 Bug 321101] and all dependencies)
** Dveditz said we should focus on scripts that use array extras and those that try to look into different frames.
* '''Form Controls Bugs'''
** see [https://bugzilla.mozilla.org/show_bug.cgi?id=334977 Bug 334977 and all dependencies
 
'''Please add any other bugs/areas that need special attention for this release.  Thanks!'''


== Test Results ==
== Test Results ==
Any 1.5.0.3 testing results that will help us track progress, identify regressions, and verify fixes should go here.
Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.
 
* [[Firefox:1.5.0.4:Test_Plan:BFT | Basic Functional Tests (BFTs)]]
* [[Firefox:1.5.0.4:Test_Plan:UB | MacOS X UB testing]]
* [[Firefox:1.5.0.4:Test_Plan:l10n | l10n related testing]]
* [[Firefox:1.5.0.4:Test_Plan:Software Update | Software Update Testing]]


'''The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results.  Please add any other test results here.  Thanks!'''


== Bug Verifications ==
== Bug Verifications ==
Line 15: Line 86:


'''Verified'''
'''Verified'''
* [https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.3&order=Bug+Number verified1.8.0.4 Bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?keywords_type=allwords&keywords=verified1.8.0.4&order=Bug+Number verified1.8.0.4 Bugs]


* "no verification necessary":
* "no verification necessary":
https://bugzilla.mozilla.org/show_bug.cgi?id=327712
** {{bug|327712}}
https://bugzilla.mozilla.org/show_bug.cgi?id=330900 (would be nice to have testcase)
** {{bug|330900}} (would be nice to have testcase)
** {{bug|326931}}
** {{bug|328897}}
** {{bug|330169}}
** {{bug|331678}}
** {{bug|331719}}
** {{bug|331786}}
** {{bug|331787}}
** {{bug|331793}}
** {{bug|331820}}
** {{bug|334464}} fix for HP-UX and SPARC platforms only
** {{bug|323526}} OS/2 only, verified by code inspection
** {{bug|316845}} build bug for cairo on linux, verified by code inspection


'''Pending'''
'''Pending'''
* added [need testcase]:
* added [need testcase]:
https://bugzilla.mozilla.org/show_bug.cgi?id=329219
** {{bug|329219}}


* need help with testcase:
* need help with testcase:
https://bugzilla.mozilla.org/show_bug.cgi?id=330897
** {{bug|330897}}
** {{bug|324918}} (need to make build and check assertion)
** {{bug|321101}} (need help with setting up and testing PAC scripts)
** {{bug|330169}}
** {{bug|331678}}
** {{bug|331820}}
** {{bug|335535}}
** {{bug|327708}}
** {{bug|328897}}


== [http://wiki.mozilla.org/Firefox:1.5.0.3:Community Back to Firefox 1.5.0.3 Community Home] ==
== [http://wiki.mozilla.org/Firefox:1.5.0.4:Community Back to Firefox 1.5.0.4 Community Home] ==
Jay
1,926

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/24640...26938"