canmove, Confirmed users
4,854
edits
Releases/Firefox 3.6.4/Test Plan: Difference between revisions
Releases/Firefox 3.6.4/Test Plan (view source)
Revision as of 15:43, 12 August 2010
, 12 August 2010→Test Results
| (47 intermediate revisions by 3 users not shown) | |||
| Line 9: | Line 9: | ||
== Schedule == | == Schedule == | ||
* Tree opens: 4/1 | * <strike>Tree opens: 4/1 | ||
* Code freeze: 4/12, 11:59pm | * Code freeze: 4/12, 11:59pm | ||
* Official builds start: 4/13 | * Official builds start: 4/13 | ||
* QA with | * QA with build 1 starts: 4/14 | ||
** Smoketests - 4 people - 4/14 | ** Smoketests - 4 people - 4/14 | ||
** Focusing OOPP testing - 4/14 - 4/15 | ** Focusing OOPP testing - 4/14 - 4/15 | ||
| Line 19: | Line 19: | ||
* Beta offered as advertised major update in beta channel - 4/16 | * Beta offered as advertised major update in beta channel - 4/16 | ||
* l10n testing: 4 people - 4/17 | * l10n testing: 4 people - 4/17 | ||
** Betatest & Beta Channel Testing - 4 people - 4/ | * Build 3 builds start: 5/3 | ||
* Firefox 3.6.4 | * QA with build 3 starts: 5/3 | ||
** | ** Smoketests - 3 people - 5/3 | ||
* Firefox 3.6.4 | ** Betatest & Beta Channel Testing for MU - 4 people - 5/4 | ||
* Beta offered to build 1 users in beta channel - 5/4 | |||
** Focusing OOPP testing - 2 people - 4/30 - 5/4 | |||
** BFTs - 2 people - 5/4 | |||
* QA with build 4 starts: 5/12 | |||
** Smoketests - 2 people - 5/12 | |||
** Focusing OOPP testing - 2 people - 5/12 - 5/13 | |||
** Betatest & Beta Channel Testing - 1 person - 5/12 | |||
* Beta offered to build 3 users in beta channel - 5/14 | |||
* Firefox 3.6.4 build 4 offered as normal beta - 5/18 | |||
* Firefox 3.6.4 build 5 created - 5/24 | |||
** Smoketests - 1 person - 5/24 - 5/25 | |||
** Betatest & Beta Channel Testing - 1 person - 5/26 | |||
* Firefox 3.6.4 build 5 offered as normal beta - 5/26 | |||
* Firefox 3.6.4 build 6 created - 5/27 | |||
** Smoketests - 1 person - 5/27 | |||
** Betatest & Beta Channel Testing - 1 person - 5/28 | |||
* Firefox 3.6.4 build 5 offered as normal beta - 5/28 | |||
* Firefox 3.6.4 build 7 created - 6/13 | |||
** Smoketests - 1 person - 6/14 | |||
** Betatest & Beta Channel Testing - 1 person - 6/14 | |||
* Firefox 3.6.4 build 7 offered as normal beta - 6/14</strike> | |||
** Releasetest & Release Channel Testing - 1 person - 6/17 | |||
* Firefox 3.6.4 shipped - 6/17 | |||
'''Resources''' | '''Resources''' | ||
| Line 44: | Line 66: | ||
== Builds == | == Builds == | ||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build1/ Firefox 3.6.4 Build 1] | * [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build1/ Firefox 3.6.4 Build 1] | ||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build2/ Firefox 3.6.4 Build 2] - Missing a fix so testing is skipped on this build for the next. | |||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build3/ Firefox 3.6.4 Build 3] | |||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build4/ Firefox 3.6.4 Build 4] | |||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build5/ Firefox 3.6.4 Build 5] | |||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build6/ Firefox 3.6.4 Build 6] | |||
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build7/ Firefox 3.6.4 Build 7] | |||
== Test Results == | == Test Results == | ||
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests | Smoketests and BFTs]]: '''PASS''' | * [[Releases/Firefox 3.6.4/Test Plan:Smoketests | Smoketests and BFTs (build 1)]]: '''PASS''' | ||
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing | OOPP Focused Testing]]: ''' | * [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing | OOPP Focused Testing (build 1)]]: '''Completed''' | ||
* [[Releases/Firefox 3.6.4/Test Plan:l10n | l10n Spot Checks]]: ''' | ** Several [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=559484+559703+559704+559375+559412+559451+559690+559433+559680 new bugs] found, hard to reproduce. Some [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=469267+510846+532565+532700 existing bugs] seen. None seem show-stoppers. | ||
* [[Releases/Firefox 3.6.4/Test Plan:Software Update | Updates]]: ''' | * [[Releases/Firefox 3.6.4/Test Plan:Smoketests2 | Smoketests and BFTs (build 3)]]: '''PASS''' | ||
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 2 | OOPP Focused Testing (build 3)]]: '''Completed''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests4 | Smoketests (build 4)]]: '''PASS''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 4 | OOPP Focused Testing (build 4)]]: '''Completed''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests5 | Smoketests (build 5)]]: '''PASS''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 5 | OOPP Focused Testing (build 5)]]: '''Completed''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests6 | Smoketests (build 6)]]: '''PASS''' | |||
*[[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 6 | OOPP Focused Testing (build 6)]]: '''Completed''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests7 | Smoketests (build 7)]]: '''PASS''' | |||
*[[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 7 | OOPP Focused Testing (build 7)]]: '''Completed''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:l10n | l10n Spot Checks]]: '''PASS''' | |||
* [[Releases/Firefox 3.6.4/Test Plan:Software Update | Updates]]: '''PASS''' | |||
== Bugs to Verify == | == Bugs to Verify == | ||
| Line 58: | Line 97: | ||
# Focus on critical and security bugs first. | # Focus on critical and security bugs first. | ||
# Mark bug as verified adding the keyword '''verified1.9.2''' | # Mark bug as verified adding the keyword '''verified1.9.2''' | ||
== Beta 1 (Build 1) feedback from Hendrix, etc == | |||
===Hendrix=== | |||
*Overall, not much feedback in the pre-release Hendrix group. Found some feedback in the main Firefox group as well | |||
*One Windows user reported that a pave over install failed for him (paved over 3.6.3) | |||
*Report that Firefox 3.6.4 Silverlight plugins is very slow. | |||
**Some sites such as the Silverlight Showcase exhibit this issue but that particular site is a known issue according to bsmedberg. Reporter identified http://www.onsen.ag/ as the site. More investigation needed. | |||
*Report that Acrobat Plugin Output disappears on 3.6.4 Beta using Win XP | |||
**One Reporter using the latest Adobe release which just came out. Investigating but have not yet been able to reproduce. | |||
**Another reporter reports the same issue but has many extensions installed in his profile so this issue could be extension related. | |||
**https://bugzilla.mozilla.org/show_bug.cgi?id=559494 is one file and seems similar | |||
*Report of Plugin container does not respond error message | |||
**JAVA 6.0.160.1 was not removed / replaced upon installation of JAVA | |||
6.0.200.2 and later popped-up a window advising it was being disabled | |||
due to instability.... and keeps popping-up repeatedly even though it is | |||
already disabled.... There is no right-click option to Remove or Delete | |||
it either. | |||
===Twitter=== | |||
*Feedback was primarily related to the announcment of the feature. I did not see much feedback regarding comments, etc | |||