Releases/Firefox 3.6.4/Test Plan: Difference between revisions

 
(44 intermediate revisions by 3 users not shown)
Line 9: Line 9:
== Schedule ==
== Schedule ==


* Tree opens: 4/1
* <strike>Tree opens: 4/1
* Code freeze: 4/12, 11:59pm
* Code freeze: 4/12, 11:59pm
* Official builds start: 4/13
* Official builds start: 4/13
* QA with builds start: 4/14
* QA with build 1 starts: 4/14
** Smoketests - 4 people - 4/14
** Smoketests - 4 people - 4/14
** Focusing OOPP testing - 4/14 - 4/15
** Focusing OOPP testing - 4/14 - 4/15
Line 19: Line 19:
* Beta offered as advertised major update in beta channel - 4/16
* Beta offered as advertised major update in beta channel - 4/16
* l10n testing: 4 people - 4/17
* l10n testing: 4 people - 4/17
** Betatest & Beta Channel Testing - 4 people - 4/27
* Build 3 builds start: 5/3
* Firefox 3.6.4 beta1 offered as normal beta - 4/27
* QA with build 3 starts: 5/3
** Releasetest & Release Channel Testing - 4 people - 5/4
** Smoketests - 3 people - 5/3
* Firefox 3.6.4 shipped - 5/4
** Betatest & Beta Channel Testing for MU - 4 people - 5/4
 
* Beta offered to build 1 users in beta channel - 5/4
** Focusing OOPP testing - 2 people - 4/30 - 5/4
** BFTs - 2 people - 5/4
* QA with build 4 starts: 5/12
** Smoketests - 2 people - 5/12
** Focusing OOPP testing - 2 people - 5/12 - 5/13
** Betatest & Beta Channel Testing - 1 person - 5/12
* Beta offered to build 3 users in beta channel - 5/14
* Firefox 3.6.4 build 4 offered as normal beta - 5/18
* Firefox 3.6.4 build 5 created - 5/24
** Smoketests - 1 person - 5/24 - 5/25
** Betatest & Beta Channel Testing - 1 person - 5/26
* Firefox 3.6.4 build 5 offered as normal beta - 5/26
* Firefox 3.6.4 build 6 created - 5/27
** Smoketests - 1 person - 5/27
** Betatest & Beta Channel Testing - 1 person - 5/28
* Firefox 3.6.4 build 5 offered as normal beta - 5/28
* Firefox 3.6.4 build 7 created - 6/13
** Smoketests - 1 person - 6/14
** Betatest & Beta Channel Testing - 1 person - 6/14
* Firefox 3.6.4 build 7 offered as normal beta - 6/14</strike>
** Releasetest & Release Channel Testing - 1 person - 6/17
* Firefox 3.6.4 shipped - 6/17


'''Resources'''
'''Resources'''
Line 44: Line 66:
== Builds ==
== Builds ==
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build1/ Firefox 3.6.4 Build 1]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build1/ Firefox 3.6.4 Build 1]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build2/ Firefox 3.6.4 Build 2] - Missing a fix so testing is skipped on this build for the next.
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build3/ Firefox 3.6.4 Build 3]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build4/ Firefox 3.6.4 Build 4]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build5/ Firefox 3.6.4 Build 5]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build6/ Firefox 3.6.4 Build 6]
* [ftp://ftp.mozilla.org/pub/firefox/nightly/3.6.4-candidates/build7/ Firefox 3.6.4 Build 7]


== Test Results ==
== Test Results ==
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests | Smoketests and BFTs]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests | Smoketests and BFTs (build 1)]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing | OOPP Focused Testing]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing | OOPP Focused Testing (build 1)]]: '''Completed'''
** Several [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=559484+559703+559704+559375+559412+559451+559690+559433+559680 new bugs] found, hard to reproduce. Some [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=469267+510846+532565+532700 existing bugs] seen. None seem show-stoppers.
** Several [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=559484+559703+559704+559375+559412+559451+559690+559433+559680 new bugs] found, hard to reproduce. Some [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=469267+510846+532565+532700 existing bugs] seen. None seem show-stoppers.
* [[Releases/Firefox 3.6.4/Test Plan:l10n | l10n Spot Checks]]: '''RESULTS'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests2 | Smoketests and BFTs (build 3)]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:Software Update | Updates]]: '''RESULTS'''
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 2 | OOPP Focused Testing (build 3)]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests4 | Smoketests (build 4)]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 4 | OOPP Focused Testing (build 4)]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests5 | Smoketests (build 5)]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 5 | OOPP Focused Testing (build 5)]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests6 | Smoketests (build 6)]]: '''PASS'''
*[[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 6 | OOPP Focused Testing (build 6)]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:Smoketests7 | Smoketests (build 7)]]: '''PASS'''
*[[Releases/Firefox 3.6.4/Test Plan:OOPP Testing 7 | OOPP Focused Testing (build 7)]]: '''Completed'''
* [[Releases/Firefox 3.6.4/Test Plan:l10n | l10n Spot Checks]]: '''PASS'''
* [[Releases/Firefox 3.6.4/Test Plan:Software Update | Updates]]: '''PASS'''


== Bugs to Verify ==
== Bugs to Verify ==
Line 59: Line 97:
# Focus on critical and security bugs first.
# Focus on critical and security bugs first.
# Mark bug as verified adding the keyword '''verified1.9.2'''
# Mark bug as verified adding the keyword '''verified1.9.2'''
== Beta 1 (Build 1) feedback from Hendrix, etc ==
===Hendrix===
*Overall, not much feedback in the pre-release Hendrix group. Found some feedback in the main Firefox group as well
*One Windows user reported that a pave over install failed for him (paved over 3.6.3)
*Report that Firefox 3.6.4 Silverlight plugins is very slow.
**Some sites such as the Silverlight Showcase exhibit this issue but that particular site is a known issue according to bsmedberg. Reporter identified http://www.onsen.ag/ as the site. More investigation needed.
*Report that Acrobat Plugin Output disappears on 3.6.4 Beta using Win XP
**One Reporter using the latest Adobe release which just came out. Investigating but have not yet been able to reproduce.
**Another reporter reports the same issue but has many extensions installed in his profile so this issue could be extension related.
**https://bugzilla.mozilla.org/show_bug.cgi?id=559494 is one file and seems similar
*Report of Plugin container does not respond error message
**JAVA 6.0.160.1 was not removed / replaced upon installation of JAVA
6.0.200.2 and later popped-up a window advising it was being disabled
due to instability.... and keeps popping-up repeatedly even though it is
already disabled.... There is no right-click option to Remove or Delete
it either.
===Twitter===
*Feedback was primarily related to the announcment of the feature. I did not see much feedback regarding comments, etc
canmove, Confirmed users
4,854

edits