Thunderbird:2.0.0.12:Test Plan: Difference between revisions

Latest revision as of 22:20, 15 February 2008

Test Plan for Thunderbird 2.0.0.12

Schedule

Code complete: January 31
Build starts (no later then): February 14
QA/Testing starts: February 14
Release to beta channel: February 20
Final release: February 28

QA Details

Smoketests: 2/14
Bug Verification: 2/14
Windows BFTs: 2/15
l10n Testing: 2/19
Betatest Channel Testing: 2/20
Beta Channel Testing: 2/20

Release to Beta channel on Wednesday, 2/20 at 3:00 PM.

Beta period - 2/20 to 2/28
Releasetest & Release Update Testing: 2/28
Release to World: 2/28 - 3:00 PM

Details

RC1 Builds

Bonsai Query

Testing

BFT on Windows
Spot check of Mac and Linux Platforms
Some Windows Vista testing
Bug verifications (security and critical)

Testing Results

**RC Status**
	Smoketests	BFTs
Thunderbird 2.0.0.12rc1	Team PASS	Team PASS

Smoketests

Windows Vista (donner lad) - PASS
Windows XP (juanb) - PASS
Mac OS X 10.4 (marcia) - PASS
Mac OS X 10.5 (marcia) - PASS
Linux (abillings) - PASS

BFTs

Windows XP (team) - PASS

Testing Details

Bugs

Bug Verifications

When you verify the bug is fixed:

If you test on Trunk, resolve it as VERIFIED FIXED
If you test on 1.8.1.x branch, replace the fixed1.8.1.12 keyword with verified1.8.1.12

Branch Bugs

Tips:

If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.

Bugs Found during testing:

@@ Line 24: / Line 24: @@
 === Details ===
-* [http://bonsai.mozilla.org/cvsquery.cgi?treeid=default&module=all&branch=GECKO181_20071004_RELBRANCH&branchtype=match&dir=&file=&filetype=match&who=&whotype=match&sortby=Date&hours=2&date=explicit&mindate=2007-10-09&maxdate=2007-10-30+16%3A40&cvsroot=%2Fcvsroot Bonsai Query]
+* [http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/2.0.0.12-candidates/rc1/ RC1 Builds]
+* [http://bonsai.mozilla.org/cvsquery.cgi?treeid=default&module=all&branch=GECKO181_20080128_RELBRANCH&branchtype=match&dir=&file=&filetype=match&who=&whotype=match&sortby=Date&hours=2&date=explicit&mindate=&maxdate=2008-02-12+13%3A50+PST&cvsroot=%2Fcvsroot Bonsai Query]
 === Testing ===
@@ Line 43: / Line 45: @@
 |-
 | style="background:#ffdead;" | '''Thunderbird 2.0.0.12rc1'''
-| Team '''RESULT'''
+| Team '''PASS'''
-| Team '''RESULT'''
+| Team '''PASS'''
 |-
 |}
 '''Smoketests'''
-* Windows Vista (tester) - '''RESULT'''
+* Windows Vista (donner lad) - '''PASS'''
-* Windows XP (tester) - '''RESULT'''
+* Windows XP (juanb) - '''PASS'''
-* Mac OS X 10.4 (tester) - '''RESULT'''
+* Mac OS X 10.4 (marcia) - '''PASS'''
-* Mac OS X 10.5 (tester) - '''RESULT'''
+* Mac OS X 10.5 (marcia) - '''PASS'''
-* Linux (tester) - '''RESULT'''
+* Linux (abillings) - '''PASS'''
 '''BFTs'''
-* Windows XP (team) - '''RESULT'''
+* Windows XP (team) - '''PASS'''
 ==== Testing Details ====
@@ Line 71: / Line 73: @@
 * If you test on Trunk, resolve it as VERIFIED FIXED
 * If you test on 1.8.1.x branch, replace the fixed1.8.1.12 keyword with verified1.8.1.12
+* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=fixed1.8.1.12&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=component&type0-0-0=anywordssubstr&value0-0-0=MailNews%2C+IMAP%2C+POP%2C+news%2C+SMTP&field0-0-1=product&type0-0-1=equals&value0-0-1=Thunderbird Specific query of fixed1.8.12 Thunderbird bugs]
+* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.12&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=component&type0-0-0=anywordssubstr&value0-0-0=MailNews%2C+IMAP%2C+POP%2C+news%2C+SMTP&field0-0-1=product&type0-0-1=equals&value0-0-1=Thunderbird Specific query of verified1.8.12 Thunderbird bugs]
+* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=fixed1.8.1.12%2Cverified1.8.1.12&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=component&type0-0-0=anywordssubstr&value0-0-0=MailNews%2C+IMAP%2C+POP%2C+news%2C+SMTP&field0-0-1=product&type0-0-1=equals&value0-0-1=Thunderbird Specific query of both fixed and verified Thunderbird 2.0.0.12 bugs]
+=== Branch Bugs ===
 * [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&keywords_type=anywords&keywords=fixed1.8.1.12&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&chfieldto=Now&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Unverified Fixed Bugs for 2.0.0.12]
 * [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=anywords&keywords=verified1.8.1.12&op_sys=All&op_sys=Windows+95&op_sys=Windows+98&op_sys=Windows+ME&op_sys=Windows+NT&op_sys=Windows+2000&op_sys=Windows+XP&op_sys=Windows+Server+2003&op_sys=Windows+Vista&op_sys=Windows+CE&op_sys=Windows+Mobile+6+Standard&op_sys=Windows+Mobile+6+Professional&op_sys=Mac+System+7&op_sys=Mac+System+7.5&op_sys=Mac+System+7.6.1&op_sys=Mac+System+8.0&op_sys=Mac+System+8.5&op_sys=Mac+System+8.6&op_sys=Mac+System+9.x&op_sys=Mac+OS+X&op_sys=Linux&op_sys=Other&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&negate0=1&field0-0-0=product&type0-0-0=anywordssubstr&value0-0-0=Camino+Mozilla+Calendar&field1-0-0=component&type1-0-0=notequals&value1-0-0=XForms Verified Bugs for 2.0.0.12]