Latest revision as of 21:23, 14 July 2008

Welcome to the Thunderbird Test Day wiki!

With help from the Thunderbird / Mozilla Messaging team, join us to test Thunderbird. We also invite you to inform yourself via Thunderbird wiki pages about the state of Thunderbird, version 3, and how you might help improve this great messaging platform.

We also run bugdays, in which you can participate and help plan.

Who

You, and others interested in the future of Thunderbird.

No coding, (almost*) no experience required. Anyone can participate and be a valuable contributor. There are people available to assist you. You must however run code which is development status.

* It will help if you have used Thunderbird for 2-3 months.

Why

Test days are about assessing how good a specific version of Thunderbird is for a population of users larger than the core of people involved in coding the fixes and improvements. A larger population is essential because a diverse set of testers on a diverse set of computers is required to ferret out problems which are themselves ... diverse. Testing the code also helps find its functional weaknesses, and confirms its strengths.

Note - currently there are lots (LOTS!) of bugs - some of which we evaluate during Bug Days. We invite you to join us on bug days which occur every Thursday. Bug days are designed to help newcomers in the process of cleaning up the database and drive down the line in this chart.

Schedule

Multiple staffed sessions allow you to participate during the evening or during daytime at any location in the world. You may attend any or all sessions. If you can't attend a scheduled session please drop in between sessions - someone might be hanging out who can help you. If you can't participate in this day's activity, we invite you to participate in a future QA Day.

Click in a UTC link below to get the session start time for your point on the globe.

	Sessions
Timezone	Session 1 13h-15h UTC	Session 2 19h-21h UTC	Session 3 02h-05h UTC
Los Angeles, USA (PDT=UTC-8+1)	Thu 06h-08h	Thu 12h-14h	Thu 19h-22h
New York, USA (EDT=UTC-5+1)	Thu 09h-11h	Thu 15h-17h	Thu 22h-01h
São Paulo, Brazil (UTC-4+1)	Thu 10h-12h	Thu 16h-18h	Thu 23h-02h
UK (BST)	Thu 14h-16h	Thu 20h-22h	Fri 03h-06h
Berlin, Germany (CEST=UTC+1+1)	Thu 15h-17h	Thu 21h-23h	Fri 04h-07h
Moscow, Russia (UTC+3+1)	Thu 17h-19h	Thu 23h-01h	Fri 06h-09h
Beijing, China (UTC+8)	Thu 21h-23h	Fri 03h-04h	Fri 10h-13h

Where

You can get help on test day in IRC channel #testday. Prior to the scheduled date you can get help on preparing by asking in #maildev.)

How

Information about Shredder (Thunderbird) Alpha 2 testing

Preparation, prior to Test Day:

Get a litmus account
Get a bugzilla account
If you wish to do a test drive, take note of the precautions in the first few steps of "On Test Day", and get trunk version of Thunderbird. Trunk is where the code for the release to be tested will be pulled from, where we normally attempt to reproduce bugs that people have reported, and normally where bugs are first fixed before being ported to branches, if appropriate.

If you have a question or encounter a problem about bugzilla, litmus or anything just post a note in the #testday IRC channel. If you don't get a response consult the channel header for someone to ping by name. Or ping a channel operator.

If you are new to bugzilla you can't change most bug fields, but you can add a comment detailing what should be changed and why. You can also post your comments in the #testday channel and someone will assist you. (optional) See Bug triage about how to get upgraded privileges to be able to change bug fields.

Notes:

Caution: This is not a release candidate - it is early development level/trunk code that has not be subjected to extensive quality tests, despite the fact that many people successfully use it on a daily basis without major problems or data loss. Use at your own risk and protect your data with appropriate backups.
This release is not anywhere near feature complete. See Thunderbird:Home for details and planning information about the future of Thunderbird.
Don't expect most extensions to work. At your own risk you can test extensions that doesn't pass version checking by install Nightly Tester Tools extension to override version checking - see Triage_Resources, Tools, and Hints - then report results to extension author.
It's called Shredder because a) we want it to be obvious this is not a publicly released version of Thunderbird people, b) we want people to be cautious about using it.

On Test Day, install the new version of Thunderbird Alpha 1 and report your findings via bug reports and other feedback tools.

Check the (substitute) release notes
[TBA Get a build] and use custom install to put it its own directory.
Protect - Backup your profile data. Create and use a test profile. You might also want to back up your imap or pop mail store.
Things to Test. Look for changes in behavior, both bad and good. Do one or more of the following. If you have other ideas, let us know.
- Exercise your favorite (or least favorite) Thunderbird functions and provide feedback. Examples: account setup, large scale POP and imap downloads, filters, junk mail processing to name a few.
- Try new capabilities of Thunderbird 3
  - New Add-ons Manager (Tools > Add-ons) shows recommended Add-ons. (Note: few add-ons are compatible with this early alpha, as add-on developers need to upgrade them.)
  - Address book can now read Mac OS X's system Address Book but is currently disabled by default. To enable it, see this blog entry.
  - New Crash Reporter (Breakpad). Searching message bodies no longer produces as many false positives and is more accurate in some multilingual situations.
  - Improved performance through javascript.
  - Thunderbird is now a native Cocoa application on Mac.
- Test Thunderbird on multiple operating systems, if you have multiple OS.
- Test reported crashers, hangs, etc. Please update a bug if needed per instructions below.
  - hangs (60 bugs)
  - crashers (32 bugs)
  - other bugs - excluding sev=trivial (1409 bugs)
Bugs - Update or file new bugs for problems that you encounter:
- Get a Bugzilla account if you don't have one - easily created at bugzilla.
- Remember to always cite in the bug your version of Thunderbird.
- Did you start in "safe mode" to avoid problems caused by extensions?
- File new bugs for new problems.
- For already reported bugs ... update the bug only if status has changed, the bug needs improvement, or there is new information. A comment of "This still exists in TB 3.0a1" is needed only if the report indicates the bug should not exist on trunk.
  - For UNCONFIRMED bugs, attempt to replicate the problem specified in the bug report. Mark (or comment) as "confirmed" if you are able to replicate and steps to reproduce are well documented and easily followed and the problem exists in trunk build. If you are not running trunk but can replicate with current release, please comment but do not confirm. If you are running trunk, cannot replicate, and the issue is presumed easy to recreate then you might close it dupe, WFM, or INVALID.
    Other helpful steps include:
  - Clarify bug reports without distorting or changing the original problem (note: simply stating this bug still occurs in version xxx isn't helpful unless you are confirming the bug at the same time)
  - Change the summary to be more accurate to the problem being reported, and if appropriate remove words so summary is less chatty
  - Close bug reports as WORKSFORME, INVALID, or INCOMPLETE when it's appropriate to do so (see status descriptions to find out what is appropriate).
  - Ask bug reporter in a bug comment to provide missing information that will help to replicate and ultimately fix the bugs they report.
Give feedback about your Test Day experience. (see feedback heading below)

Please check these for more helpful information about working with bugs:

Thunderbird Bug triage - expert tips, extensions, reference documents
Bug Writing Guidelines describes writing of effective bug reports that lead to bug fixes.

Give us feedback

Please post and give us information about your testing experience. We'd like to hear about problems, questions, ideas to improve documentation, where you learned about testday, and overall thoughts about Thunderbird- in #testday, #maildev or Mozilla Feedback (pick product=Thunderbird Release Candidate)

We really appreciate your help today and your feedback is very valuable.

Thanks!

Thanks so much for your help. Your efforts help us to improve Thunderbird. We could never do this without you and the entire volunteer community.

@@ Line 3: / Line 3: @@
 = Welcome to the Thunderbird Test Day wiki! =
-With help from the [http://getThunderbird.com/ Thunderbird] / [http://www.mozillamessaging.com Mozilla Messaging team], join us to test Thunderbird.  We also invite you to inform yourself via [[Thunderbird|Thunderbird wiki pages]] about the state of Thunderbird, version 3, and how you might help improve this great messaging platform. We also run bugdays, in which you can participate and help plan via [[Thunderbird:Bugdays_Planning|Planning for bugdays]].
+With help from the [http://getThunderbird.com/ Thunderbird] / [http://www.mozillamessaging.com Mozilla Messaging team], join us to test Thunderbird.  We also invite you to inform yourself via [[Thunderbird|Thunderbird wiki pages]] about the state of Thunderbird, version 3, and how you might help improve this great messaging platform.
+We also run [[Thunderbird:Bugdays|bugdays]], in which you can participate and  [[Thunderbird:Bugdays_Planning|help plan]].
 = Who =
@@ Line 9: / Line 11: @@
 '''<u>You</u>''', and others interested in the future of Thunderbird.
-No coding, (almost*) no experience required. Anyone can participate and be a valuable contributor. There are people available to assist you. You must however run code which is development status. <small>*&nbsp;It will help if you have used Thunderbird for 2-3 months.</small>
+No coding, (almost*) no experience required. Anyone can participate and be a valuable contributor. There are people available to assist you. You must however run code which is development status.
+<small>*&nbsp;It will help if you have used Thunderbird for 2-3 months.</small>
 = Why =
@@ Line 19: / Line 23: @@
 = Schedule =
-Multiple staffed sessions allow you to participate during the evening or during daytime at any location in the world. You may attend any or all sessions as they wish. If you can't attend a scheduled session please drop in between sessions - someone might be hanging out who can help you. If you can't participate in today's bugday, we invite you to [[Thunderbird:QA_Days|participate in a future Test Day]]. Or, work on any bug any day or time - see [[Thunderbird:Testdays#Where|Where]] about getting help.
+Multiple staffed sessions allow you to participate during the evening or during daytime at any location in the world. You may attend any or all sessions. If you can't attend a scheduled session please [[Thunderbird:Testdays#Where|drop in]] between sessions - someone might be hanging out who can help you. If you can't participate in this day's activity, we invite you to [[Thunderbird:QA_Days|participate in a future QA Day]].
 '''<u>Click in a UTC link below to get the session start time for your point on the globe.</u>'''
@@ Line 80: / Line 84: @@
 = Where =
-You can get help on bug day in IRC channel [irc://irc.mozilla.org/testday #testday]. Prior to the scheduled date you can get help on preparing by asking in [irc://irc.mozilla.org/maildev #maildev].)
+You can get help on test day in IRC channel [irc://irc.mozilla.org/testday #testday]. Prior to the scheduled date you can get help on preparing by asking in [irc://irc.mozilla.org/maildev #maildev].)
 * Get an IRC client:
+** [http://irc.mibbit.com/ Mibbit Web Client]
 ** [http://www.ircreviews.org/clients/platforms-windows.html Windows clients]
 ** [http://www.ircreviews.org/clients/platforms-macos.html MacOS clients]
@@ Line 88: / Line 93: @@
 ** [https://addons.mozilla.org/firefox/16/ ChatZilla (Firefox extension)]
 * Connect to [irc://irc.mozilla.org irc.mozilla.org]
-* Join the channel [irc://irc.mozilla.org/bugday #testday]
+* Join the channel [irc://irc.mozilla.org/testday #testday]
 = How =
-'''DRAFT - Please revisit this page on Thursday May 8. Details such as release notes, what to test, and where to get builds will be available at that time.'''
+Information about Shredder (Thunderbird) Alpha 2 testing
+'''Preparation, prior to Test Day:'''
+* Get a [http://litmus.mozilla.org litmus account]
+* Get a [http://bugzilla.mozilla.org bugzilla account]
+* If you wish to do a test drive, take note of the '''precautions''' in the first few steps of "On Test Day", and get [ftp://ftp.mozilla.org/pub/thunderbird/nightly/latest-trunk/ trunk version of Thunderbird]. <small>Trunk is where the code for the release to be tested will be pulled from, where we normally attempt to reproduce bugs that people have reported, and normally where bugs are first fixed before being ported to branches, if appropriate.</small>
-If at any point you have a question, encounter a problem, or are not familiar with our bug tracking system (bugzilla) post a note in the [irc://irc.mozilla.org/testday IRC channel].  ''If you are new to bugzilla you won't be able to change most bug fields, but you can add a comment to a bug detailing what should be changed and why. You can also make your comments known in the #testday channel and someone will assist you.'' ''(optional) See [[Thunderbird:Bug_Triage#Canconfirm_and_Editbugs_Privileges|Bug triage]] about how to get upgraded privileges to be able to change bug fields.''
+<!-- '''DRAFT - We have more work to do here. So please revisit this page on Thursday May 8. Details such as release notes, what to test, and where to get builds will be available at that time.''' -->
+If you have a question or encounter a problem about bugzilla, litmus or anything just post a note in the [irc://irc.mozilla.org/testday #testday IRC channel].  If you don't get a response consult the channel header for someone to ping by name. Or ping a channel operator.
-'''For Test Day of Thunderbird Alpha 1:'''
+''If you are new to bugzilla you can't change most bug fields, but you can add a comment detailing what should be changed and why. You can also post your comments in the #testday channel and someone will assist you.'' <small>''(optional) See [[Thunderbird:Bug_Triage#Canconfirm_and_Editbugs_Privileges|Bug triage]] about how to get upgraded privileges to be able to change bug fields.''</small>
-# '''Get a Bugzilla account''' - easily created at [https://bugzilla.mozilla.org/createaccount.cgi bugzilla account].
+Notes:
-# '''Get a build''' (location TBD) and use custom install to put it its own directory. <!-- "Trunk" refers to builds of Thunderbird 3 (currently in heavy development) -- it's where most bugs will get fixed and where we normally attempt to reproduce bugs that people have reported. See '''"Versions to test"''' below for details. -->
+* <b> Caution:</b> This is not a release candidate - it is early development level/trunk code that has not be subjected to extensive quality tests, despite the fact that many people successfully use it on a daily basis without major problems or data loss. '''Use at your own risk and protect your data with appropriate backups.'''
-# '''Protect''' - [http://kb.mozillazine.org/Thunderbird_:_FAQs_:_Backing_Up_and_Restoring Backup your data] and consider using a [http://kb.mozillazine.org/Starting_Firefox_or_Thunderbird_with_a_specified_profile test profile]. You might also want to have a backup of your mail.
+* This release is not anywhere near feature complete.  See [[Thunderbird:Home]] for details and planning information about the future of Thunderbird.
-# '''Test suggestions:'''
+* Don't expect most extensions to work. At your own risk you can test extensions that doesn't pass version checking by install Nightly Tester Tools extension to override version checking - see  [[Thunderbird:Bug_Triage#Triage_Resources.2C_Tools_and_Hints|Triage_Resources, Tools, and Hints]] - then report results to extension author.
-#* Run [https://litmus.mozilla.org/run_tests.cgi?test_run_id=6 Thunderbird Trunk litmus tests].  Ask for help in #testday if you're not familiar with Litmus. If a testcase is unclear, mark it as such. See also the [http://quality.mozilla.org/howto/litmus/tutorial Litmus tutorial].
+* It's called ''Shredder'' because a) we want it to be obvious this is not a publicly released version of Thunderbird people, b) we want people to be cautious about using it.
-#* Exercise your favorite (or least favorite) Thunderbird functions and provide feedback. Examples: account setup, large scale POP and imap downloads, filters, junk mail processing to name a few
-#* Try new capabilities of Thunderbird 3 (see release notes TBD)
+'''On Test Day''', install the new version of Thunderbird Alpha 1 and report your findings via bug reports and other feedback tools.
-#* Test Thunderbird on multiple operating systems, if you have multiple OS
-#* Test reported crashers, hangs, etc, and update bug if needed per instructions below:
+# '''Check the [http://weblogs.mozillazine.org/rumblingedge/archives/2008/05/20080503_thunderbird_trunk_builds.html (substitute) release notes]
-#** [http://tinyurl.com/5unb74 hangs] (87 bugs) <!-- more: http://tinyurl.com/5pb9l9 -->
+# '''[TBA Get a build]''' and use custom install to put it its own directory. <!-- "Trunk" refers to builds of Thunderbird 3 (currently in heavy development) -- it's where most bugs will get fixed and where we normally attempt to reproduce bugs that people have reported. See '''"Versions to test"''' below for details. -->
-#** [http://tinyurl.com/5ay9tq crashers] (43 bugs) <!-- more: http://tinyurl.com/5nf9hb -->
+# '''Protect''' - [http://kb.mozillazine.org/Thunderbird_:_FAQs_:_Backing_Up_and_Restoring Backup your profile data]. Create and use a [http://kb.mozillazine.org/Starting_Firefox_or_Thunderbird_with_a_specified_profile test profile]. You might also want to back up your imap or pop mail store.
-#** [http://tinyurl.com/6zqqs8 other bugs] - excluding sev=trivial (2244 bugs)
+# '''Things to Test'''. Look for changes in behavior, both bad and good. Do one or more of the following. If you have other ideas, let us know.
-# '''Update or file new bugs for problems that you encounter:'''
+<!-- #* Run [https://litmus.mozilla.org/run_tests.cgi?test_run_id=6 Thunderbird Trunk litmus tests].  Ask for help in #testday if you're not familiar with Litmus. If a testcase is unclear, mark it as such. See also the [http://quality.mozilla.org/howto/litmus/tutorial Litmus tutorial]. -->
+#* Exercise your favorite (or least favorite) Thunderbird functions and provide feedback. Examples: account setup, large scale POP and imap downloads, filters, junk mail processing to name a few.
+#* Try new capabilities of Thunderbird 3
+#** New Add-ons Manager (Tools > Add-ons) shows recommended Add-ons. (Note: few add-ons are compatible with  this early alpha, as add-on developers need to upgrade them.)
+#** Address book can now read Mac OS X's system Address Book but is currently disabled by default.  To enable it, see [http://clarkbw.net/blog/2008/04/16/mac-address-book-try-thunderbird-nightly/ this blog entry].
+#** New Crash Reporter ([http://kb.mozillazine.org/Breakpad Breakpad]). Searching message bodies no longer produces as many false positives and is more accurate in some multilingual situations.
+#** Improved performance through javascript.
+#** Thunderbird is now a native Cocoa application on Mac.
+ <!-- (see release notes)-->
+#* Test Thunderbird on multiple operating systems, if you have multiple OS.
+#* Test reported crashers, hangs, etc. Please update a bug if needed per instructions below.
+#** [http://tinyurl.com/5unb74 hangs] (60 bugs) <!-- more: http://tinyurl.com/5pb9l9 -->
+#** [http://tinyurl.com/5ay9tq crashers] (32 bugs) <!-- more: http://tinyurl.com/5nf9hb -->
+#** [http://tinyurl.com/6zqqs8 other bugs] - excluding sev=trivial (1409 bugs) <!-- A1 was 2244 bugs -->
+# '''Bugs''' - Update or file new bugs for problems that you encounter:
+#* Get a Bugzilla account if you don't have one - easily created at [https://bugzilla.mozilla.org/createaccount.cgi bugzilla].
+#* Remember to always cite in the bug your version of Thunderbird.
+#* Did you start in [http://kb.mozillazine.org/Safe_mode "safe mode"] to avoid problems caused by extensions?
 #* [http://bugzilla.mozilla.org/enter_bug.cgi?product=Thunderbird&format=guided File new bugs] for new problems.
 #* For already reported bugs ... update the bug only if status has changed, the bug needs improvement, or there is new information. A comment of "This still exists in TB 3.0a1" is needed only if the report indicates the bug should not exist on trunk.
-#** For UNCONFIRMED bugs, attempt to replicate the problem specified in the bug report, and mark (or comment) as "confirmed" if you are able to replicate '''and''' the steps to reproduce are well documented and easily followed '''and''' the problem exists in trunk build. If you are not running trunk but can replicate with current release, please comment but do not confirm. If you are running trunk, cannot replicate, and the issue is presumed easy to recreate then you might close it dupe, WFM, or INVALID.<p>Other helpful steps include:
+#** For UNCONFIRMED bugs, attempt to replicate the problem specified in the bug report. Mark (or comment) as "confirmed" if you are able to replicate '''and''' steps to reproduce are well documented and easily followed '''and''' the problem exists in trunk build. If you are not running trunk but can replicate with current release, please comment but do not confirm. If you are running trunk, cannot replicate, and the issue is presumed easy to recreate then you might close it dupe, WFM, or INVALID.<p>Other helpful steps include:
-#** Clarify bug reports without distorting or changing the original problem.
+#** Clarify bug reports without distorting or changing the original problem (note: simply stating this bug still occurs in version xxx isn't helpful unless you are confirming the bug at the same time)
 #** Change the summary to be more accurate to the problem being reported, and if appropriate remove words so summary is less chatty
 #** Close bug reports as [https://bugzilla.mozilla.org/page.cgi?id=fields.html#status WORKSFORME, INVALID, or INCOMPLETE] when it's appropriate to do so (see [https://bugzilla.mozilla.org/page.cgi?id=fields.html#status status descriptions ] to find out what is appropriate).
 #** Ask bug reporter in a bug comment to provide missing information that will help to replicate and ultimately fix the bugs they report.
-#* Remember to always cite in the bug what version(s) of Thunderbird you are using.
 # '''[[Thunderbird:Bugdays#Give us feedback|Give feedback]]''' about your Test Day experience. (see feedback heading below)
-Please check these for more helpful information:
+Please check these for more helpful information about working with bugs:
 * [[Thunderbird:Bug_Triage|Thunderbird Bug triage]] - expert tips, extensions, reference documents
 * [http://www.mozilla.org/quality/bug-writing-guidelines.html Bug Writing Guidelines] describes writing of effective bug reports that lead to bug fixes.
 <!-- '''Versions to test:''' If you can, please test with [http://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-trunk/ Nightly Trunk Builds]. If you are not permitted to use trunk, then use the [http://www.getthunderbird.com/ latest update of Thunderbird version 2] - currently 2.0.0.12.  You can install a trunk build or any release of Thunderbird, and not disturb your production setup by a) using '''custom install''' to specify a directory of your choosing, and b) using [http://kb.mozillazine.org/Starting_Firefox_or_Thunderbird_with_a_specified_profile profile manager] to create a test profile. -->
 = Give us feedback =
-Please post a note in [irc://irc.mozilla.org/testday #testday] or [irc://irc.mozilla.org/maildev #maildev] about your experience: problems, questions, ideas to improve documentation, where you learned about testday, and overall thoughts about Thunderbird. We really appreciate your help today and your feedback is very valuable.
+Please post and give us information about your testing experience.  We'd like to hear about problems, questions, ideas to improve documentation, where you learned about testday, and overall thoughts about Thunderbird- in [irc://irc.mozilla.org/testday #testday],  [irc://irc.mozilla.org/maildev #maildev] or [http://feedback.mozilla.org/ Mozilla Feedback <small>(pick product=Thunderbird Release Candidate)</small>]
+We really appreciate your help today and your feedback is very valuable.
 = Thanks! =

Thunderbird:Testdays: Difference between revisions