Thunderbird:Testing: Difference between revisions

Thunderbird:Testing (view source)

Revision as of 18:17, 4 April 2023

2,358 bytes removed , 4 April 2023

m

major update

Wsm

canmove, Confirmed users

2,081

edits

@@ Line 1: / Line 1: @@
 <small>[[Thunderbird:Home|<< Back to Thunderbird Home Page]]</small>
-You can help other users, or help make Thunderbird better and enjoy the satisfaction that you have contributed to improving Thunderbird - no prior experience is necessary.
+You can help improve Thunderbird and other users - no prior experience is necessary.
+Below are just a few ways you can contribute to the Quality of Thunderbird.
-Below are just a few ways you can contribute to the Quality of Thunderbird. Each item has a specific page with more details.
 __FORCETOC__
-== '''Easy:''' Testing ==
+== '''Easy:''' ==
-This activity is simple, takes the least amount of time, and doesn't require any special skill.
-<small>The text below was moved from [[Thunderbird:Testing/Testing]]</small><!-- Moved from testing/testing -><!-- More information [[Thunderbird:Testing/Testing|here]] if you want to help with the testing activity. --><!-- <center>Quality through testing
-One of the easiest way to help make Thunderbird a great product is by testing it.
-Here are several different ways you can help.</center>
-=== Keywords ===
-* testace<ref>[https://en.wikipedia.org/wiki/Test_case]</ref>
--->
-=== Punctual testing ===
-This may be the easiest way to participate, learn how to do more - and get more confident about helping. To help here, just subscribe yourself to the [https://mail.mozilla.org/listinfo/thunderbird-testers Thunderbird-testers] mailing list. This is a read-only mailing list with 1-2 messages per month. We usually send detailed instructions on what to do and test and how to get help when you sign up for one of those events.
-Once on the mailing list just read the emails coming in. They'll either ask for volunteers for a shared event or will give very specific instructions on how to test a new feature on which we want a lot of coverage. When we ask for volunteers we'll usually use the following tools for testing :
+These activities are simple, takes the least amount of time, and doesn't require any special skill.
-<!-- MozTrap is dead
+=== Beta testing ===
-* [https://moztrap.mozilla.org/ MozTrap] to manage our [https://secure.wikimedia.org/wikipedia/en/wiki/Test_case testcase]-->
-* [https://bugzilla.mozilla.org Bugzilla] to manage our defects and [https://secure.wikimedia.org/wikipedia/en/wiki/Software_bug bugs]
-Having accounts on both on these systems is needed in order to participate.
+Before Thunderbird is released to the general public, it goes through beta testing. To participate in this effort you'll need to run a [https://www.thunderbird.net/download/beta/ Beta version] which is different from the standard release version of Thunderbird.
+The [https://www.thunderbird.net/download/beta/ Beta web page] has advice and links to many helpful resources.
 === Finding regressions ===
-While testing you might find some portions of Thunderbird that used to work, but do not work anymore. These are called [[ Thunderbird:Testing/Regression|regressions]].
+While testing or searching bugzilla you might find some portions of Thunderbird that previously worked but do not work anymore. Bug reports will have the '''regression''' keyword.
-=== Daily testing ===
+For these bugs it is very helpful to know the "regression range", the 1-day range of changes that broke Thunderbird.  A bug whose regression range has not been determined also has a bugzilla keyword '''regressionrange-wanted'''.
-To participate in this effort, you'll need to run a version different from the standard release version of Thunderbird linked on the mozilla.com website.
+We can find the regression range using a wonderful semiautomated tool called [https://mozilla.github.io/mozregression/ mozregression], and hopefully identify the code which caused the regression behavior.
-Daily testing is can be done with [https://www.mozilla.org/en-US/thunderbird/channel/ "newer" versions of Thunderbird] that needs testing. Mozilla produces updates of these versions of Thunderbird every night, with new fixes, but also sometimes causing new bugs.
+== '''Moderate:''' ==
-* We need many people on the stable branch - as its name implies, the stable branch only contains fixes and doesn't see any new features. But by using these builds, you'll help make sure that we don't introduce new bugs in the next security and stability release. To use these, either:
+=== Performance Profiles ===
-*# Download one stable nightly build and update it regularly
-*# Or switch your update channel to beta instead of release.
-* We also need people to use Alphas and Betas of the next major release. To run these just download one when they are announced and just keep using them.
-* And finally we also need people to run trunk builds. These builds will contain all the new features of the next major release of Thunderbird and you don't need to wait for the next beta to see them. These builds are less stable than the others and get broken once in a while (I would say maybe once or twice per calendar year).
-*# We also announce major issues when we are aware of them on planning list at [https://thunderbird.topicbox.com/ Thunderbird discussion].
-When doing daily testing, you will want to have an account on  [https://bugzilla.mozilla.org Bugzilla], so you can report the issues you find.
+Bugs which are performance related, with the "perf" keyword, can be profiled using a tool which traces the code being used.  [https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance This page] has details on running the tool.  More information to come.
-=== Maintaining the Test cases ===
+=== Maintaining Thunderbird's bug reports ===
-A main part of our manual and community driven testing relies on test cases .<ref name="testcase">https://secure.wikimedia.org/wikipedia/en/wiki/Test_case</ref>. What we do is we publish a call for help from volunteers and then split the test cases between those volunteers.
+[https://bugzilla.mozilla.org/ Bugzilla] is the database / tool that tracks reported defects. Working in this area requires some experience using Thunderbird, and the ability to determine what the user reporting a problem might be seeing. You don't need great technical skill. It just takes a little time.
-This means :
+More information on this activity can be found [[Thunderbird:Testing/bugzilla|here]].
-* Adding tests
+== '''Difficult:''' ==
-* Editing tests
-* Removing obsolete tests
-Not too technical, but a good level of English is needed.
+=== Daily build testing ===
-<!-- == References ==
+This requires running [https://www.mozilla.org/en-US/thunderbird/channel/ Daily version] which is different from the standard release version of Thunderbird.  Daily is a difficult environment, because you get a new version almost every day, with updated code.  Sometimes the daily build is broken by bugs. Otherwise, the challenges are similar to running a beta version.
-<references/> -->
-== '''Moderate:''' Maintaining the bug database ==
-The bug database aka [https://bugzilla.mozilla.org/ Bugzilla] is the tool used track defects.  The bug database is open to anyone who wants to help developers know about issues with Thunderbird.
-Work in this area requires some experience just using Thunderbird (just a few months), and the ability to determine what the user reporting a problem might be seeing. You don't need great technical skill. It just takes a little time.
-More information on this activity can be found [[Thunderbird:Testing/bugzilla|here]].
 <!-- == '''Challenging:''' Writing automated tests ==