canmove, Confirmed users
2,081
edits
QA/Thunderbird3/TestInstructions/Beta1: Difference between revisions
Jump to navigation
Jump to search
QA/Thunderbird3/TestInstructions/Beta1 (view source)
Revision as of 17:24, 2 December 2008
, 2 December 2008→Details: resassign test groups
m (fix testrun ids) |
(→Details: resassign test groups) |
||
| Line 22: | Line 22: | ||
'''Important''' | '''Important''' | ||
* Use '''only the specified builds - not nightly or previous alpha or beta build. | * Use '''only the specified builds - not nightly or previous alpha or beta build. | ||
* Please file a bug whenever you encounter a problem, and mark as blocking {{bug|463057}} so | * Please file a bug whenever you encounter a problem, and mark as blocking {{bug|463057}} so others can be notified of problems found during testing. | ||
* | * For litmus testcases, if it ... | ||
** | ** is not run (you skipped it) - please do not comment nor mark passing or failed. | ||
** | ** fails - file a bug <small>(if one doesn't already exist)</small>, blocking {{bug|463057}} and put URL of testcase in bug's URL field; comment in the test and state bug litmus report | ||
** | ** is unclear - please comment with steps and wording you think will make it more clear | ||
* [[QA/Thunderbird3/TestResults/Beta1]] | * Read sections 1.1 to 1.6 of [[QA/Thunderbird3/TestResults/Beta1|release information]], '''especially the release notes.''' | ||
* Contact methods are also listed. | |||
==Builds== | ==Builds== | ||
| Line 35: | Line 36: | ||
==BFT== | ==BFT== | ||
Basic Functionality Tests is organized into subgroups listed below. | Basic Functionality Tests is organized into subgroups listed below. To shorten your testing time (running the full set takes 4-6 hours) you can focus on a few subgroups as follows: | ||
* <font color=red>'''*''' indicates priority items</font> - if you have the resource required please do '''*''' groups before others | * <font color=red>'''*''' indicates priority items</font> - if you have the resource required please do <font color=red>'''*'''</font> groups before others | ||
* '''All''' indicates items we hope everyone will test | * '''All''' indicates items we hope everyone will test | ||
* '''AL''' and '''MZ''' - | * '''AL''' and '''MZ''' - please run the test group if your last name/surname is in the range A-to-L or M-to-Z. If you have time feel free to do all tests. If not, skip the ones not assigned to your name. | ||
If you start running out of time and think you won't be able to return (or have time left after doing the assigned subgroups), you might return to the litmus menu "Select a Testgroup and Subgroup to Test" and pick one or two subgroups that show the least amount of testing coverage. | If you start running out of time and think you won't be able to return (or have time left after doing the assigned subgroups), you might return to the litmus menu "Select a Testgroup and Subgroup to Test" and pick one or two subgroups that show the least amount of testing coverage. | ||
| Line 49: | Line 50: | ||
# Complete all information about your setup - paste buildid, set platform, OS, and locale (note: there is only one linux OS selection). NOTE: help|about will not give you buildid. builid must be 10 or 14 digits of the form YYYYMMDDHH or YYYYMMDDHHMMSS. Two ways to get buildid: | # Complete all information about your setup - paste buildid, set platform, OS, and locale (note: there is only one linux OS selection). NOTE: help|about will not give you buildid. builid must be 10 or 14 digits of the form YYYYMMDDHH or YYYYMMDDHHMMSS. Two ways to get buildid: | ||
#* copy to clipboard using NTT after installing [https://addons.mozilla.org/en-US/thunderbird/addon/6543 Nightly Tester Tools extension] | #* copy to clipboard using NTT after installing [https://addons.mozilla.org/en-US/thunderbird/addon/6543 Nightly Tester Tools extension] | ||
#* application.ini file in Thunderbird program directory (mine for windows is " | #* application.ini file in Thunderbird program directory (mine for windows is "20081201164237") | ||
# Click "submit configuration" | # Click "submit configuration" | ||
# You're off and running | # You're off and running! Please do '''*''' items first. Expect 2.5-3.5 hours to do half the list as assigned. | ||
'''Subgroup assignments for BFTs''' | '''Subgroup assignments for BFTs''' (list order per litmus) | ||
| | ||
All-Install, shutdown, uninstall | <font color="grey">All-Install, shutdown, uninstall</font> | ||
AL-Migration (from other mail systems) | |||
AL-Import (from other mail systems) | |||
AL-Window configuration | |||
AL-Toolbars and menus | |||
All-Account settings & Preferences (Options) | <font color="grey">All-Account settings & Preferences (Options)</font> | ||
<font color="red">* IMAP accounts</font> | <font color="red">* IMAP accounts</font> | ||
<font color="red">* POP accounts (exclude Global Inbox)</font> | <font color="red">* POP accounts (exclude Global Inbox)</font> | ||
<font color="red">* Global inbox</font> | <font color="red">* Global inbox</font> | ||
All-Mail composition | <font color="grey">All-Mail composition</font> | ||
AL-Spell checker | |||
AL-RSS account & subscriptions | |||
AL-Newsgroups | |||
All-Navigating and displaying messages | <font color="grey">All-Navigating and displaying messages</font> | ||
MZ-Downloading and saving | |||
MZ-Image blocking | |||
MZ-Return receipts | |||
<font color="red">* Proxies</font> | <font color="red">* Proxies</font> | ||
MZ-Offline, disk space | MZ-Offline, disk space | ||
All-Moving, copying, deleting messages | <font color="grey">All-Moving, copying, deleting messages</font> | ||
All-Views and labeling messages | <font color="grey">All-Views and labeling messages</font> | ||
AL-Message filters | |||
AL-Message search | |||
<font color="grey">All-Address search</font> | |||
MZ-Saved Search folders | |||
MZ-Message Grouping | |||
MZ-Message Aging | |||
MZ-Quicksearch | |||
<font color="grey">All-Address books</font> | |||
AL-Junk mail | |||
AL-Extensions | |||
MZ-Theme management | |||
MZ-Help | |||
MZ-Printing | |||
<font color="grey">All-Master Passwords & password management</font> | |||
<font color="red">* Phishing, spoof detection</font> | <font color="red">* Phishing, spoof detection</font> | ||
<font color="red">* Secure connections</font> | <font color="red">* Secure connections</font> | ||
| Line 103: | Line 104: | ||
==locale== | ==locale== | ||
We need testers to smoketest or BFT L10n builds (per tests described above), then update the wiki at [[Thunderbird3/TestResults/Beta1/L10N]] to help us track which locales have been tested. | |||
We also have [https://litmus.mozilla.org/run_tests.cgi?test_run_id=32 L10n trunk baseline tests] focusing on language string correctness and UI elements working and looking correct. Your testing results are recorded in litmus. | |||