Template:Calendar:Testday Intro: Difference between revisions

Jump to navigation Jump to search

Template:Calendar:Testday Intro (view source)

Revision as of 20:04, 27 December 2006

19,530 bytes removed ,  27 December 2006
no edit summary
No edit summary
Line 29: Line 29:
* Sebo
* Sebo
* Jminta
* Jminta
== What build should I test? ==
We will be testing the latest nightly builds of Sunbird and Lightning:
'''Sunbird:'''
: http://ftp.mozilla.org/pub/mozilla.org/calendar/sunbird/nightly/latest-trunk/
'''Lightning''' (for Thunderbird 1.5.x and 2.0 candidates):
: http://ftp.mozilla.org/pub/mozilla.org/calendar/lightning/nightly/latest-mozilla1.8/
== What specifically will we be testing? ==
We will be testing the remote calendar ability of Sunbird and Lightning. We need to run through the few Litmus cases we have for remote calendars as well as simply have you attempt various forms of access, and attempt to gain access to calendars that are read only and verify that Sunbird and Lightning handle these situations appropriately. In particular, we will need to test:
* CalDav Calendars - test with the Cosmo (OSAF server), the Apple CalDav server,  Bedework, Oracle etc.
* WebDav Calendars - Microsoft WebDav, Apache, Open XChange, etc
* WCAP Calendars - (only available in Lightning -- use the lightning_wcap.xpi to enable support for it).
* FTP Calendars - A special type of ICALENDAR remote storage where an ICS file is simply stored at an FTP location.
We will have some servers available for testing, but we hope that you will be able to do some testing with servers that you have access to.  If you need access to a particular server for testing, please ask in IRC and we will provide you with access information.
<font color=red>
== BEFORE YOU START--BACKUP YOUR PROFILE ==
''' Though we don't expect things to go wrong, we always strongly encourage you to back up your profile and to do your testing on a "test" profile.'''
</font>
Backing up a profile is easy:<br>
1. Find your profile directory:
{| border="2" cellpadding="2"
! OS !! Thunderbird Profile !! Sunbird Profile
|-
| Windows || %AppData%\Thunderbird || %AppData%\Mozilla\Sunbird
|-
| Linux || ~/.thunderbird || ~/.mozilla/sunbird
|-
| MacOSX || ~/Library/Thunderbird || ~/Library/Application Support/Sunbird
|}
2. Copy the root of it somewhere else, for example copy the Thunderbird or Sunbird directory and everything below it.
Creating a testing profile is also easy:
# Launch your application with a -P option
# Create a New Profile by clicking the Create a New Profile button
# Click Next, Give it a name like "Testing Profile", click Finish
# Select the testing profile and click the "Start Calendar" (Or Start Mail in Thunderbird) button.
'''Remember that you will have to start the application with the -P option during testing so you can pick your Testing profile'''
Once you've finished testing, you can delete the extra profiles and you'll be back to normal.
If something goes terribly wrong (although we don't expect it to), close the application and just replace the profile with the backed up copy. That will reset the application to the way it was before you started testing.
== Testing Instructions ==
'''To Run Litmus Test Cases'''
Build ID Test Day
--------------------------------
OS      | Sunbird    | Lightning
Linux  | 2006121903 | 2006121903
Mac    | 2006121903 | 2006121903
Windows | 2006121903 | 2006121903
# Download Sunbird or Lightning from the above URLs
# Create your testing profile (see above)
# Go to [http://litmus.mozilla.org Litmus].
##Select Run Tests, the Product is Calendar. Your buildId should match the one in the table above. Verify that it does. Sunbird's buildId is in the "About Sunbird" window. Lightning's buildId is in its description in the Add-ons Manager.
##Choose a Test group and subgroup to test on. If you are running the lightning-wcap extension, please run the "Prototypes" and "WCAP Calendar" tests prior to other tests.
##Follow the test steps and verify the function under test works as described in Expected Results.
## If the test case performs as expected, mark it as a "Pass".  If not, mark it as a "Fail" and then enter a bug (see below).
## When you've finished one test, go to the next test by clicking the test case name.
## Once you've completed all the tests in a group, click the "Submit All Results" button at the bottom.
'''To Confirm Unconfirmed Bugs:'''
We need help confirming bugs in Bugzilla. We currently have 252 unconfirmed bugs. Can you help confirm some? If you need privileges, please let a moderator know and we will try to help with that.
#Click on a Bugzilla query below for a component that you would like to work on.
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Alarms&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=|  Alarms]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Calendar+Views&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Calendar Views]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=General&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| General]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Import+and+Export&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Import and Export]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Lightning+Only&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Lightning Only Issues]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Printing&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Printing (sunbird)]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Provider%3A+CalDav&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| CalDAV Support]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Provider%3A+ICS%2FWebdav&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| WebDAV Support]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Provider%3A+Local+Storage&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Local Storage Calendar]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Provider%3A+WCAP&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| WCAP Support]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Sunbird+Only&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Sunbird Only Issues]
*[https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&component=Tasks&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=6m&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0=| Task (and Todo) Support]
#Pick a bug that sounds interesting, and tell one of the moderators in the channel that you're working on it. (They will let you know whether or not someone's already taken it).
#To confirm the bug, follow these steps:
##Do some Bugzilla searching first to see if the bug might be a duplicate of an existing issue. If it is a duplicate, please add a comment stating the existing bug that this is a duplicate of, and include your IRC nickname. Also, let a moderator know in the channel, so that they can change its status to DUPLICATE.
##Attempt to perform the steps reported using a nightly build from above. Be certain that you can reproduce the bug using the nightly build.
##If you were able to reproduce the bug in the last step, then add a comment to the bug containing detailed steps on how you confirmed the bug. Be certain to include the buildID of the nightly (see table below), your operating system, the steps you followed, your IRC nickname (for Test Day tracking), and any other information that might be pertinent to the developer when they attempt to fix it.
##If you have Bugzilla privileges, please move the bug to the "New" state, if not, alert one of the moderators and they will do it for you.
There is more information about confirming bugs [http://www.mozilla.org/quality/help/unconfirmed.html| here].
'''BUG FOUND!'''
# In the process of working with the Bugzilla or Litmus, you may find another bug. When you think you've found a bug, try to reproduce it. Restart Sunbird/Lightning and do the same steps again. The most valuable bugs are those that can be reproduced.
# Once the bug has been reproduced, search for it or something similar on [https://bugzilla.mozilla.org Bugzilla]. This can easily be done by searching for the error message, window name, or some other identifying feature of the bug. If you found an existing bug that is just like the bug you found, read the comments. Maybe your situation is slightly different and your input could help developers find the origin of the bug.
# If you can't find the bug in Bugzilla, talk about it in the channel. Maybe others can confirm your bug or find a similar bug in Bugzilla. This also gives moderators a chance to guide you to either provide more details, update an existing bug or file a new bug. 
# If you are certain you found a unique bug and have read the [https://bugzilla.mozilla.org/page.cgi?id=bug-writing.html Bug Writing Guidelines] and [https://bugzilla.mozilla.org/page.cgi?id=etiquette.html Bugzilla Etiquette], go ahead and file the bug in Bugzilla. Remember to be as specific as possible.
Some other ways you can help:
* Think of some test cases that aren't already included in Litmus (we love suggestions!).
* Ask your friends to join you. The more people to help the better!
* Consider looking at the [[Calendar:QA_TODO|Calendar ToDo list]], there is much you can help with.
== Where do I find Litmus and Bugzilla? ==
* Litmus can be found at http://litmus.mozilla.org/
* A list of Calendar specific test cases can be found via the [http://litmus.mozilla.org/search_results.cgi?product=Calendar&locale=en-US search function]
* Bugzilla can be found at http://bugzilla.mozilla.org/
* A list of Calendar specific bugs (without enhancements) can be found [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=VERIFIED&resolution=---&bug_severity=blocker&bug_severity=critical&bug_severity=major&bug_severity=normal&bug_severity=minor&bug_severity=trivial&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Bug+Number&field0-0-0=noop&type0-0-0=noop&value0-0-0= here]
* A list of already filed enhancement requests can be found [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Calendar&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&resolution=WONTFIX&resolution=---&bug_severity=enhancement&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Bug+Number&field0-0-0=noop&type0-0-0=noop&value0-0-0= here]
Tips:
* Make sure you enter the correct information for your platform, version of Thunderbird, Lightning etc. Please include the full build identifier (i.e Thunderbird 1.5.0.7 (20060909) with Lightning 0.3 (2006100206)).
* Be sure to read the [[Calendar:Current_QA_TestDay#Testing_Instructions|Testing Instructions]] above before filing a bug.
* Feel free to ask on [[Calendar:Current_QA_TestDay#Where_do_I_start.3F|IRC]] if you need help or have any more questions.
== How do I send feedback? ==
Please use email us at [mailto:dev-apps-calendar@lists.mozilla.org dev-apps-calendar at lists.mozilla.org] to send feedback about how the testday went, any overall thoughts about Sunbird and Lightning, and to follow up on issues found and bugs filed.  We really appreciate your help today and your feedback is very valuable.
== calbot Instructions ==
xFallenAngel has created a bot to keep track of Test Day progress. It is in its early stages, but it should provide basic functionality. You will be greeted by this bot upon entering #calendar-qa. Be sure to prefix everything you say with "calbot:" so the bot knows you are talking to him.
The commands are based upon natural language. You can for the most part talk to him, as if he were human. If calbot does not want to understand you, try rephrasing your question. If all fails then a moderator will probably be around to help you or you can consult the help. (Try "calbot: help TestdayGreeting")
Note also, in some cases it is enough to answer with yes or no. This of course should still be prefixed with the bot's name.
Some common phrases:
*Whats going on?
*What can I work on?
*I want to work on ''&lt;Complete task name&gt;''
*I want to do something else
*I am finished
*Who is working on ''&lt;Complete task name&gt;''
== Rewards ==
* There will be no rewards available for this test day. We're saving our resources for test days when we are closer to a release :-)
* But as always, thank you VERY VERY much for helping us out. We definitely couldn't do this without all of you!
* That said, if you or your company want to sponsor rewards for a test day, please hop onto IRC and let us know.
Ctalbert
Confirmed users
3,816

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/45244"

Navigation menu