Litmus:Todo: Difference between revisions

1,103 bytes added ,  15 October 2007
 
(23 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= Litmus ToDo List =
'''[[Litmus|« back to Litmus main page]]'''
 
= Litmus To-Do List =


Here's some things that Litmus needs. If you feel like taking one of these tasks on, great! Just post about your progress on this page.  
Here's some things that Litmus needs. If you feel like taking one of these tasks on, great! Just post about your progress on this page.  
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Litmus&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Open Litmus Bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Litmus&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=ASSIGNED&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Assigned Litmus Bugs]


== Unclaimed Tasks ==
== Unclaimed Tasks ==
* '''Administration Interface''': allow admins to edit products, groups, subgroups, etc... without having to manually edit the database tables.


* '''Attachments''': do we still have a need for attachments? We're not trying to replace Bugzilla here, and there's a pretty high potential for abuse. We might want to allow this for community proposals for changes to test cases.
* '''Attachments''': do we still have a need for attachments? We're not trying to replace Bugzilla here, and there's a pretty high potential for abuse. We might want to allow this for community proposals for changes to test cases.
* '''Bugzilla Bug Integration''': automatically mark-up bugs numbers in comments and test steps/expected results as links to Bugzilla.
* '''Log File Support''': Build UI for display of result logs, which will now be held in the database to facilitate comparison.
* '''Test list add/edit/clone''': need to be able to create new test lists, add/edit/reorder test cases within that test list, and also clone existing test lists to make it easier to add new lists.


* '''Test result/run comparison''': we need to be able to compare single test results head-to-head, and we also need to display comparisons between entire test runs. We can take a page from LXR's book and mark up the deltas in special colors to facilitate comparisons. We might also want to use some AJAX to roll-up the parts of the comparison that are the same.
* '''Test result/run comparison''': we need to be able to compare single test results head-to-head, and we also need to display comparisons between entire test runs. We can take a page from LXR's book and mark up the deltas in special colors to facilitate comparisons. We might also want to use some AJAX to roll-up the parts of the comparison that are the same.
* '''Backup/Archive/Purging of old test results''': the first step here will be to determine what our data retention policy will be. Both Bob and Tracy have said that they never need to go back further than one month to compare test results, but their opinions might change if it were easier for them to do so. It might make sense to be able to tag particular test runs, e.g. test runs for releases, with a DO_NOT_PURGE flag so that they can be kept around indefinitely.
* '''Testcase State''': replace the current state display (broken) with a state matrix/table that displays testcase state for each branch and platform. Must also reference Build ID.
* '''Search for Testcase''': by name, group, and subgroup. Any other searchable fields?


== Claimed Tasks ==
== Claimed Tasks ==
Line 26: Line 18:
=== Chris Cooper ===
=== Chris Cooper ===
* In Progress
* In Progress
** '''Test Runs - Design''': this is the major piece that is present in Testrunner but still missing in Litmus. I will add my design to [[Litmus:Design#Replicate_Testrunner_Functionality]], at which point I should have many smaller subtasks to add to the unclaimed task pool above. At the very least, we will need the basic add/edit/clone functionality.
** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&product=Webtools&component=Litmus&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=ASSIGNED&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=ccooper%40deadsquid.com&emailassigned_to2=1 Litmus bugs currently assigned to coop]
** get metadata for Bob's automated tests into the database
** '''Web Services Interface - Design'''
*** Need to have a XML-RPC whatever interface to Litmus to get tests, submit results, etc...
** add group listing (i.e. this testcase belongs to the following groups)
** add "Search for testcase" functionality -> search by: name, testgroup, product


* Completed Tasks
* Completed Tasks
** Litmus i18n
** '''Test Runs''': this is the major piece that is present in Testrunner but still missing in Litmus. Design is listed in [[Litmus:Design#Replicate_Testrunner_Functionality]].
** '''Updated reporting tools''': since these tools need to know about test runs anyway, I'm taking this opportunity to update them as well.
** '''Administration Interface'''
** '''Testcase/Subgroup/Testgroup Management'''
** add "Search for testcase" functionality -> search by: testgroup, subgroup, product
** added full-text search (by summary, steps, expected results)
** database re-architect for test runs;
** add group listing (i.e. this testcase belongs to the following groups)
** only display testcases that are not marked as obsolete to regular testers. Admin can see all testcases.
** only display testcases that are not marked as obsolete to regular testers. Admin can see all testcases.
** script to grab/update test cases from Testrunner
** script to grab/update test cases from Testrunner
Line 54: Line 50:
*** make percentages based on build ID, rather than time
*** make percentages based on build ID, rather than time
*** display community coverage percentages as well as personal percentages
*** display community coverage percentages as well as personal percentages
=== Jay Patel ===


=== Zach Lipton ===
=== Zach Lipton ===


* In Progress
* In Progress
** '''Add/clone testcase'''
** QMO Extension
*** '''Status''': Initial template work done. Need to complete CGI and add authentication. Expected to be completed by 1/18/06 or so.
** [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&product=Webtools&component=Litmus&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=ASSIGNED&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=zach%40zachlipton.com&emailassigned_to2=1 Litmus bugs currently assigned to zach]
 
* Completed Projects
** '''User info''': personal pages for testers where they can change their information.
** '''The testdata filter'''
*** The testdata filter (in Template.pm) is in pretty bad shape and needs to get fixed. It likely opens us up to XSS attacks if we actually had a real cookie to attack. [[User:Zachlipton|Zachlipton]] 11:03, 28 Jul 2005 (PDT)
** '''litmusconfig.js'''
*** Select boxes need to be converted to pull data from litmusconfig.js rather than the clunky show/hide div approach. [[User:Zachlipton|Zachlipton]] 15:47, 29 Jul 2005 (PDT)
** '''Precompiled templates'''
** '''Authentication''': there is currently no authentication in Litmus. We accept the first email address the user provides when testing, use this to build a cookie, and then never let them change it (without removing the cookie, of course). We need to implement proper authentication:
** '''Authentication''': there is currently no authentication in Litmus. We accept the first email address the user provides when testing, use this to build a cookie, and then never let them change it (without removing the cookie, of course). We need to implement proper authentication:
*** '''Status''': Initial version checked into CVS 1/7/06. Working on migration to allow user accounts from the previous system to be used under the new authentication system.  
*** '''Status''': Initial version checked into CVS 1/7/06. Working on migration to allow user accounts from the previous system to be used under the new authentication system.  
Line 69: Line 71:
*** Update INSTALL
*** Update INSTALL
*** Update auth information on wiki and add API description
*** Update auth information on wiki and add API description
 
** '''User management''': admin tools for working with user accounts;
* Completed Projects
** '''Web Services Interface - Design'''
** '''The testdata filter'''
*** Need to have a XML-RPC whatever interface to Litmus to get tests, submit results, etc...
*** The testdata filter (in Template.pm) is in pretty bad shape and needs to get fixed. It likely opens us up to XSS attacks if we actually had a real cookie to attack. [[User:Zachlipton|Zachlipton]] 11:03, 28 Jul 2005 (PDT)
** '''litmusconfig.js'''
*** Select boxes need to be converted to pull data from litmusconfig.js rather than the clunky show/hide div approach. [[User:Zachlipton|Zachlipton]] 15:47, 29 Jul 2005 (PDT)
** '''Precompiled templates'''
canmove, Confirmed users
2,850

edits