Bugzilla Anthropology: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 9: Line 9:
*Provide an overview of how Bugzilla is being used.
*Provide an overview of how Bugzilla is being used.


== Status - Updated 26/3/2012 ==
== Status - Updated June 4th 2012 ==


* 21 interviews completed  
* 21 interviews completed  
** Current estimated required 20 to get high coverage
** Current estimated required 20 to get high coverage
** Final Round of interviews, 100% complete.
** Final Round of interviews, 100% complete.
** Outstanding transcripts are being reviewed by participants and will be posted once content is approved.
** Interview being summaries by Olga Baysal and Reid Holmes of Cheriton School of Computer Science
** Transcripts posted below that have been verified by the participants
at the University of Waterloo
* Currently working to get visibility on how review queue size is changing over time.
** A prototype is imminent, 2 bugs continue to block this progress.
** However, keyword and whiteboard searches have been fixed
** Do to considerable requests for access to the database, looking into making the elastic search database REST interface public.
* Preliminary findings presentation available, email mbest@mozilla.com to setup a time.


* Progress on statistics side remains slow
** A prototype is imminent, 3 bugs continue to block this progress although some progress has been made in recent days.
** Once the database schema has been updated with the corrections, automated tests will need to be written to insure that data is trustworthy
** A understanding of what security concerns there are remaining has been worked out with the security team and there is now a clear road map of what needs to happen to make the information public.
*** Due to resource constraints, it's hard to get an ETA on when this work will be done.
** Access to current experiments can be found at the following LDAP protected URL
*** [https://metrics.mozilla.com/bugzilla-analysis-site/]
[[file:Bugzilla_Anthropology_Presentation.pdf]]
[[file:Bugzilla_Anthropology_Presentation.pdf]]



Revision as of 19:59, 4 June 2012

General Agenda

To figure out how people are currently engaging with Bugzilla and see what we can learn about the tool's good, bad, and frustrating qualities.

  • Identify the information we want to gather.
  • Interview stakeholders across the organization.
  • Surface statistics that are relevant to it's use.
  • Identify best practices, useful hacks, and key problem areas.
  • Provide an overview of how Bugzilla is being used.

Status - Updated June 4th 2012

  • 21 interviews completed
    • Current estimated required 20 to get high coverage
    • Final Round of interviews, 100% complete.
    • Interview being summaries by Olga Baysal and Reid Holmes of Cheriton School of Computer Science

at the University of Waterloo

  • Progress on statistics side remains slow
    • A prototype is imminent, 3 bugs continue to block this progress although some progress has been made in recent days.
    • Once the database schema has been updated with the corrections, automated tests will need to be written to insure that data is trustworthy
    • A understanding of what security concerns there are remaining has been worked out with the security team and there is now a clear road map of what needs to happen to make the information public.
      • Due to resource constraints, it's hard to get an ETA on when this work will be done.
    • Access to current experiments can be found at the following LDAP protected URL

File:Bugzilla Anthropology Presentation.pdf

Interviews

Interviews will be a large portion of the programs scope. The the following section includes details about what will be investigated, who will be interviewed, and the notes gathered in those interviews.

Transcripts

Below are the results of the interviews conducted so far. These are the raw transcripts so they are unfiltered and the raw input that was given by the participants. Summaries of this information will be coming but these will be useful for those that want to dig a little deeper.

Interviews

Write Ins

Statistics

Gathering statistics on Bugzilla usage is a good way to provide an additional perspective that can help corroborate or question the information we gather via the interviews. A tool has emerged that seems to provide some solid insight into this area.

As this data significant influence on the interpretation of interview findings, verifying that the data presented is accurate is very important. This work is currently being discussed on the following Etherpad: