QA/Data harvesting/Progress Card

From MozillaWiki
Jump to navigation Jump to search

Progress Card



Feature Prio Status Estimated Date of Completion Owner
Additional Comments

Find/fixed Rate-trend Graphs

Sample metrics types here

P1


2010-08-27


Michael Kurze

This will need flags to allow for better selection of releases. Also, DWH data is incomplete (only bugs #560K to about #585K are included).

  • opened/found per week (last 7 weeks): [1]
  • closed/fixed over time (last 7 weeks): [2]


Buckets:grouped by priority

Samples from bugzilla here.

P1




  • Current open bugs by prio for products Firefox and Core: prio


Buckets:grouped by severity

P1




  • Currently open bugs by severity, for products Firefox and Core: [3]


Buckets:grouped by   component

Sample from bugzilla here

P1




  • Current open bugs by component, for products Firefox and Core: [4]
  • Same, but only the 10 components with the most bugs: [5]



Buckets:grouped by bug-asignee

Sample metrics types here

P3




Can be done with current DW data


Buckets:grouped by flags

Sample metrics types here

P1


2010-08-20


Michael Kurze
Needs flags

Ability to compare data from different releases

Sample from bugzilla here


P1


2010-08-27


Michael Kurze
Needs flags

What data (everything listed in the other features?)

Answer: Ideally,we should be able to trim the data we want to compare based on target milestone,component,keywords,flags etc

https://bugzilla.mozilla.org/query.cgi

Ability to compare data from different projects

Sample from bugzilla here

P2




Can be done with current DW data (?)

is Product/Component sufficient for this? Please add other fields that can indicate a project (flags? keywords?)

Answer: Ideally,we should be able to trim the data we want to compare based on target milestone,component,keywords,flags etc

https://bugzilla.mozilla.org/query.cgi

Tabular reporting

P3

CURRENTLY AVAILABLE


NA



The metrics dashboard should automatically deliver this with all dashboard items.


Average age of a bug in each component

Sample metric types here

P1




Can be done with current DW data


Rate/percentage of bugs being reopened/project

Sample metric types here

P2




Can be done with current DW data (?)

how are projects identified (see above)

Regression bugs per release/project

Samples from bugzilla here

P1


2010-09-04


Michael Kurze
Needs keywords and flags



Average age of bugs in unconfirmed status

Sample metrics types here

P1





Can be done with current DW data

Options to-CSV/JSON/Save the graph as an image

P3

CURRENTLY AVAILABLE


NA



If anything of this is buggy or difficult, it is probably best to file a metrics bug.