Confirmed users
513
edits
Auto-tools/Projects/DevelopmentMetrics: Difference between revisions
Jump to navigation
Jump to search
Auto-tools/Projects/DevelopmentMetrics (view source)
Revision as of 19:56, 5 February 2016
, 5 February 2016requires vpn
Klahnakoski (talk | contribs) (→Bug Counts: better description) |
Klahnakoski (talk | contribs) (requires vpn) |
||
| Line 19: | Line 19: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Review-byTop.html Top 30 Reviewers]<br>Requires VPN | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Review-byTop.html Top 30 Reviewers]<br><span style="color:red">Requires VPN</span> | ||
| Shows the top reviewers from the past 6 weeks, the number of reviews they did, and the number in their queue right now. The original objective of this dashboard is to confirm some engineers have too many reviews. This dashboard is fine for identifying egregious differences, but poor for individual comparison; it seems personal style, team style, and code under review all impact the size and number of reviews done. | | Shows the top reviewers from the past 6 weeks, the number of reviews they did, and the number in their queue right now. The original objective of this dashboard is to confirm some engineers have too many reviews. This dashboard is fine for identifying egregious differences, but poor for individual comparison; it seems personal style, team style, and code under review all impact the size and number of reviews done. | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/ReviewIntensity_First.html Time to First Incoming Review]<br>Requires VPN | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/ReviewIntensity_First.html Time to First Incoming Review]<br><span style="color:red">Requires VPN</span> | ||
| Counts review requests and review completion rates. Also breaks down aggregate review age. The first review has been shown to take the longest, probably due to people synchronization issues. Subsequent reviews were almost instantaneous, so we exclude them. This dashboard is not good for fine grained comparison of teams because the nature of the bugs, and the process used, is often too different. The response time INCLUDES WEEKENDS. | | Counts review requests and review completion rates. Also breaks down aggregate review age. The first review has been shown to take the longest, probably due to people synchronization issues. Subsequent reviews were almost instantaneous, so we exclude them. This dashboard is not good for fine grained comparison of teams because the nature of the bugs, and the process used, is often too different. The response time INCLUDES WEEKENDS. | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Review-byReviewer.html Incoming Review by Individual]<br>Requires VPN | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Review-byReviewer.html Incoming Review by Individual]<br><span style="color:red">Requires VPN</span> | ||
| Top reviewers, but this time with some breakdown by week and component. Interesting, but not actionable. | | Top reviewers, but this time with some breakdown by week and component. Interesting, but not actionable. | ||
|- style="vertical-align:top;" | |- style="vertical-align:top;" | ||
| [http://people.mozilla.org/~klahnakoski/review/ReviewIntensity.html Incoming Reviews]<br>Requires VPN | | [http://people.mozilla.org/~klahnakoski/review/ReviewIntensity.html Incoming Reviews]<br><span style="color:red">Requires VPN</span> | ||
| Statistics for all reviews. Subsequent reviews of a bug happen much faster than the first. Maybe the fast review speed is an administrative anomaly; reviews are added after the fact, and marked as reviewed. Maybe, the requester and reviewer are working closely to remove the remaining nits. | | Statistics for all reviews. Subsequent reviews of a bug happen much faster than the first. Maybe the fast review speed is an administrative anomaly; reviews are added after the fact, and marked as reviewed. Maybe, the requester and reviewer are working closely to remove the remaining nits. | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Reviews_Pending_18.html Reviews Requested in the Past 18 weeks]<br>Requires VPN | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/review/Reviews_Pending_18.html Reviews Requested in the Past 18 weeks]<br><span style="color:red">Requires VPN</span> | ||
| An attempt to better understand the aggregate response time; while treating "old" reviews (those over 18weeks), as something else entirely. | | An attempt to better understand the aggregate response time; while treating "old" reviews (those over 18weeks), as something else entirely. | ||
|} | |} | ||
| Line 62: | Line 62: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Dashboard_byProject.html Project Dashboard] | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Dashboard_byProject.html Project Dashboard]<br><span style="color:red">Requires VPN</span> | ||
| Lists assigned bugs, patches in review, and patches awaiting landing | | Lists assigned bugs, patches in review, and patches awaiting landing | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Predictive_Simple.html#programFilter=B2G+1.3 Burndown Prediction] | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Predictive_Simple.html#programFilter=B2G+1.3 Burndown Prediction]<br><span style="color:red">Requires VPN</span> | ||
| Uses average new bug rate, and average close rate to estimate the time it takes | | Uses average new bug rate, and average close rate to estimate the time it takes | ||
to close all bugs in the given category. Compares to close rates necessary to meet due date | to close all bugs in the given category. Compares to close rates necessary to meet due date | ||
|- | |- | ||
| style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Dashboard-FinalBurndown.html Final Burndown Dashboard] | | style="vertical-align:top;width:300px;" | [http://people.mozilla.org/~klahnakoski/modevmetrics/Dashboard-FinalBurndown.html Final Burndown Dashboard]<br><span style="color:red">Requires VPN</span> | ||
| Basic burndown chart. Showing current bugs over time compared to ideal (linear) burndown | | Basic burndown chart. Showing current bugs over time compared to ideal (linear) burndown | ||
|} | |} | ||