Confirmed users
1,905
edits
Auto-tools/Projects/OrangeFactor: Difference between revisions
Auto-tools/Projects/OrangeFactor (view source)
Revision as of 00:42, 14 October 2010
, 14 October 2010→Making Oranges Interesting
No edit summary |
|||
| Line 49: | Line 49: | ||
Currently, our intermittent oranges are not very interesting. After they've been identified, they are usually more-or-less ignored. This has caused us to accumulate oranges to the point where we have to deal with several of them for every commit (and by 'deal with', I mean 'log it and forget it'), which is time consuming for the sheriffs and for anyone who pushes a commit. At the same time, it demotivates any effort to actually fix them. | Currently, our intermittent oranges are not very interesting. After they've been identified, they are usually more-or-less ignored. This has caused us to accumulate oranges to the point where we have to deal with several of them for every commit (and by 'deal with', I mean 'log it and forget it'), which is time consuming for the sheriffs and for anyone who pushes a commit. At the same time, it demotivates any effort to actually fix them. | ||
We'd like to help change that. | We'd like to help change that. We think we can help by creating a dashboard to analyze oranges in the following ways: | ||
* identify the oranges that occur most frequently; these are the oranges that would produce the greatest improvement in our orange factor if fixed | |||
* identify significant changes in the frequency of a given orange; if a known intermittent orange suddenly begins to occur more frequently, it may be related to a recent code change, and this might give developers more information about when/why it occurred, which would hopefully help in fixing it | |||
* identify interesting patterns in failures; some failures may occur more frequently on certain OS's, build types, architectures, or other factors; by providing views which can track oranges across a range of factors, we might be able to provide developers with data that would help them reproduce failures or give them insight into their cause | |||
* identify overall trends in orange occurrences, already part of [http://jmaher.couchone.com/orange_factor/_design/woo/orange.html Orange Factor]; this can help track the 'orangeness' of a product over time, and can help measure the helpfulness of orange-fixing activities | |||