Confirmed users
513
edits
Auto-tools/Projects/Alerts: Difference between revisions
→Nomenclature
Klahnakoski (talk | contribs) |
Klahnakoski (talk | contribs) |
||
| Line 34: | Line 34: | ||
* '''Sub-Test''' - A test should be an atom, but unfortunately some tests bundle yet-deeper-but-unnamed tests into their replicates. These buried tests are called "sub-tests". To handle the sub-tests, the replicates are further ETLed into normal tests for dzAlerts to digest. [https://wiki.mozilla.org/Auto-tools/Projects/Alerts#Dromeao.2A_ETL more below] | * '''Sub-Test''' - A test should be an atom, but unfortunately some tests bundle yet-deeper-but-unnamed tests into their replicates. These buried tests are called "sub-tests". To handle the sub-tests, the replicates are further ETLed into normal tests for dzAlerts to digest. [https://wiki.mozilla.org/Auto-tools/Projects/Alerts#Dromeao.2A_ETL more below] | ||
* '''Time Series''' - A statistic from a family of test results which can reasonably be compared to each other, and sorted by time (usually by push date). | * '''Time Series''' - A statistic from a family of test results which can reasonably be compared to each other, and sorted by time (usually by push date). | ||
* '''Score''' - The t-test and median test functions output a [http://en.wikipedia.org/wiki/P-value p-value]. This value is meaningful when it is close to zero, and should be charted on a vertical log-scale. For the sake of charting here we define SCORE = -log10(p-VALUE), which charts nicely alongside the time series, and provides a hint to the number of zeros to the right of the decimal place. | |||
== General Design == | == General Design == | ||