Confirmed users
513
edits
Auto-tools/Projects/Alerts: Difference between revisions
→Datazilla Alerting System
Klahnakoski (talk | contribs) (→ETL) |
Klahnakoski (talk | contribs) |
||
| Line 2: | Line 2: | ||
The '''Datazilla Alerting System''', also known as '''dzAlerts'''. Is a daemon that periodically inspects the Talos, B2G, and Eideticker performance results and generates alerts when there is a statistically significant regression in performance. | The '''Datazilla Alerting System''', also known as '''dzAlerts'''. Is a daemon that periodically inspects the Talos, B2G, and Eideticker performance results and generates alerts when there is a statistically significant regression in performance. | ||
== Objective == | == Objective == | ||
| Line 84: | Line 77: | ||
===Alert Management=== | ===Alert Management=== | ||
The Analysis phase is executed over the data multiple times as more test results arrive. This allows the algorithm to fill the future window with test statistics as they become available. The recalculation on increased samples changes the confidence calculations on the alert, and can result in the alert being obsoleted, or even re-instated. For this reason, and others, the alert is recorded in a database along with its latest statistics and status ('new' or 'obsolete'). Of course, there number of times the recalculation is done is limited by the future window size (default 20 on Talos). | The Analysis phase is executed over the data multiple times as more test results arrive. This allows the algorithm to fill the future window with test statistics as they become available. The recalculation on increased samples changes the confidence calculations on the alert, and can result in the alert being obsoleted, or even re-instated. For this reason, and others, the alert is recorded in a database along with its latest statistics and status ('new' or 'obsolete'). Of course, there number of times the recalculation is done is limited by the future window size (default 20 on Talos). | ||
== Collaboration == | |||
Features and development are ongoing | |||
* Signal from Noise meeting ([https://etherpad.mozilla.org/SignalFromNoise notes on etherpad]) | |||
* IRC: #ateam@irc.mozilla.org | |||
* email: klahnakoski@mozilla.com | |||
== Code == | == Code == | ||
https://github.com/klahnakoski/datazilla-alerts | https://github.com/klahnakoski/datazilla-alerts | ||