Confirmed users
513
edits
Auto-tools/Projects/Alerts: Difference between revisions
→Datazilla Alerting System
Klahnakoski (talk | contribs) |
Klahnakoski (talk | contribs) |
||
| Line 1: | Line 1: | ||
= Datazilla Alerting System = | = Datazilla Alerting System = | ||
The '''Datazilla Alerting System''', also known as '''dzAlerts'''. Is a daemon that periodically inspects the Talos, B2G, and Eideticker performance results and generates alerts when there is a statistical regression in performance. | |||
== Contribution == | |||
Features and development are ongoing | |||
* Signal from Noise meeting ([https://etherpad.mozilla.org/SignalFromNoise notes on etherpad]) | |||
* IRC: #ateam@irc.mozilla.org | |||
* email: klahnakoski@mozilla.com | |||
== Objective == | |||
dzAlerts' objective is to provide high quality, and detailed alerts on performance regressions. | |||
== History == | == History == | ||
| Line 15: | Line 25: | ||
dzAlerts is now completely separate, and uses an ElasticSearch cluster to pull slices of the test results data cube. It maintains enough information about the alerts so it can provide links to the Datazilla UI. | dzAlerts is now completely separate, and uses an ElasticSearch cluster to pull slices of the test results data cube. It maintains enough information about the alerts so it can provide links to the Datazilla UI. | ||
== | == Nomenclature == | ||
The nomenclature used by dzAlerts is a little different than the surrounding applications it deals with. This is to be consistent with the definitions of the same name overall, and to provide space for naming the fine features dzAlerts has visibility to, but are invisible to other systems. | |||
* '''Test Suite''' - or "suite" for short, is a set of bundled tests. All the "tests" referred to by Datazilla and Talos are actually bundles of individual tests. ''Dromeao_css'', ''kraken'', ''tp5o'', and ''tscrollx'' are examples of test suites | |||
* '''Test''' - a single test responsible for testing a feature. Dromaeo_css has 6 tests called dojo.html, ext.html, jquery.html, mootools.html, prototype.html and yui.html. These can also be called "pages", or "page tests". | |||
* '''Sub-Test''' - A test should be the finest grain, but unfortunately some tests bundle yet-deeper-but-unnamed tests into a single result. These are ETLed into normal tests for dzAlerts to digest, but we need a name for these in the wild. | |||
== General Design == | == General Design == | ||