160
edits
TestEngineering/Performance/Sheriffing/Alerts: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Sheriffing/Alerts (view source)
Revision as of 09:54, 16 January 2018
, 16 January 2018provide some short descriptions
(improve expression) |
(provide some short descriptions) |
||
| Line 7: | Line 7: | ||
=== Talos === | === Talos === | ||
* short description: | * short description: Monitors various time-based performance KPIs on the browser ([https://wiki.mozilla.org/index.php?title=Buildbot/Talos/Tests more details]) | ||
* frequency: daily, little more than a dozen alerts | * frequency: daily, little more than a dozen alerts | ||
* [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes (often requires backfilling) | * [https://wiki.mozilla.org/Buildbot/Talos/Sheriffing/Tree_FAQ#What_is_coalescing coalesced] by SETA?: yes (often requires backfilling) | ||
| Line 31: | Line 31: | ||
** build times often spike upwards for just a short time; they then lower to previous levels thanks to caching mechanisms set in place. We mark these as invalid alerts. | ** build times often spike upwards for just a short time; they then lower to previous levels thanks to caching mechanisms set in place. We mark these as invalid alerts. | ||
=== Autophone === | === Autophone === | ||
* short description: | * short description: Monitors mobile performance of browser ([https://wiki.mozilla.org/EngineeringProductivity/Autophone more details]) | ||
* frequency: every week or so, around 4 alerts | * frequency: every week or so, around 4 alerts | ||
* contact: :bc: | * contact: :bc: | ||
| Line 44: | Line 44: | ||
** retriggers are almost always needed, but results show up after a day or so | ** retriggers are almost always needed, but results show up after a day or so | ||
=== AWSY === | === AWSY === | ||
* short description: | * short description: Monitors memory consumption by the browser([https://wiki.mozilla.org/AWSY/Tests more details]) | ||
* frequency: every 2-3 days, around half a dozen | * frequency: every 2-3 days, around half a dozen | ||
* contact: :erahm | * contact: :erahm | ||
| Line 56: | Line 56: | ||
** retriggering/backfilling takes some time (>1h per test), so one must not abuse in collecting missing graph data | ** retriggering/backfilling takes some time (>1h per test), so one must not abuse in collecting missing graph data | ||
=== platform_microbench === | === platform_microbench === | ||
* short description: | * short description: N/A | ||
* frequency: daily, around 1-2 dozen alerts | * frequency: daily, around 1-2 dozen alerts | ||
* contact: | * contact: | ||