Firefox OS/Performance/Investigating Alerts: Difference between revisions
< Firefox OS | Performance
Jump to navigation
Jump to search
| Line 14: | Line 14: | ||
[[File:Alert_full_clean.png|800px]] | [[File:Alert_full_clean.png|800px]] | ||
The first part of the Alert is the score: | |||
[[File:Alert_score.png|400px]] | [[File:Alert_score.png|400px]] | ||
The score can map directly to the confidence of the alert sustaining over time. The range is from 2-4 where 4 is .9999% sure. In the above example, we have a score of 3.32 which is .99932% confident this is a sustained regression. | |||
Revision as of 17:34, 14 May 2014
When you get an email from fxos-perf-alerts@mozilla.com, there is a good chance it is an automated email.
We have two types of automated alerts:
- Ingestion Alerts (we were expecting data and never received it)
- Regression Alerts (the values of the reported data have changed)
Regression Alerts
A regression alert has a Title in this format
'[ALERT][B2G] <testname> regressed by <-x.x> in <suite>'
example
'[ALERT][B2G] email_memory regressed by -3.6 in vsize, vsize'
The first part of the Alert is the score:
The score can map directly to the confidence of the alert sustaining over time. The range is from 2-4 where 4 is .9999% sure. In the above example, we have a score of 3.32 which is .99932% confident this is a sustained regression.