Firefox OS/Performance/Investigating Alerts
< Firefox OS | Performance
Jump to navigation
Jump to search
When you get an email from fxos-perf-alerts@mozilla.com, there is a good chance it is an automated email.
We have two types of automated alerts:
- Ingestion Alerts (we were expecting data and never received it)
- Regression Alerts (the values of the reported data have changed)
Regression Alerts
A regression alert has a Title in this format
'[ALERT][B2G] <testname> regressed by <-x.x> in <suite>'
example
'[ALERT][B2G] email_memory regressed by -3.6 in vsize, vsize'
The first part of the Alert is the score:
The score can map directly to the confidence of the alert sustaining over time. The range is from 2-4 where 4 is .9999% sure. In the above example, we have a score of 3.32 which is .99932% confident this is a sustained regression.