Firefox OS/Performance/Investigating Alerts: Difference between revisions

Firefox OS/Performance/Investigating Alerts (view source)

1,070 bytes added , 14 May 2014

Confirmed users

3,376

edits

@@ Line 70: / Line 70: @@
 ** {{bug|1010396}} - document test names in detail
+The next section is the Datazilla links, these are mostly self explanatory and for more information on what the view in Datazilla means check out [[/Bisecting_Regressions|Bisecting_Regressions]]:
+[[File:Alert_datazilla_link.png|600px]]
+After the links to Datazilla, we show a link to a diff of the Gaia repository (all changes from the previous test run to the current one):
+[[File:Alert_github_diff.png|600px]]
+The next field is the date.  This is the date that the results were posted to Datazilla.  Not the date we did the build or started the test run.  Not the date that we detected the regression.  Since the alerting system waits for future data, this date will be a few hours older than the email:
+[[File:Alert_details_date.png|600px]]
+The last section of the details is the raw numbers for Before, After, and Diff:
+[[File:Alert_details_numbers.png|600px]]
+ * Before - the MEAN value of the previous 10 data points you see on the graph
+ * After - the MEAN value of the current data point + 9 future ones which are seen on the graph
+ * Diff - After - Before