TestEngineering/Performance/FAQ: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "=Sheriffing= ==Tree== See TestEngineering/Performance/Sheriffing/Tree_FAQ. ==Alert== See TestEngineering/Performance/Sheriffing/Alert_FAQ ==Noise== See TestEngine...")
 
Line 2: Line 2:


==Tree==
==Tree==
See [[TestEngineering/Performance/Sheriffing/Tree_FAQ]].
=== Branch names and confusion ===
We have a variety of branches at Mozilla, here are the main ones that we see alerts on:
* Mozilla-Inbound (PGO, Non-PGO)
* Autoland (PGO, Non-PGO)
* Mozilla-Beta (all PGO)
 
Linux and Windows builds have [[TestEngineering/Performance/Sheriffing/Tree_FAQ#What_is_PGO|PGO]], OSX does not.
 
When investigating alerts, always look for the Non-PGO branch first.  Usually expect to find changes on Mozilla-Inbound (about 50%) and Autoland (50%).
 
The volume on the branches is something to be aware of, we have higher volume on Mozilla-Inbound and Autoland, this means that alerts will be generated faster and it will be easier to track down the offending revision.
 
A final note, Mozilla-Beta is a branch where little development takes place.  The volume is really low and alerts come 5 days (or more) later.  It is important to address Mozilla-Beta alerts ASAP because that is what we are shipping to customers.


==Alert==
==Alert==

Revision as of 12:59, 16 January 2020

Sheriffing

Tree

Branch names and confusion

We have a variety of branches at Mozilla, here are the main ones that we see alerts on:

  • Mozilla-Inbound (PGO, Non-PGO)
  • Autoland (PGO, Non-PGO)
  • Mozilla-Beta (all PGO)

Linux and Windows builds have PGO, OSX does not.

When investigating alerts, always look for the Non-PGO branch first. Usually expect to find changes on Mozilla-Inbound (about 50%) and Autoland (50%).

The volume on the branches is something to be aware of, we have higher volume on Mozilla-Inbound and Autoland, this means that alerts will be generated faster and it will be easier to track down the offending revision.

A final note, Mozilla-Beta is a branch where little development takes place. The volume is really low and alerts come 5 days (or more) later. It is important to address Mozilla-Beta alerts ASAP because that is what we are shipping to customers.

Alert

See TestEngineering/Performance/Sheriffing/Alert_FAQ

Noise

See TestEngineering/Performance/Sheriffing/Noise_FAQ

Perfherder

See TestEngineering/Performance/Sheriffing/Perfherder_FAQ