342
edits
TestEngineering/Performance/Sheriffing/Workflow: Difference between revisions
TestEngineering/Performance/Sheriffing/Workflow (view source)
Revision as of 07:48, 13 November 2023
, 13 November 2023→Infra alerts
Alexandrui (talk | contribs) |
Alexandrui (talk | contribs) |
||
| Line 141: | Line 141: | ||
=== Infra alerts === | === Infra alerts === | ||
==== What is an infra alert ==== | |||
The regressions caused by infra changes are probably the most difficult to identify. Excepting the case when the infra change is announced and known of, an infra regression is usually most likely to be detected by the sheriff after all the suspect commits/bugs were removed from the list. | The regressions caused by infra changes are probably the most difficult to identify. Excepting the case when the infra change is announced and known of, an infra regression is usually most likely to be detected by the sheriff after all the suspect commits/bugs were removed from the list. | ||
| Line 152: | Line 154: | ||
<br /> | <br /> | ||
For an easy follow-up, there’s a [https://changelog.dev.mozaws.net/ changelog] containing the changes related to the infrastructure that is very useful when the investigation is leading to this kind of regression: https://changelog.dev.mozaws.net/ | For an easy follow-up, there’s a [https://changelog.dev.mozaws.net/ changelog] containing the changes related to the infrastructure that is very useful when the investigation is leading to this kind of regression: https://changelog.dev.mozaws.net/ | ||
<br /> | |||
<br /> | |||
==== How to handle infra alerts ==== | |||
Infra alerts became more frequent starting sometime in 2022, but the causes are still unknown for the moment. They usually come up in pairs of regression-improvement. When a regression comes up: | |||
<br /> | |||
* it has to be tagged with the '''infra''' tag and move it to '''investigating''' queue | |||
As soon as it comes back, if it is an improvement: | |||
<br /> | |||
* it has to be tagged with the '''infra, regression-fix, improvement''' tags and mark it as WONTFIX | |||
<br /> | |||
'''OR''' if the alert contains regression alerts: | |||
<br /> | |||
* it has to be tagged with the '''infra, regression-fix'''' tags and mark it as WONTFIX | |||
<br /> | |||
as well as the regression alert | |||
<br /> | |||
* has to be changed the status to '''FIXED''' | |||
=== Invalid alerts === | === Invalid alerts === | ||