canmove, Confirmed users
1,126
edits
Sheriffing/Job Visibility Policy: Difference between revisions
m
→8) Must avoid patterns known to cause non deterministic failures: Fix whitespace
(Add mention of test timebombs & link to the MDN "Avoiding intermittent oranges" guide) |
m (→8) Must avoid patterns known to cause non deterministic failures: Fix whitespace) |
||
| Line 49: | Line 49: | ||
** Since these will cause failures when the external site is unavailable, as well as impacting end to end times & adding noise to performance tests. | ** Since these will cause failures when the external site is unavailable, as well as impacting end to end times & adding noise to performance tests. | ||
** eg: Emulator/driver binaries direct from a vendor's site, package downloads from PyPi or page assets for unit/performance tests. | ** eg: Emulator/driver binaries direct from a vendor's site, package downloads from PyPi or page assets for unit/performance tests. | ||
* Must not contain time bombs, e.g. tests that will fail after a | * Must not contain time bombs, e.g. tests that will fail after a certain date or when run at certain times. | ||
certain date or when run at certain times. | * See the [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Avoiding_intermittent_oranges guide on avoiding intermittent failures]. | ||
* See the [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Avoiding_intermittent_oranges guide on avoiding intermittent failures]. | |||
=== 9) Supports the disabling of individual tests === | === 9) Supports the disabling of individual tests === | ||