canmove, Confirmed users
2,041
edits
B2G/QA/Automation/UI/Best Practices: Difference between revisions
B2G/QA/Automation/UI/Best Practices (view source)
Revision as of 17:03, 23 March 2015
, 23 March 2015→Test Runs
| Line 94: | Line 94: | ||
* Separate stable and unstable tests. Stable test failures can be assumed to be correct, and can be escalated automatically. | * Separate stable and unstable tests. Stable test failures can be assumed to be correct, and can be escalated automatically. | ||
* Keep test runs green by [../ | * Keep test runs green by [/../Xfail and Disable|pruning known failures]. It's important to know which tests have just started failing today. | ||
* All test failures must be retested manually, even known intermittents. | * All test failures must be retested manually, even known intermittents. | ||
* Tests that are disabled must be re-added to manual test runs, or the coverage will be dropped. | * Tests that are disabled must be re-added to manual test runs, or the coverage will be dropped. | ||