Auto-tools/Projects/Stockwell/disable-recommended: Difference between revisions

Line 209: Line 209:
== Special cases / getting help ==
== Special cases / getting help ==
There are lots of "special cases" -- different types of tests, platform variations, and who knows what! If something seems odd, if you need more information, we're here to help: Ping/email :gbrown / :jmaher.
There are lots of "special cases" -- different types of tests, platform variations, and who knows what! If something seems odd, if you need more information, we're here to help: Ping/email :gbrown / :jmaher.
= Notes from email =
Before disabling or when you don't disable:
* you have to read the history and see if anyone is working on it or trying to figure out the bug
* review recent bug history
** if there is a patch under review or comments indicate that a fix
is coming soon, consider postponing disabling
* look at the last 7 days in orange factor
** if no longer failing, mark [stockwell fixed]
** some examples:
** https://bugzilla.mozilla.org/show_bug.cgi?id=1420472
** https://bugzilla.mozilla.org/show_bug.cgi?id=1421775
** https://bugzilla.mozilla.org/show_bug.cgi?id=1423386 (fixed 2 days ago- recent comment and proved on graph)
* if it is a harness (i.e. not a clear test case in the title), then comment and stress the importance
** https://bugzilla.mozilla.org/show_bug.cgi?id=1391545
** https://bugzilla.mozilla.org/show_bug.cgi?id=1407383
**
if there are tests to disable we need to edit the manifests:
* What type of test is this and where is the manifest? ./mach test-info
* Which platforms are affected? opt/debug/both, os, other
* One time mercurial setup:
https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Source_Code/Mercurial
* Creating a patch and requesting review
We'll need separate guides to disabling syntax for:
* manifest parser
** mochitest.ini, browser.ini, chrome.ini, xpcshell.ini, a11y.ini
* reftest manifests
** reftest.list, crashtests.list
** use fuzzing if possible
* web-platform tests
** testing/web-platform
* autophone (easily confused with above .ini/.list manifests)
Confirmed users
1,759

edits