Confirmed users
330
edits
B2G/QA/Smoke Tests: Difference between revisions
→High Severity Smoke Tests: added tests and escalation strategy
(→Smoke Tests: Created the page) |
(→High Severity Smoke Tests: added tests and escalation strategy) |
||
| Line 1: | Line 1: | ||
__TOC__ | __TOC__ | ||
= High Severity | = High Severity Bugs = | ||
* Any action that bricks the device. | |||
* Any action that causes the device not to come up again after reboot. | |||
* Any action that causes the device to crash and reboot. | |||
* The following Sanity Test Cases fail without a workaround: | |||
** [RIL] Correct [https://en.wikipedia.org/wiki/Radio_Interface_Layer Radio Interface Layer] is installed | |||
** [OTA] [https://en.wikipedia.org/wiki/Over-the-air_programming Over The Air] update is successful | |||
** [Homescreen] The Homescreen is viewable | |||
** [Dialer] Can make an Outbound Call twice | |||
** [Dialer] Can make an Inbound Call twice | |||
** [SMS] Can send an Outbound Message twice | |||
** [SMS] Can receive an Inbound Message twice | |||
** [Camera] Can take a photo | |||
** [Camera] Can view the photo taken | |||
** [Browser] Can browse for 1-2 minutes over WiFi | |||
Note: The telephony tests are done twice to make sure that the process cleans up after itself when the first instance is over so that the second instance is also successful. | |||
== Escalation Strategy == | |||
* When a High Severity Bug is found, it is reported in Bugzilla with the Whiteboard tag "smoketest". | |||
* A notification email is sent by QAnalysts to the following mailing lists: mozilla-dev-b2g@lists.mozilla.org, dev-b2g@lists.mozilla.org, dev-gaia@lists.mozilla.org and b2g-release-drivers@mozilla.org | |||
* The IRC channel owners of #b2g and #gaia are notified in their respective channels. | |||
* A regression window for the root cause of the bug is identified. | |||
* The developer who authored the commit is needinfo?ed with a request to back out the commit as soon as possible. | |||
* The [https://wiki.mozilla.org/Modules/FirefoxOS module owner] is also needinfo?ed. | |||
* QA tracks the bug until the commit has been backed out. | |||
* When a new build become available, QA verifies that the bug no longer reproduces. | |||
= Smoke Tests by Functional Area = | = Smoke Tests by Functional Area = | ||