B2G/QA/Smoke Tests: Difference between revisions

→‎Smoke Test Blockers: updated "smoketest" to be "keyword" | updated Bugzilla query for keyword "smoketest" | changed [backout-needed] to [backout-asap]
(→‎Escalation Strategy: updated "smoketest" to be keyword | changed [backout-needed] to be [backout-asap] | updated Bugzilla query for [backout-asap])
(→‎Smoke Test Blockers: updated "smoketest" to be "keyword" | updated Bugzilla query for keyword "smoketest" | changed [backout-needed] to [backout-asap])
Line 34: Line 34:


= Smoke Test Blockers =
= Smoke Test Blockers =
Bugzilla Query for the Whiteboard tag "smoketest": http://mzl.la/16lkWbM
Bugzilla Query for the keyword "smoketest": http://mzl.la/17ZCuek


== Escalation Strategy ==
== Escalation Strategy ==
* When a Smoke Test Blocker is found, it is reported in Bugzilla with the Whiteboard tag "smoketest".
* When a Smoke Test Blocker is found, it is reported in Bugzilla with the keyword "smoketest".
* The QA Team is notified in the the #fxosqa IRC channel.
* The QA Team is notified in the the #fxosqa IRC channel.
* A regression window for the root cause of the bug is identified.
* A regression window for the root cause of the bug is identified.
* The developer who authored the commit is needinfo?ed with a request to back out the commit as soon as possible.
* The developer who authored the commit is needinfo?ed with a request to back out the commit as soon as possible.
* The Whiteboard tag "[backout-needed]" is added to the bug.
* The Whiteboard tag "[backout-asap]" is added to the bug.
* The [https://wiki.mozilla.org/Modules/FirefoxOS module owner] is also needinfo?ed.  
* The [https://wiki.mozilla.org/Modules/FirefoxOS module owner] is also needinfo?ed.  
* A Smoke Test report email is sent daily by the Firefox OS QA team to the following mailing lists: fxosqa-report-watchlist@mozilla.org and b2g-release-drivers@mozilla.org
* A Smoke Test report email is sent daily by the Firefox OS QA team to the following mailing lists: fxosqa-report-watchlist@mozilla.org and b2g-release-drivers@mozilla.org
* QA tracks the bug until the commit has been backed out.
* QA tracks the bug until the commit has been backed out.
* QA requests for a new nightly build to be created.
* QA requests for a new nightly build to be created.
* When a new build becomes available, QA verifies that the bug no longer reproduces.  
* When a new build becomes available, QA verifies that the bug no longer reproduces.


= Test Automation =
= Test Automation =
Confirmed users
330

edits