533
edits
Brindusa.tot (talk | contribs) |
Brindusa.tot (talk | contribs) |
||
(4 intermediate revisions by the same user not shown) | |||
Line 343: | Line 343: | ||
|- | |- | ||
| Temporary or permanent telemetry monitoring | | Temporary or permanent telemetry monitoring | ||
|style="text-align:center;" | | |style="text-align:center;" | N/A || List of error conditions to monitor | ||
|- | |- | ||
| Telemetry correctness testing | | Telemetry correctness testing | ||
|style="text-align:center;" | | |style="text-align:center;" | N/A || | ||
|- | |- | ||
| Server integration testing | | Server integration testing | ||
Line 449: | Line 449: | ||
'''Nightly testing'''<br /> | '''Nightly testing'''<br /> | ||
List of OSes that will be covered by testing<br /> | *List of OSes that will be covered by testing<br /> | ||
** Windows 7 x64 | |||
** Ubuntu 16.04 x64 | |||
** Mac OS X 10.11 (El Capitan) | |||
*Link for the tests run | *Link for the tests run | ||
** Full Test suite - [https://testrail.stage.mozaws.net/index.php?/runs/view/1949&group_by=cases:section_id&group_order=asc Nightly tests] | |||
** Full Test suite | *This feature was treated as bug work, so no sign-off email was sent | ||
* | |||
'''Merge to Aurora Sign-off''' | '''Merge to Aurora Sign-off'''<br /> | ||
List of OSes that will be covered by testing<br /> | *List of OSes that will be covered by testing<br /> | ||
** Windows 10 x64 | |||
** Ubuntu 16.04 x64 | |||
** Mac OS X 10.12 (Sierra) | |||
*Link for the tests run | *Link for the tests run | ||
** Full Test suite | ** Full Test suite - [https://testrail.stage.mozaws.net/index.php?/runs/view/2470&group_by=cases:section_id&group_order=asc Aurora tests] | ||
*This feature was treated as bug work, so no sign-off email was sent | |||
'''Merge to Beta/Pre-Release Sign-off''' | |||
*List of OSes that will be covered by testing<br /> | |||
** Windows 10 x64 | |||
** Windows 7 x32 | |||
** Ubuntu 16.04 x64 | |||
** Mac OS X 10.12 (Sierra) | |||
*Link for the tests run | |||
** Full Test suite - [https://testrail.stage.mozaws.net/index.php?/runs/view/3335&group_by=cases:section_id&group_order=asc Beta test runs] | |||
== Checklist == | == Checklist == | ||
Line 466: | Line 481: | ||
|- | |- | ||
| Testing Prerequisites (specs, use cases) | | Testing Prerequisites (specs, use cases) | ||
| style="text-align:center;" | | | style="text-align:center;" | {{mdone|}} | ||
| style="text-align:center;" | | | style="text-align:center;" | | ||
|- | |- | ||
| Testing Infrastructure setup | | Testing Infrastructure setup | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| Test Plan Creation | | Test Plan Creation | ||
| style="text-align:center;" | | | style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| Test Cases Creation | | Test Cases Creation | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| Full Functional Tests Execution | | Full Functional Tests Execution | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} | ||
|style="text-align:center;" | | |style="text-align:center;" | | ||
|- | |- | ||
| Automation Coverage || | | Automation Coverage | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} | ||
|style="text-align:center;" | | |||
|- | |- | ||
| Performance Testing | | Performance Testing | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| All Defects Logged || || | | All Defects Logged | ||
|style="text-align:center;" | {{mdone|}}|| | |||
|- | |- | ||
| Critical/Blockers Fixed and Verified || || | | Critical/Blockers Fixed and Verified | ||
|style="text-align:center;" | {{mdone|}} || | |||
|- | |- | ||
| Metrics/Telemetry|| | | Metrics/Telemetry|| | ||
|style="text-align:center;" | | |style="text-align:center;" | | ||
|- | |- | ||
| QA Signoff - Nightly Release|| | | QA Signoff - Nightly Release | ||
|style="text-align:center;" | | |style="text-align:center;" | N/A | ||
|style="text-align:center;" | Was treated as bug work - no sign off email was sent. | |||
|- | |- | ||
| QA Aurora - Full Testing | | QA Aurora - Full Testing | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| QA Signoff - Aurora Release || | | QA Signoff - Aurora Release | ||
|style="text-align:center;"| | |style="text-align:center;" | N/A | ||
|style="text-align:center;"| Was treated as bug work - no sign off email was sent. | |||
|- | |- | ||
| QA Beta - Full Testing | | QA Beta - Full Testing | ||
|style="text-align:center;" | | |style="text-align:center;" | {{mdone|}} || | ||
|- | |- | ||
| QA Signoff - Beta Release || | | QA Signoff - Beta Release || | ||
|style="text-align:center;" | Email to be sent | |style="text-align:center;" | Email to be sent | ||
|} | |} |
edits