QA/LZMA Support for Updater: Difference between revisions

m
 
(16 intermediate revisions by 2 users not shown)
Line 1: Line 1:
'''Approvals Required / Received'''
The following individuals are required to/have approved this Test Plan:
{| class="wikitable"
|-
! Name !! Title !! Department !! Approval Date !! Method
|-
| RyanVM  || QA Reviewer ||Product Integrity || n/a||    Email
|-
|Matt Howell  || Software Engineer || Engineering || 6/14/2017 ||    Email
|-
| David Durst || EPM || Product Management || n/a ||  Email
|}
'''Revision History'''
'''Revision History'''


Line 37: Line 52:
  Matt Howell<br />
  Matt Howell<br />


'''QA Eng. Softvision Las Vegas'''<br />
'''QA Eng. Softvision Las Vegas - Nightly testing'''<br />
[mailto:stefan.georgiev@softvision.com Stefan Georgiev - Team Lead ]<br />
[mailto:amasresha@softvision.com Abe Masresha]<br />
[mailto:amasresha@softvision.com Abe Masresha - Test Lead]<br />
 
[mailto:jwilliams@softvision.com Justin Williams - Tester]<br />
'''QA - Beta testing'''<br />
[mailto:gwimberly@softvision.com Grover Wimberly IV - Tester]<br />
[mailto:petruta.rasa@softvision.ro Petruta Rasa]<br />
[mailto:kkumari@softvision.com Kanchan Kumari - Tester]<br />
 
= Testing summary =  
= Testing summary =  
== Scope of Testing ==
== Scope of Testing ==
Line 124: Line 138:
This section should contain links for builds with the feature -  
This section should contain links for builds with the feature -  
* Links for Nightly build:  [https://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Nightly build]
* Links for Nightly build:  [https://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Nightly build]
* Links for Beta build: use beta build 56b3
* Links for Beta build: use beta build later than [https://archive.mozilla.org/pub/firefox/candidates/56.0b3-candidates/build1/ 56b3]


== Test Execution Schedule ==
== Test Execution Schedule ==
Line 133: Line 147:
|-
|-
| Start project  
| Start project  
|style="text-align:center;" | 5/30/2017  ||   
|style="text-align:center;" | 5/30/2017  ||  9/25/2017
|-
|-
| Study documentation/specs received from developers
| Study documentation/specs received from developers
Line 142: Line 156:
|-
|-
| QA - Test cases/Env preparation  
| QA - Test cases/Env preparation  
|style="text-align:center;" |7/31/2017  || 8/1/2017
|style="text-align:center;" |7/31/2017  || 8/31/2017
|-
|-
| QA - Nightly Testing  
| QA - Nightly Testing  
Line 148: Line 162:
|-
|-
| QA - Beta Testing  
| QA - Beta Testing  
|style="text-align:center;" | ||  
|style="text-align:center;" | 8/10/2017 || 9/8/2017
|-
|-
| Release Date  
| Release Date  
|style="text-align:center;" | ||  
|style="text-align:center;" | 9/19/2017 || 9/26/2017
|}
|}


Line 233: Line 247:
|None in pre-beta testing cycle || ||  || 56
|None in pre-beta testing cycle || ||  || 56
|-
|-
 
|-
|None during Beta testing cycle || ||  || 56
|-
|}
|}


Line 246: Line 262:
'''Nightly testing'''<br />
'''Nightly testing'''<br />
List of OSes that will be covered by testing:  see 'Environments' section <br />
List of OSes that will be covered by testing:  see 'Environments' section <br />
*Link for the tests run
**Links:
** [https://testrail.stage.mozaws.net/index.php?/suites/view/1110&group_by=cases:section_id&group_order=desc Full Test suite]<br>
** [https://testrail.stage.mozaws.net/index.php?/suites/view/1110&group_by=cases:section_id&group_order=desc Full Test suite]<br>
**[https://testrail.stage.mozaws.net/index.php?/plans/view/5274 Runs and Results]<br>
**[https://testrail.stage.mozaws.net/index.php?/plans/view/5274 Runs and Results]<br>
Line 252: Line 268:
** Regression Test suite, No regression bugs were found <br />
** Regression Test suite, No regression bugs were found <br />


'''Merge to Beta Sign-off'''<br />
'''Preliminary status report on Beta'''<br />
List of OSes that will be covered by testing<br />
Preliminary status report analysis shows that updating from Firefox 55.0bX, updates first to 56.0b3 and then to latest beta available on the channel. Also, update.mar files are correct and have the right format. Preliminary recommendation is to "ship it". <br />
** Link for the tests run
 
** Full Test suite
'''Pre-Release Sign-off - GREEN 2017-09-06''' <br />
*List of OSes covered by testing: Windows 7 64-bit, Windows 10 64-bit, Ubuntu 16.04 64-bit and Mac OS X 10.11<br />
** Link for the tests run -  [https://testrail.stage.mozaws.net/index.php?/plans/view/5274 link]
** Regression Test suite, No regression bugs were found <br />


== Checklist ==
== Checklist ==
Line 299: Line 318:
|-
|-
|  QA Beta - Full Testing
|  QA Beta - Full Testing
|style="text-align:center;" |{{in progress|}}
|style="text-align:center;" |{{mdone|}}
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|-
|  QA pre-Release Signoff  
|  QA pre-Release Signoff  
|style="text-align:center;" |{{in progress|}}
|style="text-align:center;" |{{mdone|}}
|style="text-align:center;" | Email to be sent  
|style="text-align:center;" | Email sent on 9/6/2017
|}
|}
Confirmed users
507

edits