QA/LZMA Support for Updater: Difference between revisions

no edit summary
No edit summary
Line 11: Line 11:
| 6/13/2017 || 1.1 || Abe Masresha || Added link to automation tests and test cases
| 6/13/2017 || 1.1 || Abe Masresha || Added link to automation tests and test cases
|-
|-
| 8/10/2017 || 1.2 || Abe Masresha || added signoffs date and other sections
| 8/10/2017 || 1.2 || Abe Masresha || added signoffs date and other links
|-
|-
| 8/14/2017 || 1.3 || Abe Masresha || adding more information to the test plan
| 8/14/2017 || 1.3 || Abe Masresha || adding more information to the test plan
Line 19: Line 19:
= Overview =
= Overview =
== Purpose ==
== Purpose ==
The purpose of this work is to change the update file format using LZMA compression. The update will have LZMA support and the update file size will be smaller.
The purpose of this work is to change the update file format using LZMA compression because LZMA compression provides more file compression benefit over the current bzip2 compression.  
 


== Scope ==
== Scope ==
Line 26: Line 25:


::: Stability of the browser with this work.
::: Stability of the browser with this work.
::: Whether browser update is applied
::: Whether browser update is applied successfully
::: If the browser update is in the desized file format
::: If the browser update is in the desired file format
 


* How testing will be performed:
* How testing will be performed:
Line 77: Line 75:


=== Nightly ===
=== Nightly ===
Firefox Nightly 56.0a1, no special configuration is required<br>
Firefox Nightly 56.0a1, [https://docs.google.com/a/mozilla.com/document/d/1BW81CCLvKPsMlFvu1BSIOHXNLzFIKKL7UpBifMrKJI4/edit?usp=sharing Test environment setting is provided here]<br>
This patch was pushed to Mozilla-central on 7-31-2017, so all Nightly updates should update through this watershed.
This patch was pushed to Mozilla-central on 7-31-2017, so all Nightly updates should update through this watershed.


=== Beta ===
=== Beta ===
Beta 56.0b3, no special configuration is required<br>
Beta 56.0b3, [https://docs.google.com/a/mozilla.com/document/d/1BW81CCLvKPsMlFvu1BSIOHXNLzFIKKL7UpBifMrKJI4/edit?usp=sharing Test environment setting is provided here]<br> <br>
Feature was backed out [https://bugzilla.mozilla.org/show_bug.cgi?id=1387231 Bug 1387231] so the watershed for beta will be 56b3. <br>
Feature was backed out [https://bugzilla.mozilla.org/show_bug.cgi?id=1387231 Bug 1387231] so the new watershed of beta will be 56b3. <br>
To test on 56b3, 56b4 is required as this is update related work.<br>
To test on 56b3, the next beta build (56b4) should be avialable as this is an update related work.<br>


= Test Strategy =  
= Test Strategy =  
== Test Objectives ==
== Test Objectives ==
* Verify the update is in MAR file format. [https://docs.google.com/a/mozilla.com/document/d/1BW81CCLvKPsMlFvu1BSIOHXNLzFIKKL7UpBifMrKJI4/edit?usp=sharing More information is available here]  <br>
*Verify update is applied successfully
*Verify update is applied successfully
*Verify browser is stable and does not crash with this feature
*Verify browser is stable and does not crash with this feature
Line 92: Line 91:
*Verify update is applied when the browser has an add-on
*Verify update is applied when the browser has an add-on
*Verify Firefox is responsive if update download is interrupted by no internet connection
*Verify Firefox is responsive if update download is interrupted by no internet connection
* Verify the update is in MAR file format. [https://docs.google.com/a/mozilla.com/document/d/1BW81CCLvKPsMlFvu1BSIOHXNLzFIKKL7UpBifMrKJI4/edit?usp=sharing More information is available here]  <br>


== Builds ==
== Builds ==
This section should contain links for builds with the feature -  
This section should contain links for builds with the feature -  
* Links for Nightly build:  [https://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Nightly build]
* Links for Nightly build:  [https://archive.mozilla.org/pub/firefox/nightly/latest-mozilla-central/ Nightly build]
* Links for Beta build: use beta build later than 56b3
* Links for Beta build: use beta build 56b3


== Test Execution Schedule ==
== Test Execution Schedule ==
Line 145: Line 143:
== Overview ==
== Overview ==
Landed on Nightly on: 7/31/2017 <br>
Landed on Nightly on: 7/31/2017 <br>
Merged to Beta on: Beta 56b3 will have the patch. Start the testing when 56b4 is ready.
Merged to Beta on: Beta 56b3 will have the patch so start the testing when 56b4 is ready.


= References =
= References =
Line 197: Line 195:


== Test suite ==
== Test suite ==
  Full Test suite - Link to test rail - testcases should be added under Firefox Desktop project [https://testrail.stage.mozaws.net/index.php?/suites/view/1110&group_by=cases:section_id&group_order=desc link]
  Full Test suite - [https://testrail.stage.mozaws.net/index.php?/suites/view/1110&group_by=cases:section_id&group_order=desc test rail]
  Smoke Test suite -not applicable
  Smoke Test suite -not applicable in this case
  Regression Test suite - not applicable
  Regression Test suite - not applicable in this case


= Bug Work =
= Bug Work =
Line 215: Line 213:
Checklist
Checklist
* All test cases should be executed
* All test cases should be executed
* Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
* Has sufficient automated test coverage (as measured by code coverage tools)
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed  


== Results ==
== Results ==
Line 231: Line 229:
'''Merge to Beta Sign-off'''<br />
'''Merge to Beta Sign-off'''<br />
List of OSes that will be covered by testing<br />
List of OSes that will be covered by testing<br />
*Link for the tests run
** Link for the tests run
** Full Test suite
** Full Test suite


381

edits