MozillaWiki

Releases/Firefox 66/Test Plan: Difference between revisions

Page Discussion

Releases/Firefox 66/Test Plan (view source)

Revision as of 15:30, 7 May 2019

13,714 bytes added ,  7 May 2019
m
→‎Release Candidates: -
 
(32 intermediate revisions by 8 users not shown)
Line 172: Line 172:
  ! width="200" | TEST REPORT
  ! width="200" | TEST REPORT
  |-
  |-
  | style="text-align:center;" | date
  | style="text-align:center;" | 2018-12-20
  | style="background:grey; color: white;" | tbd
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* .
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1515332%2C1515289&list_id=14609242  2 new bugs] uncovered, low-impact.
* .
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/ Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=558178%2C%201476585%2C%201465445%2C%201393460%2C%201511869%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201194214%2C%201471233%2C1481496%2C%201360545%2C%201378105%2C%201354992%2C1494258%2C%201476591%2C%201445644%2C%201282075%2C%201503603%2C1449956%2C%201490833%2C%201494270%2C1352397%2C1473904%2C%201512428%2C1482918&bug_id_type=anyexact&query_format=advanced&list_id=14482784 Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1338 TestRail link]
  |-
  |-
  | style="text-align:center;" | date
  | style="text-align:center;" | 2019-01-10
  | style="background:grey; color: white;" | tbd
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* .
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1518802%2C1518473&list_id=14609244  2 new bugs] uncovered, low-impact.
* .
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/ Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201511869%2C%201393460%2C%201465445%2C%20558178%2C%201476585%2C%201360545%2C%201378105%2C%201354992%2C%201392028%2C%201328984%2C%201288773%2C1515332%2C%201471233%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201194214%2C%201481496%2C%201494258%2C1185974%2C1494270%2C%20478200%2C%201430114%2C1429084%2C1485135%2C%201490833%2C%20169132%2C%201454005%2C%20%2C1308007%2C&bug_id_type=anyexact&query_format=advanced&list_id=14505852 Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/TestRail link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1355 TestRail link]
|-
| style="text-align:center;" | 2019-01-23
| style="background:green; color: white;" | GREEN
| style="text-align: left;" |
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1522099%2C1521865&list_id=14609247  2 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
| style="text-align: center;" | ---
| style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515332%2C%201515289%2C%201282075%2C%201194214%2C%20558178%2C%201393460%2C%201465445%2C%201476585%2C%201511869%2C%201518802%2C%201471233%2C%201511999%2C%201396732%2C%201441881%2C%201443511%2C%201481496%2C%201360545%2C%201449956%2C%201354992%2C%201494258%2C%201185974%2C%201494270%2C%201499557%2C%201499805%2C%201481755%2C%201470409%2C%201358102%2C%201470409%2C%201358102%2C%201470152%2C%201251982%2C%201204241%2C%201470152&bug_id_type=anyexact&list_id=14526616&resolution=---&query_format=advanced Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1410 TestRail link]
  |-
  |-
|}
|}
Line 407: Line 416:
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]  
** {{mnotstarted|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1pdhpLWG93lZtygJS2ZX341x11uBcPouAPYmgrjxPuM8/edit# report]
 
=== Beta 13 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b13-candidates/build1/ 66.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/42bac7964f74 42bac7964f74] | (ID: 20190304101322)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/13 Firefox 66 Beta 13]
** 66.0b13-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Search, Default & custom theme support.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15857 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1TmCfARCCdWMimAxDeYKYBDRmN8yqUsyKZc60rFSaJno/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1TmCfARCCdWMimAxDeYKYBDRmN8yqUsyKZc60rFSaJno/edit report]
 
=== Beta 14 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0b14-candidates/build1/ 66.0b14-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/13bfcad39c39 13bfcad39c39] | (ID: 20190307095232)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/14 Firefox 66 Beta 14]
** 66.0b14-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Session restore, Build installation & uninstallation, File system interaction and macOS signing.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/15947 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=166794611 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels, [https://docs.google.com/document/d/1jI_6C_s8fkR6RAGG6Dhw3rPjhqEptmRM_o-ZxZttGM0/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels, [https://docs.google.com/document/d/1jI_6C_s8fkR6RAGG6Dhw3rPjhqEptmRM_o-ZxZttGM0/edit report]
 
== Release Candidates ==
 
=== 66.0-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/65.0-candidates/build1/ 65.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/be4781c53713 be4781c53713] | (ID: 20190121133710)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_65/Test_Plan/Beta/RC1 Firefox 65 RC1]
** 65.0-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14871 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/16oFDVlAV6iLM6ex6JamWHEnSHRI1fvQWYB0laJA_iDk/edit report]
** {{mnotstarted|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/16oFDVlAV6iLM6ex6JamWHEnSHRI1fvQWYB0laJA_iDk/edit report]
** {{mnotstarted|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/16uqxeX1zJJQ47Ea16SPH8mIdFCSi4rwcijL2X3b62FE/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/16uqxeX1zJJQ47Ea16SPH8mIdFCSi4rwcijL2X3b62FE/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/16uqxeX1zJJQ47Ea16SPH8mIdFCSi4rwcijL2X3b62FE/edit report]
 
=== 66.0-build2 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/66.0-candidates/build2/ 66.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/7c987c3a5840 7c987c3a5840] | (ID: 20190313193404)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/RC2 Firefox 66 RC2]
** 66.0-build2
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16124 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1JTds4tAM4N3rmBGN5R_7-v5Zs3UUHndXbKsBxF4Ea_A/edit report]
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1JTds4tAM4N3rmBGN5R_7-v5Zs3UUHndXbKsBxF4Ea_A/edit report]
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/10wl40ng_xUEvbVP5kZaAHc5xAYGGCl0sLH2hIAow5Kc/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/10wl40ng_xUEvbVP5kZaAHc5xAYGGCl0sLH2hIAow5Kc/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/10wl40ng_xUEvbVP5kZaAHc5xAYGGCl0sLH2hIAow5Kc/edit report]
 
=== 66.0-build3 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0-candidates/build3/ 66.0-build3] | [https://hg.mozilla.org/releases/mozilla-release/rev/https://hg.mozilla.org/releases/mozilla-release/rev/164a57c0cdf0088e786e6b966e34fdd3799671d1 164a57c0cdf0088e786e6b966e34fdd3799671d1] | (ID: 20190314174725)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/66.0 Firefox 66 RC3]
** 66.0-build3
*** {{mdone|}} Smoke Testing on: Web Compatibility, Safe Browsing and Geolocation.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16149 TestRail].
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1hNl-MD25b9VEho7fPlsNIRWfU0OdvVOIKQv-ZnbFG1c/edit# report]
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1hNl-MD25b9VEho7fPlsNIRWfU0OdvVOIKQv-ZnbFG1c/edit# report]
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1PdIcPCqAI6wGWz9HuiMA-IE5JPUT5DtMkEttBxzZmyI/edit report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1PdIcPCqAI6wGWz9HuiMA-IE5JPUT5DtMkEttBxzZmyI/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1PdIcPCqAI6wGWz9HuiMA-IE5JPUT5DtMkEttBxzZmyI/edit report]
 
=== 66.0.1-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0.1-candidates/build1/ 66.0.1-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/662e97c69103 662e97c69103] | (ID: 20190322013140)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/66.0.1 Firefox 66.0.1]
** 66.0.1-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16320 TestRail].
* Updates testing
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1q5WPzPon9MJhVnGVcEze8YZUbd6knVk_K3JfkTkZzJc/edit report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1q5WPzPon9MJhVnGVcEze8YZUbd6knVk_K3JfkTkZzJc/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1q5WPzPon9MJhVnGVcEze8YZUbd6knVk_K3JfkTkZzJc/edit report]
 
=== 66.0.2-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0.2-candidates/build1/ 66.0.2 build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/ed39a05717aa ed39a05717aa] | (ID: 20190326175229)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/66.0.2 Firefox 66.0.2]
** 66.0.2-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16455 TestRail].
* Updates testing
** [Dropped] Updates on ''release-localtest'' channel
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1TdPy39d0vG9yzhrpOeecjLbSkA9b2xSfjdIUlDYuje8/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1TdPy39d0vG9yzhrpOeecjLbSkA9b2xSfjdIUlDYuje8/edit report]
 
=== 66.0.3-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0.3-candidates/build1/ 66.0.3 build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/37ecfd08ffee 37ecfd08ffee] | (ID: 20190409155332)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/66.0.3 Firefox 66.0.3]
** 66.0.3-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/16832 TestRail].
* Updates testing
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1DleAv2iB-AhE7_u9WDDhy0JrO_8hhug-CdewHTyFeQA/edit# report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1DleAv2iB-AhE7_u9WDDhy0JrO_8hhug-CdewHTyFeQA/edit# report]
 
=== 66.0.4-build3 ===
==== Build Information ====
* Build 3: [https://archive.mozilla.org/pub/firefox/candidates/66.0.4-candidates/build3/ 66.0.4 build3] | [https://hg.mozilla.org/releases/mozilla-release/rev/848b15028562 848b15028562] | (ID: 20190504212614)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_66/Test_Plan/Beta/66.0.4 Firefox 66.0.4]
** 66.0.4-build3
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17279 TestRail].
* Updates testing
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1l5RXZyQD7_9DaGkyoR5si3HoL_fQ6vYGcYmLivXJU_Q/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1l5RXZyQD7_9DaGkyoR5si3HoL_fQ6vYGcYmLivXJU_Q/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1l5RXZyQD7_9DaGkyoR5si3HoL_fQ6vYGcYmLivXJU_Q/edit report]
 
=== 66.0.5-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/66.0.5-candidates/build1/ 66.0.5 build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/96d2576eae4baf0aa961b4f5a1dadd26bb8ee823 96d2576eae4baf0aa961b4f5a1dadd26bb8ee823] | (ID: 20190507012018)
 
==== Testing ====
* Manual
** 66.0.5-build1
*** {{mnotstarted|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/17365 TestRail].
* Updates testing
** {{mnotstarted|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/11kuxp2BMCRPOzBfadvgN752VaLBnJGrub9Ex44RZ2II/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/11kuxp2BMCRPOzBfadvgN752VaLBnJGrub9Ex44RZ2II/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/11kuxp2BMCRPOzBfadvgN752VaLBnJGrub9Ex44RZ2II/edit report]
Andrei.vaida
Confirmed users
1,595

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/1208330...1211946"