Releases/Firefox 64/Test Plan: Difference between revisions

no edit summary
No edit summary
 
(38 intermediate revisions by 6 users not shown)
Line 172: Line 172:
  ! width="200" | TEST REPORT
  ! width="200" | TEST REPORT
  |-
  |-
  | style="text-align:center;" | 2018-07-06
  | style="text-align:center;" | 2018-09-14
  | style="background:green; color: white;" | GREEN
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* No new bugs logged
* [https://bugzil.la/1490833  1 new bug] uncovered, low-impact.
* Known (old) bugs are low-impact.
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1393460%2C%201282075%2C%201378105%2C%201319761%2C%20558178%2C%201396732%2C%201441881%2C%201194214%2C%201416721%2C%201431062%2C%201462269%2C%201445644%2C%201309534%2C%201457858%2C%201462346%2C%201462283&bug_id_type=anyexact&query_format=advanced&list_id=14222121 Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1393460%2C%201282075%2C%201378105%2C%201319761%2C%20558178%2C%201396732%2C%201441881%2C%201194214%2C%201416721%2C%201431062%2C%201462269%2C%201445644%2C%201309534%2C%201457858%2C%201462346%2C%201462283&bug_id_type=anyexact&query_format=advanced&list_id=14222121 Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1004 TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1120 TestRail link]
  |-
  |-
  | style="text-align:center;" | 2018-07-20
  | style="text-align:center;" | 2018-09-27
  | style="background:green; color: white;" | GREEN
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* [https://bugzil.la/1476621,1476909,1476925,1476943,1476649,1476936,1476569 7 new bugs] uncovered, low-impact.
* [https://bugzil.la/1493930,1494258,1494270 3 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=558178%2C%20932289%2C%201194214%2C%201230678%2C%201277327%2C%201288773%2C%201305744%2C%201306590%2C%201308007%2C%201309534%2C%201328984%2C%201378105%2C%201392028%2C%201429084%2C%201436334%2C%201443511%2C%201447085%2C%20%201448002&list_id=14105260&bug_id_type=anyexact&query_format=advanced Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1476569%2C%20558178%2C%201476585%2C%201393460%2C%201282075%2C%201194214%2C%201396732%2C%201441881%2C%201443511%2C%201481755%2C%201481496%2C%201360545%2C%201449956%2C%201354992%2C%201490833%2C%201431062%2C%201468465%2C%091430114%2C%20545940%2C1328984%2C%201288773%2C%201416721%2C%201490459%2C%201370743%2C%20478200%2C%201487467&bug_id_type=anyexact&query_format=advanced&list_id=14355159 Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1014 TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1152 TestRail link]
  |-
  |-
  | style="text-align:center;" | 2018-08-09
  | style="text-align:center;" | 2018-10-18
  | style="background:green; color: white;" | GREEN
  | style="background:green; color: white;" | GREEN
  | style="text-align: left;" |  
  | style="text-align: left;" |  
* [https://bugzil.la/1481466,1481422,1481463,1481400,1481746,1481496,1481755,1481788,1481801,1481823 10 new bugs] uncovered, low-impact.
* [https://bugzil.la/1499557,1499805,1499541,1499315,1499377,1500075 6 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
* Known (old) bugs are low-impact.
  | style="text-align: center;" | ---
  | style="text-align: center;" | ---
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1447085%2C1480683%2C653826%2C1481422%2C1476569%2C1476649%2C1481496%2C1449956%2C1416721%2C1373830%2C1481746%2C1481823%2C1481788%2C1481755%2C1378105%2C1481463%2C%201257140%2C%201431062%2C%201447802%2C1481801%2C1470152%2C1381813%2C1251982&bug_id_type=anyexact&query_format=advanced&list_id=14383061 Bugzilla link]
  | style="text-align: center;" | [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1481823%201481755%201481496%201499541%201499805%201447802%201470409%201470152%201251982%201282075%201358102%201470152%201449956%201490459%201416721%201204241%201434929%201463363%201441881%201370743%201431062%201494270%201494258%201354992%201378105%201360545%201443511%201396732%201493930%201393460%201465445%201476569%201476585%20558178%201490833%201194214&list_id=14390005 Bugzilla link]
| style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1055 TestRail link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/plans/view/13001 TestRail link]
|-
| style="text-align:center;" | 2018-08-31
| style="background:GREEN; color: white;" | GREEN
| style="text-align: left;" |
* [https://bugzil.la/1487038,1487338,1487419,1487430,1487467 5 new bugs] uncovered, low-impact.
* Known (old) bugs are low-impact.
| style="text-align: center;" | ---
| style="text-align: center;" | [https://mzl.la/2POBT6q Bugzilla link]
  | style="text-align: center;" | [https://testrail.stage.mozaws.net/index.php?/reports/view/1105 TestRail link]
  |-
  |-
|}
|}
Line 418: Line 409:
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels , [https://docs.google.com/document/d/1VId0etg-iHq9eYdwHXcng5UDUAP7spwjHUa__XRXVu0/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels , [https://docs.google.com/document/d/1VId0etg-iHq9eYdwHXcng5UDUAP7spwjHUa__XRXVu0/edit report]  
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels , [https://docs.google.com/document/d/1VId0etg-iHq9eYdwHXcng5UDUAP7spwjHUa__XRXVu0/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels , [https://docs.google.com/document/d/1VId0etg-iHq9eYdwHXcng5UDUAP7spwjHUa__XRXVu0/edit report]
=== Beta 12 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/64.0b12-candidates/build1/ 64.0b12-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/4fcfd15911a1 4fcfd15911a1] | (ID: 20181122182000)
==== Testing ====
* Manual - [https://wiki.mozilla.org/index.php?title=Releases/Firefox_64/Test_Plan/Beta/12 Firefox 64 Beta 12]
** 64.0b12-build1
*** {{mdone}} Smoke and Exploratory Testing with focus on: Privacy & Activity Stream
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/13919 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels , [https://docs.google.com/document/d/1i35bX2mAtKkGWu8s7uGwUCTg3l2zOVJY3ExyHKuoMJE/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels , [https://docs.google.com/document/d/1i35bX2mAtKkGWu8s7uGwUCTg3l2zOVJY3ExyHKuoMJE/edit report]
=== Beta 13 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/64.0b13-candidates/build1/ 64.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/efca407c5be1 efca407c5be1] | (ID: 20181126173133)
==== Testing ====
* Manual - [https://wiki.mozilla.org/index.php?title=Releases/Firefox_64/Test_Plan/Beta/13 Firefox 64 Beta 13]
** 64.0b13-build1
*** {{mdone}} Smoke and Exploratory Testing with focus on: Plugin compatibility & support, Graphics compatibility & support and Smart Card
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/13947 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels , [https://docs.google.com/document/d/1Hi-MiisaJjJ82_XNvs_GD2LJ1OI9a1gHLL4r5dd4y0k/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels , [https://docs.google.com/document/d/1Hi-MiisaJjJ82_XNvs_GD2LJ1OI9a1gHLL4r5dd4y0k/edit report]
=== Beta 14 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/64.0b14-candidates/build1/ 64.0b14-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/fa72e773a9eb fa72e773a9eb] | (ID: 20181128185223)
==== Testing ====
* Manual - [https://wiki.mozilla.org/index.php?title=Releases/Firefox_64/Test_Plan/Beta/14 Firefox 64 Beta 14]
** 64.0b14-build1
*** {{mdone}} Smoke and Exploratory Testing with focus on: Search, In-browser PDF support and Awesomebar & indicators
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14019 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' & ''aurora-cdntest'' channels , [https://docs.google.com/document/d/1HkAgXpczwzYlS7ItUY0jwzKhTyRyiI0fXq1-8O_Ptmw/edit report]
** {{mdone|}} Updates on ''beta'' & ''aurora'' channels , [https://docs.google.com/document/d/1HkAgXpczwzYlS7ItUY0jwzKhTyRyiI0fXq1-8O_Ptmw/edit report]
== Release Candidates ==
=== 64.0-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/64.0-candidates/build1/ 64.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/80a34446b74a 80a34446b74a] | (ID: 20181203202653)
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_64/Test_Plan/Beta/RC1 Firefox 64 RC1]
** 64.0-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14052 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1_OhscPW-KKza9N8n9vao5RRxsAzGEMnrgxDUV7s0C3E/edit report]
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1_OhscPW-KKza9N8n9vao5RRxsAzGEMnrgxDUV7s0C3E/edit report]
** {{mnotstarted|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
=== 64.0-build2 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/64.0-candidates/build2/ 64.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/319052b37637 319052b37637] | (ID: 20181205213546)
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_64/Test_Plan/Beta/RC2 Firefox 64 RC2]
** 64.0-build2
*** {{mdone|}} Smoke Testing on: Web Compatibility & Graphics compatibility & support.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14111 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1jtISrUUBmD5Rh_r8GFXTW9y9jCpPGX6a06GHNvnNPwg/edit report]
** {{mnotstarted|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mnotstarted|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
=== 64.0-build3 ===
==== Build Information ====
* Build 3: [https://archive.mozilla.org/pub/firefox/candidates/64.0-candidates/build3/ 64.0-build3] | [https://hg.mozilla.org/releases/mozilla-release/rev/8337ebb86a42 8337ebb86a42] | (ID: 20181206201918)
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_64/Test_Plan/Beta/RC3 Firefox 64 RC3]
** 64.0-build3
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/14130 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1416132901 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://docs.google.com/document/d/1bRq2WEcqvC2Oqqs-mnA_R3wXGZ3DY1WmKBUWpJb5Wd8/edit report]
** {{mdone|}} Updates on ''beta'' channel, [https://docs.google.com/document/d/1bRq2WEcqvC2Oqqs-mnA_R3wXGZ3DY1WmKBUWpJb5Wd8/edit report]
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1aTyWipB8wbcwmxILqKLxjx5ICZxq3IXb9rcpHFb5O3k/edit report]
=== 64.0.2-build1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/64.0.2-candidates/build1/ 64.0.2-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/c58ea2229c33 c58ea2229c33] | (ID: 20190108160530)
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_64/Test_Plan/Beta/64.0.2 Firefox 64.0.2]
** 64.0.2-build1
*** {{mdone|}} Smoke Testing on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1353 TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=898339968 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''release-localtest'' channel, [https://docs.google.com/document/d/1vHN8QQIBPdIqCvBO27zEEzoxE_AiONcXpfHf_m8ZPqE/edit report]
** {{mdone|}} Updates on ''release-cdntest'' channel, [https://docs.google.com/document/d/1vHN8QQIBPdIqCvBO27zEEzoxE_AiONcXpfHf_m8ZPqE/edit report]
** {{mdone|}} Updates on ''release'' channel, [https://docs.google.com/document/d/1vHN8QQIBPdIqCvBO27zEEzoxE_AiONcXpfHf_m8ZPqE/edit report]
306

edits