Releases/Firefox 61/Test Plan: Difference between revisions

no edit summary
No edit summary
 
(27 intermediate revisions by 6 users not shown)
Line 292: Line 292:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b3-candidates/build1/ 61.0b3-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/22c0edf133aa 22c0edf133aa] | (ID: 20180507191226)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b3-candidates/build1/ 61.0b3-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/22c0edf133aa 22c0edf133aa] | (ID: 20180507191226)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b3-candidates/build1/ 61.0b3-build1]


==== Testing ====
==== Testing ====
Line 299: Line 300:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/915 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/915 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/3 Fennec 61 Beta 3]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel , [https://public.etherpad-mozilla.org/p/beta-61.0b3-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel , [https://public.etherpad-mozilla.org/p/beta-61.0b3-build1 report]  
Line 320: Line 322:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b5-candidates/build1/ 61.0b5-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/d8660eabf305 d8660eabf305] | (ID: 20180514150347)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b5-candidates/build1/ 61.0b5-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/d8660eabf305 d8660eabf305] | (ID: 20180514150347)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b5-candidates/build1/ 61.0b5-build1]


==== Testing ====
==== Testing ====
Line 327: Line 330:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/919 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/919 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/5 Fennec 61 Beta 5]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel , [https://docs.google.com/document/d/1TOPuBWZZ950SRFI3r64Pc4_-UH7Do8lOzSLEZDOAPeg/edit report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel , [https://docs.google.com/document/d/1TOPuBWZZ950SRFI3r64Pc4_-UH7Do8lOzSLEZDOAPeg/edit report]  
Line 348: Line 352:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b7-candidates/build1/ 61.0b7-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/4268240fb6d9  4268240fb6d9] | (ID: 20180521110957)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b7-candidates/build1/ 61.0b7-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/4268240fb6d9  4268240fb6d9] | (ID: 20180521110957)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b7-candidates/build1/ 61.0b7-build1]


==== Testing ====
==== Testing ====
Line 355: Line 360:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/9885 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/9885 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/7 Fennec 61 Beta 7]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b7-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b7-build1 report]  
Line 376: Line 382:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b9-candidates/build1/ 61.0b9-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/d81b581fbd2c  d81b581fbd2c] | (ID: 20180528091514)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b9-candidates/build1/ 61.0b9-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/d81b581fbd2c  d81b581fbd2c] | (ID: 20180528091514)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b9-candidates/build1/ 61.0b9-build1]


==== Testing ====
==== Testing ====
Line 383: Line 390:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/9974 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/9974 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/9 Fennec 61 Beta 9]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b9-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b9-build1 report]  
Line 404: Line 412:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b11-candidates/build1/ 61.0b11-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/c13cb09f0c25 c13cb09f0c25] | (ID: 20180604143143)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b11-candidates/build1/ 61.0b11-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/c13cb09f0c25 c13cb09f0c25] | (ID: 20180604143143)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b11-candidates/build1/ 61.0b11-build1]


==== Testing ====
==== Testing ====
Line 411: Line 420:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10061 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10061 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/11 Fennec 61 Beta 11]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b11-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b11-build1 report]  
Line 418: Line 428:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b12-candidates/build1/ 61.0b12-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/873262bdac1b 873262bdac1b] | (ID: 20180604143143)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b12-candidates/build1/ 61.0b12-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/873262bdac1b 873262bdac1b] | (ID: 20180604143143)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b12-candidates/build1/ 61.0b12-build1]


==== Testing ====
==== Testing ====
Line 425: Line 436:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10194 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10194 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/12 Fennec 61 Beta 12]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b12-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b12-build1 report]  
Line 432: Line 444:
==== Build Information ====
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b13-candidates/build1/ 61.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/5b5e620e33ee 5b5e620e33ee] | (ID: 20180611134439)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b13-candidates/build1/ 61.0b13-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/5b5e620e33ee 5b5e620e33ee] | (ID: 20180611134439)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b13-candidates/build1/ 61.0b13-build1]


==== Testing ====
==== Testing ====
Line 439: Line 452:
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10243 in TestRail].
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10243 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/13 Fennec 61 Beta 13]
* Updates testing
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b13-build1 report]  
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b13-build1 report]  
** {{mnotstarted|}} Updates on ''beta'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b13-build1 report]
** {{mdone|}} Updates on ''beta'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b13-build1 report]
 
=== Beta 14 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0b14-candidates/build1/ 61.0b14-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/585281dde960 585281dde960] | (ID: 20180614135649)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/14 Firefox 61 Beta 14]
** 61.0b14-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Content scroll, zoom & drag support and Profile support & compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/plans/view/10301 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
* Updates testing
** {{mdone|}} Updates on ''beta-cdntest'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b14-build1 report]
** {{mdone|}} Updates on ''beta'' channel, [https://public.etherpad-mozilla.org/p/beta-61.0b14-build1 report]
 
=== Beta 15 ===
==== Build Information ====
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0b15-candidates/build1/ 61.0b14-build1]
 
==== Testing ====
* Manual - Mobile only build 
** [https://wiki.mozilla.org/QA/Fennec/61/Beta/15 Fennec 61 Beta 15]
 
 
=== 61.0 Release Candidate ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0-candidates/build1/ 61.0-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/6f3df7ea04aa 6f3df7ea04aa] | (ID: 20180618212916)
* Mobile Build 1: [http://archive.mozilla.org/pub/mobile/candidates/61.0-candidates/build1  61.0-build1]
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/61.0 Firefox 61 Release candidate]
** 61.0-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/10324 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/RC Fennec 61 RC]
** {{mdone|}}  Updates on ''beta-cdntest'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build1 report]
** {{mdone|}} Updates on ''beta'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build1 report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build1 report]
** {{mnotstarted|}} Updates on ''release'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build1 report]
 
=== 61.0 Release Candidate 2 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/61.0-candidates/build2/ 61.0-build2] | [https://hg.mozilla.org/releases/mozilla-beta/rev/f5ea361ceb75 f5ea361ceb75] | (ID: 20180620142108)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/61.0RC2 Firefox 61 Release candidate 2]
** 61.0-build2
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/10475 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** [https://wiki.mozilla.org/QA/Fennec/61/RC/build2 Fennec 61 RC build 2]
** {{mdone|}}  Updates on ''beta-cdntest'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build2 report]
** {{mnotstarted|}} Updates on ''beta'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build2 report]
** {{mnotstarted|}} Updates on ''release-cdntest'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build2 report]
** {{mnotstarted|}} Updates on ''release'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build2 report]
 
=== 61.0 Release Candidate 3 ===
==== Build Information ====
* Build 3: [https://archive.mozilla.org/pub/firefox/candidates/61.0-candidates/build3/ 61.0-build3] | [https://hg.mozilla.org/releases/mozilla-beta/rev/785d242a5b01 785d242a5b01] | (ID: 20180621125625)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/61.0RC3 Firefox 61 Release candidate 3]
** 61.0-build3
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/10501 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=803809069 Bug verification] with focus on the latest fixes to land in this build.
** {{mdone|}}  Updates on ''beta-cdntest'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build3 report]
** {{mdone|}} Updates on ''beta'' channel [https://public.etherpad-mozilla.org/p/rc-61.0-build3 report]
** {{mdone|}} Updates on ''release-cdntest'' channel [https://public.etherpad-mozilla.org/p/Firefox_61.0-build3 report]
** {{mdone|}} Updates on ''release'' channel [https://public.etherpad-mozilla.org/p/Firefox_61.0-build3 report]
 
=== 61.0.1 ===
==== Build Information ====
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/61.0.1-candidates/build1/ 61.0.1-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/7d280b7e277b 7d280b7e277b] | (ID: 20180704003137)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/61.0.1 Firefox 61.0.1]
** 61.0.1-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1002 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=663700695 Bug verification] with focus on the latest fixes to land in this build.
** {{mdone|}} Updates on ''release-localtest'' channel [https://public.etherpad-mozilla.org/p/Firefox_61.0.1-build1 report]
** {{mdone|}} Updates on ''release-cdntest'' channel [https://public.etherpad-mozilla.org/p/Firefox_61.0.1-build1 report]
** {{mdone|}} Updates on ''release'' channel [https://public.etherpad-mozilla.org/p/Firefox_61.0.1-build1 report]
 
=== 61.0.2 ===
==== Build Information ====
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/61.0.2-candidates/build1/ 61.0.2-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/975058795980 975058795980] | (ID: 20180807170231)
 
==== Testing ====
* Manual - [https://wiki.mozilla.org/Releases/Firefox_61/Test_Plan/Beta/61.0.2 Firefox 61.0.2]
** 61.0.2-build1
*** {{mdone|}} Smoke and Exploratory Testing with focus on: Search and Web Compatibility.
**** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1050 in TestRail].
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=663700695 Bug verification] with focus on the latest fixes to land in this build.
** {{mdone|}} Updates on ''release-localtest'' channel [https://public.etherpad-mozilla.org/p/61.0.2-build1 report]
** {{mdone|}} Updates on ''release-cdntest'' channel [https://public.etherpad-mozilla.org/p/61.0.2-build1 report]
** {{mdone|}} Updates on ''release'' channel [https://public.etherpad-mozilla.org/p/61.0.2-build1 report]
306

edits