QA/Fenix/94.0.0/beta.2: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(12 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small> [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] | [[QA/Fenix/94.0.0/beta.2 | Fenix 94.0.0 Beta 2]] | </small>
<small> [[QA/Fenix/94.0.0/beta.1 | Fenix 94.0.0 Beta 1]] | [[QA/Fenix/94.0.0/beta.2 | Fenix 94.0.0 Beta 2]] |  | [[QA/Fenix/94.0.0/beta.3 | Fenix 94.0.0 Beta 3]] | </small>


= Firefox 94.0.0 Beta 2 Test Plan =
= Firefox 94.0.0 Beta 2 Test Plan =
Line 5: Line 5:
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v93.0.0-beta.2 Firefox 93.0.0 Beta 2]
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v94.0.0-beta.2 Firefox 94.0.0 Beta 2]
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/49243 Test Plan]  
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/49243 Test Plan]  


Line 28: Line 28:
  |-
  |-
  | Andrei Bodea
  | Andrei Bodea
  |  
  | ARM
  |  
  | Samsung Galaxy S21 Ultra (Android 11)
  | October 11th, 2021
  | October 11th, 2021
  |'''In Progress'''
  |'''Pass'''
|-
|-
| Andrei Bodea
| ARM
| Samsung Galaxy A8  (Android 9)
| October 11th, 2021
|'''Pass'''
  |-  
  |-  
  | Laurentiu Apahidean
  | Laurentiu Apahidean
Line 37: Line 44:
  | Huawei MediaPad M3 (Android 7)
  | Huawei MediaPad M3 (Android 7)
  | October 11th, 2021
  | October 11th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-  
  |-  
  | Lorand Janos  
  | Lorand Janos  
Line 43: Line 50:
  | Samsung Galaxy Tab S3 (Android 9)
  | Samsung Galaxy Tab S3 (Android 9)
  | October 11th, 2021
  | October 11th, 2021
  |'''In Progress'''
  |'''Pass'''
|-
|-
| Lorand Janos
| ARM
| Huawei P9 Lite (Android 8)
| October 11th, 2021
|'''Pass'''
  |-  
  |-  
  | Andrei Jolțan
  | Andrei Jolțan
  | ARM - Automated UI test run
  | ARM - Automated UI test run
  | Google Pixel 3a (Android 11)  
  | Google Pixel 3a (Android 11)  
| October 11th, 2021
|'''Pass'''
|-
| Oana Horvath
| ARM - Automated UI test run
| Google Pixel 2 (Android 9)
  | October 11th, 2021
  | October 11th, 2021
  |'''Pass'''
  |'''Pass'''
Line 60: Line 80:
{| class="wikitable" width=100%
{| class="wikitable" width=100%
  |-  
  |-  
  |'''Done'''
| '''All'''
| October 11th, 2021
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
* Update to Android-Components 94.0.3
* Update to Android-Components 94.0.3
*[https://github.com/mozilla-mobile/fenix/issues/21574 21574] - Move "what's new" behind feature flag - '''✅ Verified as fixed'''
*[https://github.com/mozilla-mobile/fenix/issues/21611 21611] - Jump back in Contextual Hints for Firefox Android 94 Release - '''✅ Verified as fixed'''
*[https://github.com/mozilla-mobile/fenix/issues/21765 21765] - [Bug]: “Thought-provoking stories” is wrongly enabled by default in Firefox Beta 94 for English-US - '''✅ Verified as fixed'''
*[https://github.com/mozilla-mobile/fenix/issues/21794 21794] - Inactive tabs: reverse arrow - '''❌ Reopened'''
*[https://github.com/mozilla-mobile/fenix/issues/21313 21313] - [Telemetry] Renew/delete probes for Nov/Dec - '''✅ Verified as fixed'''


== Issues ==
== Issues ==
Line 75: Line 102:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/android-components/issues/3108 3108] - Add new safe browsing policies for Malware in iframe and Billing warning
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/16128 16128] - [Bug] "Font size" option is aligned to the left on tablets
* [https://github.com/mozilla-mobile/fenix/issues/18694 18694] - [Bug] The dot from the scale overlaps the percentage number
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size

Latest revision as of 05:19, 13 October 2021

Fenix 94.0.0 Beta 1 | Fenix 94.0.0 Beta 2 | | Fenix 94.0.0 Beta 3 |

Firefox 94.0.0 Beta 2 Test Plan

Light smoke & sanity tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Andrei Bodea ARM Samsung Galaxy S21 Ultra (Android 11) October 11th, 2021 Pass
Andrei Bodea ARM Samsung Galaxy A8 (Android 9) October 11th, 2021 Pass
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7) October 11th, 2021 Pass
Lorand Janos ARM Samsung Galaxy Tab S3 (Android 9) October 11th, 2021 Pass
Lorand Janos ARM Huawei P9 Lite (Android 8) October 11th, 2021 Pass
Andrei Jolțan ARM - Automated UI test run Google Pixel 3a (Android 11) October 11th, 2021 Pass
Oana Horvath ARM - Automated UI test run Google Pixel 2 (Android 9) October 11th, 2021 Pass


Smoke Tests

https://testrail.stage.mozaws.net/index.php?/plans/view/48555

Bug verification

All October 11th, 2021 Done
  • Update to Android-Components 94.0.3
  • 21574 - Move "what's new" behind feature flag - ✅ Verified as fixed
  • 21611 - Jump back in Contextual Hints for Firefox Android 94 Release - ✅ Verified as fixed
  • 21765 - [Bug]: “Thought-provoking stories” is wrongly enabled by default in Firefox Beta 94 for English-US - ✅ Verified as fixed
  • 21794 - Inactive tabs: reverse arrow - ❌ Reopened
  • 21313 - [Telemetry] Renew/delete probes for Nov/Dec - ✅ Verified as fixed

Issues

New issues

Major:

Other:

Known issues

Major:

Other:

  • 9910 - Display video in full-screen when returning from PiP mode
  • 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
  • 16128 - [Bug] "Font size" option is aligned to the left on tablets
  • 18694 - [Bug] The dot from the scale overlaps the percentage number
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size