QA/Fenix/99.1.0/RC: Difference between revisions

< QA
No edit summary
No edit summary
 
(16 intermediate revisions by 6 users not shown)
Line 1: Line 1:
<small>[[QA/Fenix/99.0.0/beta.5| Fenix 99.0.0 Beta 5]] | [[QA/Fenix/99.1.0/RC| Fenix 99.1.0 RC]]</small>
<small>[[QA/Fenix/99.0.0/beta.5| Fenix 99.0.0 Beta 5]] | [[QA/Fenix/99.1.0/RC| Fenix 99.1.0 RC]] | [[QA/Fenix/99.1.1/RC| Fenix 99.1.1 RC]]</small>




Line 6: Line 6:
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Build: [https://firefox-ci-tc.services.mozilla.com/tasks/index/mobile.v2.fenix.release.2022.03.01.latest/arm64-v8a Firefox 98.1.0 RC]
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v99.1.0 Firefox 99.1.0 RC]
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/54173 Test Plan]  
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/55416 Test Plan]  


== Full Functional & UI tests ==
== Full Functional & UI tests ==
Line 28: Line 28:
  ! Results
  ! Results
  |-
  |-
  | Delia Pop
  | Lorand Janos
  | ARM
  | ARM
  | Samsung S10E (Android 10)
  | Samsung S10E (Android 10)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-
  |-
  | Delia Pop
  | Delia Pop
  | ARM
  | ARM
  | Motorola Moto G30 (Android 11)
  | LG G7 fit (Android 8.1.0)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
  | ARM - automated tests
  | x86 - automated tests
  | Google Pixel 3a (Android 11)
  | Google Pixel 3 (Android 10)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-
  |-
Line 49: Line 49:
  | x86 - automated tests
  | x86 - automated tests
  | Google Pixel 2 (Android 9)  
  | Google Pixel 2 (Android 9)  
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-
  |-
Line 55: Line 55:
  | ARM
  | ARM
  | Google Pixel 4 (Android 12)
  | Google Pixel 4 (Android 12)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-
  |-
Line 61: Line 61:
  | ARM
  | ARM
  | Huawei Media Pad M3 (Android 7)
  | Huawei Media Pad M3 (Android 7)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-  
  |-  
  | Sorina Florean
  | Sorina Florean
  | ARM
  | ARM
  | Sony Xperia (Android 6.0.1)
  | OnePlus 9 Pro (Android 12)
  | March 1st, 2022
  | March 29th, 2022
  |'''Pass'''
  |'''Pass'''
  |-  
  |-  
Line 74: Line 74:


=== Manual and automated test runs ===
=== Manual and automated test runs ===
https://testrail.stage.mozaws.net/index.php?/plans/view/54173
https://testrail.stage.mozaws.net/index.php?/plans/view/55416


=== Bug verification ===
=== Bug verification ===
Line 80: Line 80:
  |-  
  |-  
  | '''All'''
  | '''All'''
  | March 1st, 2022
  | March 29th, 2022
  | '''Done'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>


* Update version to 98.1.0.
* Update to Android-Components 99.0.8.
* [https://github.com/mozilla-mobile/fenix/issues/24342 24342] - [Bug]: Possible dead code. Used method reference instead of invoking. - ✅Verified as fixed on RC 99.1.0 and Nightly


== Issues ==
== Issues ==
Line 95: Line 96:


=== Known issues ===
=== Known issues ===
Major:
* [https://github.com/mozilla-mobile/fenix/issues/22486 22486] - History UI deletion of items is very buggy
Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/24106 24106] - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/22186 22186] - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection
* [https://github.com/mozilla-mobile/fenix/issues/23814 23814] - [Bug]: Search result page not always included in Recently visited search group
* [https://github.com/mozilla-mobile/fenix/issues/16820 16820] - [Bug] Unable to play certain videos on the page due to unsupported video format
* [https://github.com/mozilla-mobile/fenix/issues/23064 23064] - [Bug]: "Jump back in" tabs are not visible on homescreen
* [https://github.com/mozilla-mobile/fenix/issues/22012 22012] - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/21960 21960] - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
* [https://github.com/mozilla-mobile/fenix/issues/16820 16820] - [Bug] Unable to play certain videos on the page due to unsupported video format
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/21356 21356] - [Bug] No crash report notification is triggered after app crash on Xiaomi device
* [https://github.com/mozilla-mobile/fenix/issues/24163 24163] - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
* [https://github.com/mozilla-mobile/fenix/issues/24133 24133] - [Bug]: Improper flicker displayed when switching between toolbar cards in the Onboarding screen
* [https://github.com/mozilla-mobile/fenix/issues/21498 21498] - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
* [https://github.com/mozilla-mobile/fenix/issues/22547 22547] - [Bug]: Pausing/Playing an audio file from soundcloud.com from the media notification causes a visual defect
* [https://github.com/mozilla-mobile/fenix/issues/23860 23860]- [Bug]: Incorrect tab number appears for a moment on swipe
* [https://github.com/mozilla-mobile/fenix/issues/24131 24131] - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices

Latest revision as of 06:12, 31 March 2022

Fenix 99.0.0 Beta 5 | Fenix 99.1.0 RC | Fenix 99.1.1 RC


Firefox 99.1.0 RC Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Lorand Janos ARM Samsung S10E (Android 10) March 29th, 2022 Pass
Delia Pop ARM LG G7 fit (Android 8.1.0) March 29th, 2022 Pass
Andrei Jolțan x86 - automated tests Google Pixel 3 (Android 10) March 29th, 2022 Pass
Oana Horvath x86 - automated tests Google Pixel 2 (Android 9) March 29th, 2022 Pass
Lorand Janos ARM Google Pixel 4 (Android 12) March 29th, 2022 Pass
Laurentiu Apahidean ARM Huawei Media Pad M3 (Android 7) March 29th, 2022 Pass
Sorina Florean ARM OnePlus 9 Pro (Android 12) March 29th, 2022 Pass


Manual and automated test runs

https://testrail.stage.mozaws.net/index.php?/plans/view/55416

Bug verification

All March 29th, 2022 Done


  • Update to Android-Components 99.0.8.
  • 24342 - [Bug]: Possible dead code. Used method reference instead of invoking. - ✅Verified as fixed on RC 99.1.0 and Nightly

Issues

New issues

Major:

Other:


Known issues

  • 22486 - History UI deletion of items is very buggy

Other:

  • 24106 - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
  • 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
  • 22186 - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection
  • 23814 - [Bug]: Search result page not always included in Recently visited search group
  • 16820 - [Bug] Unable to play certain videos on the page due to unsupported video format
  • 23064 - [Bug]: "Jump back in" tabs are not visible on homescreen
  • 22012 - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
  • 9910 - Display video in full-screen when returning from PiP mode
  • 21960 - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
  • 16820 - [Bug] Unable to play certain videos on the page due to unsupported video format
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 21356 - [Bug] No crash report notification is triggered after app crash on Xiaomi device
  • 24163 - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
  • 24133 - [Bug]: Improper flicker displayed when switching between toolbar cards in the Onboarding screen
  • 21498 - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
  • 22547 - [Bug]: Pausing/Playing an audio file from soundcloud.com from the media notification causes a visual defect
  • 23860- [Bug]: Incorrect tab number appears for a moment on swipe
  • 24131 - [Bug]: "Disconnect" button is not working on Sony Xperia after a period of time
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices