QA/Fenix/95.0.0/beta.1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
No edit summary
 
(27 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small> [[QA/Fenix/94.1.1/RC| Fenix 94.1.1 RC]] | [[QA/Fenix/95.0.0/beta.1| Fenix 95.0.0 Beta 1]]</small>
<small> [[QA/Fenix/94.1.1/RC| Fenix 94.1.1 RC]] | [[QA/Fenix/95.0.0/beta.1| Fenix 95.0.0 Beta 1]] | [[QA/Fenix/95.0.0/beta.2| Fenix 95.0.0 Beta 2]]</small>


= Firefox 95.0.0 Beta 1 Test Plan =
= Firefox 95.0.0 Beta 1 Test Plan =
Line 27: Line 27:
  ! Results
  ! Results
  |-
  |-
  | Laurentiu Apahidean
  | Lorand Janos
  | ARM
  | ARM
  | Huawei MediaPad M3 (Android 7)
  | Samsung Galaxy A8 (Android 9)
  | November 3rd, 2021
  | November 3rd, 2021
  |'''In progress'''
  |'''Pass'''
  |-
  |-
  | Bodea Andrei
  | Bodea Andrei
Line 37: Line 37:
  | Google Pixel 4 XL (Android 11)
  | Google Pixel 4 XL (Android 11)
  | November 3rd, 2021
  | November 3rd, 2021
  |'''In progress'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
Line 43: Line 43:
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | November 3rd, 2021
  | November 3rd, 2021
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  | Mira Lobonțiu
  | Sorina Florean
  | ARM
  | ARM
  | Samsung Galaxy Tab A6 (Android 5.1.1)
  | Huawei Media Pad M2 (Android 5.1.1)
  | November 3rd, 2021
  | November 3rd, 2021
  | '''In progress'''
  | '''Pass'''
|-
| Oana Horvath
| ARM
| Huawei P9 Lite (Android 8)
| November 3rd, 2021
| '''In progress'''
  |-
  |-
  | Lorand Janos
  | Lorand Janos
Line 61: Line 55:
  | Samsung Galaxy Tab S3 (Android 9)
  | Samsung Galaxy Tab S3 (Android 9)
  | November 3rd, 2021
  | November 3rd, 2021
  | '''In progress'''
  | '''Pass'''
  |-
  |-
  |}  
  |}  
Line 86: Line 80:
</onlyinclude>
</onlyinclude>


* [https://github.com/mozilla-mobile/fenix/issues/22138 22138] - [Telemetry] Add telemetry for Install Source - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/22226 22226] - Crash when opening opening a history group - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/22172 22172] - MR2 telemetry: Recent searches (prev. recently visited) - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/22103 22103] - MR2 telemetry: Recent bookmarks - '''✅ Verified as fixed'''
* [https://github.com/mozilla-mobile/fenix/issues/22175 22175] - MR2 telemetry: delete group from Recent Searches - '''✅ Verified as fixed'''
Update Android Components version to 95.0.20211011143313.


== Issues ==
== Issues ==
Line 92: Line 93:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/22315 22315] - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
* [https://github.com/mozilla-mobile/fenix/issues/22314 22314] - [Bug]: Tapping a search group item should switch to the previously opened website
* [https://github.com/mozilla-mobile/fenix/issues/22313 22313] - [Bug]: Incorect link saved for the original search results
* [https://github.com/mozilla-mobile/fenix/issues/22308 22308] - [Bug]: Improperly displayed tabs tray more options menu after rotation
* [https://github.com/mozilla-mobile/fenix/issues/22309 22309] - [Bug]: Collapsing/expanding inactive tabs list doesn't work after switching the orientation of the device
* [https://github.com/mozilla-mobile/fenix/issues/22312 22312] - [Bug]: Unable to dismiss the context menu when long tapping on the tabs counter on Android 5.1.1
* [https://github.com/mozilla-mobile/fenix/issues/22310 22310] - [Bug]:Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected


=== Known issues ===
=== Known issues ===
Major:
Major:
* [https://github.com/mozilla-mobile/fenix/issues/22129 22129] - [Bug]: Refined search in result page may be added to wrong search group


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/18694 18694] - [Bug] The dot from the scale overlaps the percentage number
* [https://github.com/mozilla-mobile/fenix/issues/21414 21414] - [Bug]: Add logins dialog: save button is enabled when password field is blank
* [https://github.com/mozilla-mobile/fenix/issues/21404 21404] - [Bug]: Add logins duplicate login not checked on hostname edit
* [https://github.com/mozilla-mobile/fenix/issues/21403 21403] - [Bug]: Add logins dupe username error flashes then disappears
* [https://github.com/mozilla-mobile/fenix/issues/21402 21402] - [Bug]: Add logins empty username inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/12854 12854] - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1554226 1554226] - Add new Safe Browsing categories.
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version
* [https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/8927 8927] - [Bug] Logging out from Twitter is not working as the user remains logged in
* [https://github.com/mozilla-mobile/fenix/issues/11467 11467] - [Bug] User not visible logged out if "Quit - Cookies" is performed
* [https://github.com/mozilla-mobile/fenix/issues/22062 22062] - [Bug]: Download dialog does not decode multibyte file name
* [https://github.com/mozilla-mobile/fenix/issues/15069 15069] - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
* [https://github.com/mozilla-mobile/fenix/issues/17716 17716] - [Bug] can not donwload images from Pixiv anymore
* [https://github.com/mozilla-mobile/fenix/issues/20848 20848] - Downloaded items can be deleted individually in multiselect mode
* [https://github.com/mozilla-mobile/fenix/issues/11589 11589] - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
* [https://github.com/mozilla-mobile/fenix/issues/14939 14939] - [Bug]White "Run in private browsing" icon
* [https://github.com/mozilla-mobile/fenix/issues/12661 12661] - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
* [https://github.com/mozilla-mobile/fenix/issues/10057 10057] - [Bug] Weird graphic glitches when using Dark Reader extension
* [https://github.com/mozilla-mobile/fenix/issues/15627 15627] - [Bug] Tomato Clock "Stats" are opened in the background
* [https://github.com/mozilla-mobile/fenix/issues/12079 12079] - [Bug]Run in Private browsing toggle state lost after force closing Fenix
* [https://github.com/mozilla-mobile/fenix/issues/12897 12897] - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
* [https://github.com/mozilla-mobile/fenix/issues/9196 9196] - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
* [https://github.com/mozilla-mobile/fenix/issues/20810 20810] - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
* [https://github.com/mozilla-mobile/fenix/issues/5010 5010] - [Bug]Add undo option when deleting a bookmark from edit mode
* [https://github.com/mozilla-mobile/fenix/issues/21483 21483] - [Bug]: When dark theme is enabled the icons for bookmarks folders are not visible
* [https://github.com/mozilla-mobile/fenix/issues/5298 5298] - [Bug] The same page appears in the History section multiple times
* [https://github.com/mozilla-mobile/fenix/issues/16114 16114] - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/7866 7866] - [Bug] Custom search engines do not provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/7491 7491] - [Bug] adding startpage.com as a search engine does not show startpage favicon
* [https://github.com/mozilla-mobile/fenix/issues/17431 17431] - [Bug] Some strings provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/20280 20280] - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode
* [https://github.com/mozilla-mobile/fenix/issues/13123 13123] - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color
* [https://github.com/mozilla-mobile/fenix/issues/8761 8761] - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/8456 8456] - [Bug] distorted audio while playing video at higher speed
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - Bug] Phone goes to sleep while audio is playing
* [https://github.com/mozilla-mobile/android-components/issues/9748 9748] - Streaming downloadable media does not have media notification
* [https://github.com/mozilla-mobile/fenix/issues/7907 7907] - ETP doesn't work on a quick first load on first run
* [https://github.com/mozilla-mobile/fenix/issues/17523 17523] - [Bug] The Recently closed tabs counter is not updated before opening the list
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
* [https://github.com/mozilla-mobile/fenix/issues/16685 16685] - Bug]Tab selection checkmark disappears after background/resume
* [https://github.com/mozilla-mobile/fenix/issues/16152 16152] - [Grid View] Tab titles should have dark background for dark theme
* [https://github.com/mozilla-mobile/fenix/issues/22186 22186] - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/7723 7723] - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
* [https://github.com/mozilla-mobile/fenix/issues/21187 21187] - [Bug]: After "Remove account" the application returns to homescreen instead of Turn on Sync view
* [https://github.com/mozilla-mobile/fenix/issues/22158 22158] - [Bug]: History/Home Search Group tabs created from Google are duplicated

Latest revision as of 14:01, 8 November 2021

Fenix 94.1.1 RC | Fenix 95.0.0 Beta 1 | Fenix 95.0.0 Beta 2

Firefox 95.0.0 Beta 1 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Lorand Janos ARM Samsung Galaxy A8 (Android 9) November 3rd, 2021 Pass
Bodea Andrei ARM Google Pixel 4 XL (Android 11) November 3rd, 2021 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) November 3rd, 2021 Pass
Sorina Florean ARM Huawei Media Pad M2 (Android 5.1.1) November 3rd, 2021 Pass
Lorand Janos ARM Samsung Galaxy Tab S3 (Android 9) November 3rd, 2021 Pass


Full Functional and UI Tests

Tablets

Phones

Telemetry

Bug verification

All November 3rd, 2021 In progress


  • 22138 - [Telemetry] Add telemetry for Install Source - ✅ Verified as fixed
  • 22226 - Crash when opening opening a history group - ✅ Verified as fixed
  • 22172 - MR2 telemetry: Recent searches (prev. recently visited) - ✅ Verified as fixed
  • 22103 - MR2 telemetry: Recent bookmarks - ✅ Verified as fixed
  • 22175 - MR2 telemetry: delete group from Recent Searches - ✅ Verified as fixed

Update Android Components version to 95.0.20211011143313.

Issues

New issues

Major:

Other:

  • 22315 - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
  • 22314 - [Bug]: Tapping a search group item should switch to the previously opened website
  • 22313 - [Bug]: Incorect link saved for the original search results
  • 22308 - [Bug]: Improperly displayed tabs tray more options menu after rotation
  • 22309 - [Bug]: Collapsing/expanding inactive tabs list doesn't work after switching the orientation of the device
  • 22312 - [Bug]: Unable to dismiss the context menu when long tapping on the tabs counter on Android 5.1.1
  • 22310 - [Bug]:Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected

Known issues

Major:

  • 22129 - [Bug]: Refined search in result page may be added to wrong search group

Other:

  • 18694 - [Bug] The dot from the scale overlaps the percentage number
  • 21414 - [Bug]: Add logins dialog: save button is enabled when password field is blank
  • 21404 - [Bug]: Add logins duplicate login not checked on hostname edit
  • 21403 - [Bug]: Add logins dupe username error flashes then disappears
  • 21402 - [Bug]: Add logins empty username inconsistency
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 12854 - [Bug] Blocking tracking content only in private tabs shows ETP off on normal tabs
  • 1554226 - Add new Safe Browsing categories.
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 8927 - [Bug] Logging out from Twitter is not working as the user remains logged in
  • 11467 - [Bug] User not visible logged out if "Quit - Cookies" is performed
  • 22062 - [Bug]: Download dialog does not decode multibyte file name
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 17716 - [Bug] can not donwload images from Pixiv anymore
  • 20848 - Downloaded items can be deleted individually in multiselect mode
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 14939 - [Bug]White "Run in private browsing" icon
  • 12661 - [Feature request] Add-ons sub-menu overlay should not disappear after rotation
  • 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
  • 15627 - [Bug] Tomato Clock "Stats" are opened in the background
  • 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
  • 12897 - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
  • 9196 - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
  • 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
  • 5010 - [Bug]Add undo option when deleting a bookmark from edit mode
  • 21483 - [Bug]: When dark theme is enabled the icons for bookmarks folders are not visible
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 16114 - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
  • 13833 - [Bug] The opened tabs / bookmarks suggestions are displayed at the bottom of the search screen
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
  • 17431 - [Bug] Some strings provide search suggestions
  • 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
  • 9910 - Display video in full-screen when returning from PiP mode
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
  • 8761 - [Bug] Open in Fenix from a PWA custom tab, replaces the PWA with Fenix
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 8456 - [Bug] distorted audio while playing video at higher speed
  • 5133 - Bug] Phone goes to sleep while audio is playing
  • 9748 - Streaming downloadable media does not have media notification
  • 7907 - ETP doesn't work on a quick first load on first run
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 20811 - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
  • 20812 - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync
  • 16685 - Bug]Tab selection checkmark disappears after background/resume
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 22186 - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection
  • 4178 - Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 21187 - [Bug]: After "Remove account" the application returns to homescreen instead of Turn on Sync view
  • 22158 - [Bug]: History/Home Search Group tabs created from Google are duplicated