QA/Fenix/92.0.0/beta.1: Difference between revisions

< QA
No edit summary
No edit summary
 
(15 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/91.1.0/RC1 | Fenix RC 91.1.0 ]] | [[QA/Fenix/92.0.0/beta.1 | Fenix 92.0.0 Beta 1]]</small>
<small>« [[QA/Fenix/91.4.0/RC1 | Fenix RC 91.4.0 RC ]] | [[QA/Fenix/92.0.0/beta.1 | Fenix 92.0.0 Beta 1]] | [[QA/Fenix/92.0.0/beta.4 | Fenix 92.0.0 Beta 4]]</small>


= Firefox 92.0.0 Beta 2 Test Plan =
= Firefox 92.0.0 Beta 2 Test Plan =
* Release date: August 11th, 2021
* Release date: August 12th, 2021
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team]
Line 30: Line 30:
  | ARM
  | ARM
  | Huawei MediaPad M3 (Android 7.0)
  | Huawei MediaPad M3 (Android 7.0)
  | August 11th, 2021
  | August 12th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Bodea Andrei
  | Bodea Andrei
  | ARM
  | ARM
  | OnePlus Nord (Android 10)
  | OnePlus Nord (Android 10)
  | August 11th, 2021
  | August 12th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Sorina Florean
  | Sorina Florean
  | ARM
  | ARM
  | Huawei MediaPad M2(Android 5.1.1)
  | Huawei MediaPad M2(Android 5.1.1)
  | August 11th, 2021
  | August 12th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Lorand Janos
  | Lorand Janos
  | ARM
  | ARM
  | Samsung Galaxy Tab 3 (Android 9)
  | Samsung Galaxy Tab 3 (Android 9)
  | August 11th, 2021
  | August 12th, 2021
  |'''In Progress'''
  |'''Pass'''
  |-
  |-
  | Andrei Jolțan
  | Andrei Jolțan
  | ARM
  | ARM
  | OnePlus A3 (Android 6.0.1)
  | OnePlus A3 (Android 6.0.1)
  | August 11th, 2021
  | August 12th, 2021
  | '''In Progress'''
  | '''Pass'''
  |-
  |-
  |}  
  |}  
Line 72: Line 72:
{| class="wikitable" width=100%
{| class="wikitable" width=100%
  |-  
  |-  
  | '''Andrei Jolțan'''
  | '''All'''
  | 11th of August, 2021
  | 12th of August, 2021
  | '''Done'''
  | '''Done'''
|}  
|}  
</onlyinclude>
</onlyinclude>
* [https://github.com/mozilla-mobile/fenix/issues/19956 19956] - [Telemetry] Tab view preference - '''✔️ Verified as fixed on both Nightly 92.0a1 8/11 and 92.0.0 Beta 1'''
* [https://github.com/mozilla-mobile/fenix/issues/19956 19956] - [Telemetry] Tab view preference - '''✔️ Verified as fixed on both Nightly 92.0a1 8/11 and 92.0.0 Beta 1'''
* [https://github.com/mozilla-mobile/fenix/issues/20672 20672] - [Fenix crashes when attempting to disconnect from Mozilla account - '''✔️ Verified as fixed on both Nightly 92.0a1 8/12 and 92.0.0 Beta 2'''
* [https://github.com/mozilla-mobile/fenix/issues/20672 20672] - Fenix crashes when attempting to disconnect from Mozilla account - '''✔️ Verified as fixed on both Nightly 92.0a1 8/12 and 92.0.0 Beta 2'''


== Issues ==
== Issues ==
Line 85: Line 85:


Other:
Other:
* [https://github.com/mozilla-mobile/fenix/issues/20810 20810] - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
* [https://github.com/mozilla-mobile/fenix/issues/20811 20811] - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
* [https://github.com/mozilla-mobile/fenix/issues/20812 20812] - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync


=== Known issues ===
=== Known issues ===
Line 127: Line 130:
* [https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
* [https://github.com/mozilla-mobile/fenix/issues/9916 9916] - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
* [https://github.com/mozilla-mobile/fenix/issues/8456 8456] - [Bug] distorted audio while playing video at higher speed
* [https://github.com/mozilla-mobile/fenix/issues/5133 5133] - [Bug] Phone goes to sleep while audio is playing
* [https://github.com/mozilla-mobile/android-components/issues/9748 9748] - Streaming downloadable media does not have media notification
* [https://github.com/mozilla-mobile/fenix/issues/7907 7907] - ETP doesn't work on a quick first load on first run
* [https://github.com/mozilla-mobile/fenix/issues/18445 18445] - [Bug] Clicking "use precise location" in google search results doesn't work
* [https://github.com/mozilla-mobile/fenix/issues/18455 18455] - [Bug] Permission dialog is shown over the tabs tray
* [https://github.com/mozilla-mobile/fenix/issues/16114 16114] - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
* [https://github.com/mozilla-mobile/fenix/issues/9323 9323] - [Bug]The microphone icon for widget is not displayed on 2x1 size
* [https://github.com/mozilla-mobile/fenix/issues/7866 7866] - [Bug] Custom search engines do not provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/7491 7491] - [Bug] adding startpage.com as a search engine does not show startpage favicon
* [https://github.com/mozilla-mobile/fenix/issues/17431 17431] - [Bug] Some strings provide search suggestions
* [https://github.com/mozilla-mobile/fenix/issues/16152 16152] - [Grid View] Tab titles should have dark background for dark theme
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA
* [https://github.com/mozilla-mobile/fenix/issues/14290 14290] - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
* [https://github.com/mozilla-mobile/fenix/issues/10777 10777] - [Bug]Saved logins view scrolling issue after sorting
* [https://github.com/mozilla-mobile/fenix/issues/10737 10737] - [Bug] Searching a language/saved password displays a misplaced "x"
* [https://github.com/mozilla-mobile/fenix/issues/16128 16128] - [Bug] "Font size" option is aligned to the left on tablets
* [https://github.com/mozilla-mobile/fenix/issues/20065 20065] - [Feature Request] Force Autofill Option
* [https://github.com/mozilla-mobile/fenix/issues/18983 18983] - [Bug] Unable to choose a different login after picking a wrong one
* [https://github.com/mozilla-mobile/fenix/issues/20366 20366] - [Bug]: ETP icon not displayed correctly when the toolbar is set to top on Tablets

Latest revision as of 08:01, 31 August 2021

«  Fenix RC 91.4.0 RC | Fenix 92.0.0 Beta 1 | Fenix 92.0.0 Beta 4

Firefox 92.0.0 Beta 2 Test Plan

Full Functional & UI tests

QA Task Person/Group
Softvision Alternating

QA Assignment

Assigned Build type Device Completed Results
Laurentiu Apahidean ARM Huawei MediaPad M3 (Android 7.0) August 12th, 2021 Pass
Bodea Andrei ARM OnePlus Nord (Android 10) August 12th, 2021 Pass
Sorina Florean ARM Huawei MediaPad M2(Android 5.1.1) August 12th, 2021 Pass
Lorand Janos ARM Samsung Galaxy Tab 3 (Android 9) August 12th, 2021 Pass
Andrei Jolțan ARM OnePlus A3 (Android 6.0.1) August 12th, 2021 Pass


Full Functional and UI Tests

Tablets

Phones

Telemetry

Bug verification

All 12th of August, 2021 Done
  • 19956 - [Telemetry] Tab view preference - ✔️ Verified as fixed on both Nightly 92.0a1 8/11 and 92.0.0 Beta 1
  • 20672 - Fenix crashes when attempting to disconnect from Mozilla account - ✔️ Verified as fixed on both Nightly 92.0a1 8/12 and 92.0.0 Beta 2

Issues

New issues

Major:

Other:

  • 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
  • 20811 - [Bug]: Tabs tray synced tabs "Sign in to sync" button size inconsistency
  • 20812 - [Bug]: Tabs tray "Sync" button shouldn't be displayed if the user isn't signed in to sync or needs to reconnect to sync

Known issues

Major:


Other:

  • 7723 - [Bug] The account sync doesn't start automatically when the app is brought to the foreground
  • 13123 - [Bug] Missing Fenix Notification for Myntra TWA in android taskbar
  • 8927 - [Bug] Logging out from Twitter is not working as the user remains logged in
  • 11467 - [Bug] User not visible logged out if "Quit - Cookies" is performed
  • 11589 - [Bug] Force closing Fenix after disabling an Add-on uninstalls it
  • 14939 - [Bug]White "Run in private browsing" icon
  • 12661 - [Bug]Add-ons sub-menu overlay disappears after rotation
  • 10057 - [Bug] Weird graphic glitches when using Dark Reader extension
  • 15627 - [Bug] Tomato Clock "Stats" are opened in the background
  • 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
  • 12897 - [Bug] YouTube High Definition add-on: Video can't be muted on some devices
  • 9196 - [Bug]uBlock install/uninstall confirmation snackbar covers the nav bar
  • 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
  • 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
  • 17716 - [Bug] can not donwload images from Pixiv anymore
  • 5298 - [Bug] The same page appears in the History section multiple times
  • 17523 - [Bug] The Recently closed tabs counter is not updated before opening the list
  • 13389 - [Bug] Private browsing homescreen displayed when tapping "View" after creating a collection from tabs
  • 2783 - Add snackbar to collection deletion
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
  • 16685- [Bug]Tab selection checkmark disappears after background/resume
  • 20391 - [Bug]: Empty collection can be created
  • 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
  • 7230 - [Bug] Option to open external links with private Firefox missing in the new version
  • 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
  • 8108 - [Bug] The same site can be added multiple times to home screen
  • 3108 - Add new safe browsing policies for Malware in iframe and Billing warning
  • 9026 - [Bug] Phishing & malware pages are not always blocked
  • 17856 - [Bug]Pages are zoomed after switching from landscape to portrait
  • 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
  • 9713 - [Bug] Find in page finds something even after erasing query
  • 16602 - [Bug] Fenix thinks that its reader mode is insecure
  • 9916 - [Bug] PWA - The pwa icon's are displayed as white on device homescreen
  • 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
  • 8456 - [Bug] distorted audio while playing video at higher speed
  • 5133 - [Bug] Phone goes to sleep while audio is playing
  • 9748 - Streaming downloadable media does not have media notification
  • 7907 - ETP doesn't work on a quick first load on first run
  • 18445 - [Bug] Clicking "use precise location" in google search results doesn't work
  • 18455 - [Bug] Permission dialog is shown over the tabs tray
  • 16114 - [Bug] The Firefox logo is covered when toolbar is set to the top and there is a link in clipboard
  • 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
  • 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
  • 7866 - [Bug] Custom search engines do not provide search suggestions
  • 7491 - [Bug] adding startpage.com as a search engine does not show startpage favicon
  • 17431 - [Bug] Some strings provide search suggestions
  • 16152 - [Grid View] Tab titles should have dark background for dark theme
  • 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
  • 14290 - [Bug] Decremented open tabs value after deleting a tab while using the switch gesture
  • 10777 - [Bug]Saved logins view scrolling issue after sorting
  • 10737 - [Bug] Searching a language/saved password displays a misplaced "x"
  • 16128 - [Bug] "Font size" option is aligned to the left on tablets
  • 20065 - [Feature Request] Force Autofill Option
  • 18983 - [Bug] Unable to choose a different login after picking a wrong one
  • 20366 - [Bug]: ETP icon not displayed correctly when the toolbar is set to top on Tablets