QA/Fenix/100.0.0/beta.1: Difference between revisions
< QA
Jump to navigation
Jump to search
No edit summary |
|||
| (14 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
<small>[[QA/Fenix/99. | <small>[[QA/Fenix/99.2.0/RC| Fenix 99.2.0 RC]] | [[QA/Fenix/100.0.0/beta.1| Fenix 100.0.0 Beta 1]] | [[QA/Fenix/100.0.0/beta.3| Fenix 100.0.0 Beta 3]]</small> | ||
= Firefox 100.0.0 Beta 1 Test Plan = | = Firefox 100.0.0 Beta 1/ Beta 2 Test Plan = | ||
* Release date: April | * Release date: April 6th, 2022 | ||
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team] | * QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:sflorean@mozilla.com Sorina Florean]; [mailto:mozilla-mobile-qa@softvision.com SV QA team] | ||
* Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team] | * Slack: [https://mozilla.slack.com/archives/C5VPJJL9F SV Mobile QA Team] | ||
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v100.0.0-beta. | * Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v100.0.0-beta.2 Firefox 100.0.0 Beta 1/ Beta 2] | ||
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/55679 Test Plan] | * TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/55679 Test Plan] | ||
| Line 32: | Line 32: | ||
| Google Pixel 6 (Android 12) | | Google Pixel 6 (Android 12) | ||
| April 5th, 2022 | | April 5th, 2022 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
| Lorand Janos | | Lorand Janos | ||
| Line 38: | Line 38: | ||
| Xiaomi Mi11 Lite (Android 11) | | Xiaomi Mi11 Lite (Android 11) | ||
| April 5th, 2022 | | April 5th, 2022 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
| Laurentiu Apahidean | | Laurentiu Apahidean | ||
| Line 44: | Line 44: | ||
| Huawei Media Pad M3 (Android 7) | | Huawei Media Pad M3 (Android 7) | ||
| April 5th, 2022 | | April 5th, 2022 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
| Sorina Florean | | Sorina Florean | ||
| Line 50: | Line 50: | ||
| Sony Xperia (Android 6.0.1) | | Sony Xperia (Android 6.0.1) | ||
| April 5th, 2022 | | April 5th, 2022 | ||
|''' | |'''Pass''' | ||
|- | |- | ||
|} | |} | ||
| Line 70: | Line 70: | ||
{| class="wikitable" width=100% | {| class="wikitable" width=100% | ||
|- | |- | ||
| ''' | | '''Andrei Jolțan''' | ||
| April 5th, 2022 | | April 5th, 2022 | ||
| ''' | | '''Done''' | ||
|} | |} | ||
</onlyinclude> | </onlyinclude> | ||
* Update Android Components version to 100.0.0. | * Update Android Components version to 100.0.0. | ||
* [https://github.com/mozilla-mobile/fenix/issues/24593 24593] - [Bug]: Glean is not initialized. It may be disabled by the application. on Firefox 100.0.0-beta.1 - '''✅Verified as fixed on Firefox Beta 100.0.0-beta.2''' | |||
== Issues == | == Issues == | ||
| Line 81: | Line 82: | ||
Major: | Major: | ||
* [https://github.com/mozilla-mobile/fenix/issues/24606 24606] - [Bug]: "Clear cookies and site data" not working when a permission/ site is added to the exception list | * [https://github.com/mozilla-mobile/fenix/issues/24606 24606] - [Bug]: "Clear cookies and site data" not working when a permission/ site is added to the exception list | ||
* [https://github.com/mozilla-mobile/fenix/issues/24593 24593] - [Bug]: Glean is not initialized. It may be disabled by the application. on Firefox 100.0.0-beta.1 | * [https://github.com/mozilla-mobile/fenix/issues/24593 24593] - [Bug]: Glean is not initialized. It may be disabled by the application. on Firefox 100.0.0-beta.1 '''- Verified as fixed on Beta 2''' | ||
Other: | Other: | ||
| Line 87: | Line 88: | ||
* [https://github.com/mozilla-mobile/fenix/issues/24598 24598] - [Bug]: Pwa toolbar is displayed when swiping down a page | * [https://github.com/mozilla-mobile/fenix/issues/24598 24598] - [Bug]: Pwa toolbar is displayed when swiping down a page | ||
* [https://github.com/mozilla-mobile/fenix/issues/24610 24610] - [Bug]: The last private will disappear when resuming a download | * [https://github.com/mozilla-mobile/fenix/issues/24610 24610] - [Bug]: The last private will disappear when resuming a download | ||
* [https://github.com/mozilla-mobile/fenix/issues/24634 24634] -[Bug]: Deleted tabs from a collection are still displayed when share dialog is open | |||
* [https://github.com/mozilla-mobile/fenix/issues/24633 24633] -[Bug]: Sending multiple tabs on Desktop isn't reflected in the notification received | |||
* [https://github.com/mozilla-mobile/focus-android/issues/6838 6838] - Autofill prompt is not displayed under the credentials fields | |||
=== Known issues === | === Known issues === | ||
Major: | Major: | ||
* | * [https://github.com/mozilla-mobile/fenix/issues/22486 22486] - History UI deletion of items is very buggy | ||
Other: | Other: | ||
* [https://github.com/mozilla-mobile/fenix/issues/24163 24163] - [Bug]: Improper transition for "Through provoking stories" when changing the orientation | * [https://github.com/mozilla-mobile/fenix/issues/24163 24163] - [Bug]: Improper transition for "Through provoking stories" when changing the orientation | ||
| Line 119: | Line 123: | ||
* [https://github.com/mozilla-mobile/fenix/issues/23214 23214] - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login | * [https://github.com/mozilla-mobile/fenix/issues/23214 23214] - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login | ||
* [https://github.com/mozilla-mobile/fenix/issues/24106 24106] - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs | * [https://github.com/mozilla-mobile/fenix/issues/24106 24106] - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs | ||
* [https://github.com/mozilla-mobile/fenix/issues/7230 7230] - [Bug] Option to open external links with private Firefox missing in the new version | |||
* [https://github.com/mozilla-mobile/fenix/issues/7996 7996] - [Bug] Private mode doesn't play nicely with sites added to home screen | |||
* [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar | * [https://github.com/mozilla-mobile/fenix/issues/7953 7953] - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar | ||
* [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query | * [https://github.com/mozilla-mobile/fenix/issues/9713 9713] - [Bug] Find in page finds something even after erasing query | ||
| Line 130: | Line 137: | ||
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1554226 1554226]- Add new Safe Browsing categories | * [https://bugzilla.mozilla.org/show_bug.cgi?id=1554226 1554226]- Add new Safe Browsing categories | ||
* [https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN | * [https://github.com/mozilla-mobile/fenix/issues/8480 8480] - [Bug] Pocket Top Articles top site is present for locales different than EN | ||
* [https://github.com/mozilla-mobile/fenix/issues/8966 8966] - [Bug] Share icon in custom PWA toolbar has wrong color | |||
* [https://github.com/mozilla-mobile/fenix/issues/10560 10560] - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices | |||
* [https://github.com/mozilla-mobile/fenix/issues/21356 21356] - [Bug]: No crash report notification is triggered after app crash on Xiaomi device | |||
* [https://github.com/mozilla-mobile/fenix/issues/20280 20280] - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/15069 15069] - [Bug][downloads] "Try again" doesn't work after the connection is reestablished | |||
* [https://github.com/mozilla-mobile/fenix/issues/9910 9910] - Display video in full-screen when returning from PiP mode | |||
* [https://github.com/mozilla-mobile/fenix/issues/10319 10319] - [Bug] Tapping a media notification from a PWA should open the PWA | |||
* [https://github.com/mozilla-mobile/fenix/issues/13833 13833] - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen | |||
* [https://github.com/mozilla-mobile/fenix/issues/16128 16128] - [Bug] "Font size" option is aligned to the left on tablets | |||
* [https://github.com/mozilla-mobile/fenix/issues/22186 22186] - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection | |||
* [https://github.com/mozilla-mobile/fenix/issues/24165 24165] - [Bug]: Search groups not displayed under Jump Back in section on Sony Xperia | |||
* [https://github.com/mozilla-mobile/fenix/issues/24165 24165] - [Bug] The Recently closed tabs counter is not updated before opening the list | |||
* [https://github.com/mozilla-mobile/fenix/issues/23671 23671] - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark) | |||
* [https://github.com/mozilla-mobile/fenix/issues/20810 20810] - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available | |||
* [https://github.com/mozilla-mobile/fenix/issues/22765 22765] - [Bug]: Search term groupings don't disappear after 14 days | |||
* [https://github.com/mozilla-mobile/fenix/issues/23670 23670] - [Bug]: The previously deleted tabs are restored when the collection is restored | |||
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection | |||
* [https://github.com/mozilla-mobile/fenix/issues/13177 13177] - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs | |||
* [https://github.com/mozilla-mobile/fenix/issues/11376 11376] - Reverse the direction that Fenix adds new tabs from | |||
* [https://github.com/mozilla-mobile/fenix/issues/23671 23761] - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark) | |||
* [https://github.com/mozilla-mobile/fenix/issues/22315 22315] - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks | |||
* [https://github.com/mozilla-mobile/fenix/issues/15996 15996] - [Bug] Search widget is light with dark theme | |||
* [https://github.com/mozilla-mobile/fenix/issues/23532 23532] - [Bug]: Add search engine - Clear icon is not displayed when the user starts typing in fields | |||
* [https://github.com/mozilla-mobile/fenix/issues/17431 17431] - [Bug] Some strings provide search suggestions | |||
* [https://github.com/mozilla-mobile/fenix/issues/19189 19189] - [Bug] History not shared between TWA and the browser | |||
* [https://github.com/mozilla-mobile/fenix/issues/16820 16820] - [Bug] Unable to play certain videos on the page due to unsupported video format | |||
* [https://github.com/mozilla-mobile/fenix/issues/20391 20391] - [Bug]: Empty collection can be created | |||
* [https://github.com/mozilla-mobile/fenix/issues/22310 22310] - [Bug]:Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected | |||
* [https://github.com/mozilla-mobile/fenix/issues/18702 18702] - [Bug] No snackbar is displayed when adding new tab to a collection | |||
Latest revision as of 05:24, 12 April 2022
Fenix 99.2.0 RC | Fenix 100.0.0 Beta 1 | Fenix 100.0.0 Beta 3
Firefox 100.0.0 Beta 1/ Beta 2 Test Plan
- Release date: April 6th, 2022
- QA Contact: Oana Horvath; Sorina Florean; SV QA team
- Slack: SV Mobile QA Team
- Build: Firefox 100.0.0 Beta 1/ Beta 2
- TestRail test plan: Test Plan
Full Functional & UI tests
| QA Task | Person/Group |
| Softvision | Alternating |
QA Assignment
| Assigned | Build type | Device | Completed | Results |
|---|---|---|---|---|
| Delia Pop | ARM | Google Pixel 6 (Android 12) | April 5th, 2022 | Pass |
| Lorand Janos | ARM | Xiaomi Mi11 Lite (Android 11) | April 5th, 2022 | Pass |
| Laurentiu Apahidean | ARM | Huawei Media Pad M3 (Android 7) | April 5th, 2022 | Pass |
| Sorina Florean | ARM | Sony Xperia (Android 6.0.1) | April 5th, 2022 | Pass |
Full Functional and UI Tests
https://testrail.stage.mozaws.net/index.php?/plans/view/55679
Tablets
Phones
Telemetry
Bug verification
| Andrei Jolțan | April 5th, 2022 | Done |
- Update Android Components version to 100.0.0.
- 24593 - [Bug]: Glean is not initialized. It may be disabled by the application. on Firefox 100.0.0-beta.1 - ✅Verified as fixed on Firefox Beta 100.0.0-beta.2
Issues
New issues
Major:
- 24606 - [Bug]: "Clear cookies and site data" not working when a permission/ site is added to the exception list
- 24593 - [Bug]: Glean is not initialized. It may be disabled by the application. on Firefox 100.0.0-beta.1 - Verified as fixed on Beta 2
Other:
- 24596 - [Bug]: Pocket stories disappear unexpectedly when tapping on story topics
- 24598 - [Bug]: Pwa toolbar is displayed when swiping down a page
- 24610 - [Bug]: The last private will disappear when resuming a download
- 24634 -[Bug]: Deleted tabs from a collection are still displayed when share dialog is open
- 24633 -[Bug]: Sending multiple tabs on Desktop isn't reflected in the notification received
- 6838 - Autofill prompt is not displayed under the credentials fields
Known issues
Major:
- 22486 - History UI deletion of items is very buggy
Other:
- 24163 - [Bug]: Improper transition for "Through provoking stories" when changing the orientation
- 24134 - [Bug]: Improper flicker displayed on engine pictogram and cursor when tapping the URL bar
- 23174 - [Bug]: Estimated reading time and photo are missing from some stories when "quick-reads" topic is selected
- 24362 - Pocket stories show empty images
- 23064 - [Bug]: "Jump back in" tabs are not visible on homescreen
- 24262 - [Bug]: Amazon/eBay Sponsored tiles are still available after the default search engine is set as Amazon/eBay
- 23860 - [Bug]: Incorrect tab number appears for a moment on swipe
- 24132 - [Bug]: Jump back in thumbnail image is not displayed sometimes
- 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
- 22317 - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
- 9323 - [Bug]The microphone icon for widget is not displayed on 2x1 size
- 14939 - [Bug]White "Run in private browsing" icon
- 12661 - Add-ons sub-menu overlay should not disappear after rotation
- 15627 - Tomato Clock "Stats" are opened in the background
- 12079 - [Bug]Run in Private browsing toggle state lost after force closing Fenix
- 9196 - [Bug]Add-ons uninstall confirmation snackbar covers the nav bar
- 8729 - [Bug] Add-ons - Both main and detailed descriptions don't follow the selected language
- 22062 - [Bug]: Download dialog does not decode multibyte file name
- 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
- 20848 - Downloaded items can be deleted individually in multiselect mode
- 21960 - [Bug]: Disabling "Zoom on all websites" will not reset zoom level on certain webpages until refreshing
- 21498 - [Bug]: Zooming & scrolling some pages, displays the pages' toolbar dynamic
- 18694 - [Bug] The dot from the scale overlaps the percentage number
- 22022 - [Bug]: Inactive tabs section turns "incognito" dark after returning from private tab
- 23212 - [Bug]: Deleting a saved login, the account is still displayed on the list
- 23214 - [Bug]: No success pop-up/ snackbar is displayed after adding manually a login
- 24106 - [Bug]: A white/grey flicker is displayed for a split second while the website loads or when switching tabs
- 7230 - [Bug] Option to open external links with private Firefox missing in the new version
- 7996 - [Bug] Private mode doesn't play nicely with sites added to home screen
- 7953 - [Bug] Error 0/0 displayed when double tapping on Find in page toolbar
- 9713 - [Bug] Find in page finds something even after erasing query
- FNXV2-19463 - Tapping on "View" from Private browsing displays private home screen instead of the wallpaper - home screen
- FNXV2-19726 - No Deeplinks towards Firefox Wallpapers menu are available on the Turning Red Mobile Landing Page on Firefox RC v98, Beta v98 and Nightly v99
- 21065 - [Bug] Permissions in private tabs are not persitent accross the same session
- 23535 - [Bug]: Reader view icon flickers on scroll
- 16602 - [Bug] Fenix thinks that its reader mode is insecure
- 1640893 - Colors and fonts aren't kept when selection was made in browser and pasted in Google Sheets app
- 1646515 - Copying a styled `` to the clipboard drops style
- 1554226- Add new Safe Browsing categories
- 8480 - [Bug] Pocket Top Articles top site is present for locales different than EN
- 8966 - [Bug] Share icon in custom PWA toolbar has wrong color
- 10560 - [Bug] [PWA] "Add to Home screen" confirmation dialog isn't displayed on certain devices
- 21356 - [Bug]: No crash report notification is triggered after app crash on Xiaomi device
- 20280 - [Bug] Youtube autoplay leads to non-fullscreen picture in picture (PiP) mode
- 15069 - [Bug][downloads] "Try again" doesn't work after the connection is reestablished
- 9910 - Display video in full-screen when returning from PiP mode
- 10319 - [Bug] Tapping a media notification from a PWA should open the PWA
- 13833 - [Bug] The opened tabs / bookmarks are displayed in the search screen at the bottom of the search screen
- 16128 - [Bug] "Font size" option is aligned to the left on tablets
- 22186 - [Bug]: "Jump back in" and "Recent bookmarks" options are focused when tapping on "View" after creating a collection
- 24165 - [Bug]: Search groups not displayed under Jump Back in section on Sony Xperia
- 24165 - [Bug] The Recently closed tabs counter is not updated before opening the list
- 23671 - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark)
- 20810 - [Bug]: If no tab is selected the "Bookmark" and "Close" options from the ⋮ "more options" menu shouldn't be available
- 22765 - [Bug]: Search term groupings don't disappear after 14 days
- 23670 - [Bug]: The previously deleted tabs are restored when the collection is restored
- 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
- 13177 - [Bug] Strange Tab in Collections Items Behavior When Deleting Multiple Tabs
- 11376 - Reverse the direction that Fenix adds new tabs from
- 23761 - [Bug]: the same page can be added to bookmarks from tabs tray multiple time (no snackbar/ message is displayed informing that the page is already a bookmark)
- 22315 - [Bug]: Inconsistent behaviour when opening multiple items in a new tab from history compared to bookmarks
- 15996 - [Bug] Search widget is light with dark theme
- 23532 - [Bug]: Add search engine - Clear icon is not displayed when the user starts typing in fields
- 17431 - [Bug] Some strings provide search suggestions
- 19189 - [Bug] History not shared between TWA and the browser
- 16820 - [Bug] Unable to play certain videos on the page due to unsupported video format
- 20391 - [Bug]: Empty collection can be created
- 22310 - [Bug]:Collections - Tapping on "Deselect all" doesn't change the state for tabs previously selected
- 18702 - [Bug] No snackbar is displayed when adding new tab to a collection