|
|
| Line 240: |
Line 240: |
|
| |
|
| == Test Areas == | | == Test Areas == |
| {| class="wikitable" style="width:80%"
| | Various areas of the user interface |
| |-
| |
| ! Test Areas !! Covered !! Details
| |
| |-
| |
| | Private Window
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Multi-Process Enabled
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Multi-process Disabled
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Theme (high contrast)
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | '''UI'''
| |
| || ||
| |
| |-
| |
| | Mouse-only operation
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Keyboard-only operation
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Display (HiDPI)
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Interraction (scroll, zoom)
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Usable with a screen reader
| |
| |style="text-align:center;" | Yes || e.g. with NVDA
| |
| |-
| |
| | Usability and/or discoverability testing
| |
| |style="text-align:center;" | Yes || Is this feature user friendly
| |
| | |
| |-
| |
| | '''Help/Support'''
| |
| || ||
| |
| |-
| |
| | Help/support interface required
| |
| |style="text-align:center;" | No || Make sure link to support/help page exist and is easy reachable.
| |
| |-
| |
| | Support documents planned(written)
| |
| |style="text-align:center;" | Yes || Make sure support documents are written and are correct.
| |
| | |
| |-
| |
| | '''Install/Upgrade'''
| |
| || ||
| |
| |-
| |
| | Feature upgrades/downgrades data as expected
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Does sync work across upgrades
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Requires install testing
| |
| |style="text-align:center;" | Yes || Requires NVDA Installation
| |
| |-
| |
| | Affects first-run or onboarding
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Does this affect partner builds? Partner build testing
| |
| |style="text-align:center;" | No ||
| |
| | |
| |-
| |
| | ''' Enterprise '''
| |
| || || Raise up the topic to developers to see if they are expecting to work different on ESR builds
| |
| |-
| |
| | Enterprise administration
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Network proxies/autoconfig
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | ESR behavior changes
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Locked preferences
| |
| |style="text-align:center;" | No ||
| |
| | |
| |-
| |
| | ''' Data Monitoring '''
| |
| || ||
| |
| |-
| |
| | Temporary or permanent telemetry monitoring
| |
| |style="text-align:center;" | No || Testing was not conducted by SV QA Eng team.
| |
| |-
| |
| | Telemetry correctness testing
| |
| |style="text-align:center;" | No || Testing was not conducted by SV QA Eng team.
| |
| |-
| |
| | Server integration testing
| |
| |style="text-align:center;" | No || Testing was not conducted by SV QA Eng team.
| |
| |-
| |
| | Offline and server failure testing
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Load testing
| |
| |style="text-align:center;" | No || Testing was not conducted by SV QA Eng team.
| |
| | |
| |-
| |
| | ''' Add-ons '''
| |
| || || If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
| |
| |-
| |
| | Addon API required?
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Comprehensive API testing
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Permissions
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Testing with existing/popular addons
| |
| |style="text-align:center;" | Yes || Ensure no performance/stability regressions
| |
| | |
| |-
| |
| | ''' Security '''
| |
| || ||
| |
| |-
| |
| | 3rd-party security review
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Privilege escalation testing
| |
| |style="text-align:center;" | No ||
| |
| |-
| |
| | Fuzzing
| |
| |style="text-align:center;" | No ||
| |
| | |
| |-
| |
| | ''' Web Compatibility '''
| |
| || || depends on the feature
| |
| |-
| |
| | Testing against target sites
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Survey of many sites for compatibility
| |
| |style="text-align:center;" | Yes ||
| |
| | |
| |-
| |
| | ''' Interoperability '''
| |
| || || depends on the feature
| |
| |-
| |
| | Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.
| |
| |style="text-align:center;" | Yes ||
| |
| |-
| |
| | Coordinated testing/interop across the Firefox builds: Desktop, Android, iOS
| |
| |style="text-align:center;" | No || Desktop only
| |
| |-
| |
| | Interaction of this feature with other browser features
| |
| |style="text-align:center;" | Yes ||
| |
| |}
| |
|
| |
|
| == Test suite == | | == Test suite == |