Fennec/Features/TabletUI/TestPlan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 143: Line 143:


=== Functional  ===
=== Functional  ===
#UI Based Functionality
{{hidden_r
|Keyboard Functionality
|
*verify that the keys function accordingly
*special keys :
**White Space
***Space, Enter, Tab Return
**Modifier Keys
***Shift, Caps, Option, Command, Control
**Positional Keys :
***Arrows, Home, End, PageUp/Down
**Symbols:
***Astricks () {} [] & ^ % $ # @ ! ~ etc.
**Other:
***Esc, Delete, Clear
***[https://wiki.mozilla.org/Mobile/Fennec/Cheat_Codes key combos]
***[http://support.mozilla.com/en-US/kb/mobile-keyboard-shortcuts shortcuts]
*Screen size (making sure that things fit)
<small>Note: Generally Menu+VKB typically does not do anything.  There are oddities to watch for such as hitting shift, letting go and then typing multiple characters should only capitalize one character.  Special characters may end up doing something different due to encoding, using web symbols and copy paste, etc.  White spacings may disappear due to copy/paste etc.  It's more or less doing the same testing as the above but looking at the functionality of the keys versus the functionality of the actions.  You can run both tests at the same time provided you observe for these functionalities and the above.</small>
|headerstyle=background:#dddddd
}}


*UI Based Functionality  
#Conditional Functionality
**verify that the keys function accordingly
{{hidden_r
**special keys&nbsp;:
|Keyboard Functionality
***White Space
|
****Space, Enter, Tab Return
*dismiss keyboard  
***Modifier Keys
**click on space above keyboard  
****Shift, Caps, Option, Command, Control
**hit return?  
***Positional Keys&nbsp;:
*start virtual keyboard  
****Arrows, Home, End, PageUp/Down
**click in a text field selection  
***Symbols:
**click in a search field  
****Astricks () {} [] &amp; ^&nbsp;% $ # @&nbsp;! ~ etc.
**click in awesome bar  
***Other:
*selection  
****Esc, Delete, Clear
**drag/drop  
****[https://wiki.mozilla.org/Mobile/Fennec/Cheat_Codes key combos]
**character selection  
****[http://support.mozilla.com/en-US/kb/mobile-keyboard-shortcuts shortcuts]
**multicharacter selection  
**Screen size (making sure that things fit)
**Word selection  
*Conditional Functionality
**multiword selection  
**dismiss keyboard  
**split word selection  
***click on space above keyboard  
***hyphenated  
***hit return?  
***carriage return  
**start virtual keyboard  
***partial character in words
***click in a text field selection  
<small>Note: One path of closing/opening the VKB may not necessarily lead to the same state as another.  Timing can change things, be careful to check for various actions that could cause issues with graphic defects.  Esp with the system back button</small>
***click in a search field  
|headerstyle=background:#dddddd
***click in awesome bar  
}}
**selection  
***drag/drop  
***character selection  
***multicharacter selection  
***Word selection  
***multiword selection  
***split word selection  
****hyphenated  
****carriage return  
****partial character in words


== Beta Conditional  ==
== Beta Conditional  ==

Revision as of 21:10, 21 June 2011

Test Plan

Introduction

Design Documentation/Background Research

The purpose of the virtual keyboard is to provide an interface to fennec for people to type in various languages when a hardware keyboard is closed or not available to the device.

Description of this Document

This document will cover the testing approach for virtual keyboards on the Tablets

Related Documents

See Virtual Keyboard for Android Test Plan

Schedule and Milestones

Resource Requirements

Hardware

Test devices: Handhelds for comparison:

  • Motorola Droid 2
  • HTC Thunderbolt

Tablets:

  • HTC Flyer
  • Samsung

System Testing

Android OS 2.2 (Phone) Android OS 2.3 (Gingerbread) Android OS 2.4 (Honeycomb)

Software

Variety of VKB/IMEs  : see...

Staffing

Feature Lead

Responsibilities

  • Testing Device
  • Training other people in VKBs when asked

Training

  • none necessary

Note:

  1. need to know how to install VKBs
  2. need to know how the VKB works

Features To Be Tested / Test Approach

New Features Testing

Regression Testing

Features Not To Be Tested

Test Deliverables

Dependencies/Risks

Entrance/Exit Criteria

Test Outline

Note :

  1. This test out line is a brain storm of all possible conditions to consider for testing. The scope of the testing will be narrowed from this list based on design information, risks of breakage, etc.
  2. When testing, each item has to be checked, for performance, visual impact (ie graphic defects), race conditions, locking, etc. Some things will be called out to have specific instructions to check for, however the testing should not be limited to only the called out item.

Positive Smoke/Alpha Tests

UI

  1. General

Functional

  1. UI Based Functionality
  1. Conditional Functionality

Beta Conditional

  • Virtual Conditions
    • click in text box
    • double click in text box
    • click outside of Virtual Keyboard : dismissing keyboard
    • scrolling above the on-screen keyboard
    • Change Cursor Focus
      • change focus after composition
    • slide right, slide left [ Panels ]
    • AwesomePage
    • Preferences/Feedback/Plugins/etc Panels
    • Context Menus
    • Site Menu
    • Favorites Panel
    • Position/Graphical issues
      • collapsing before bringing up keyboard/dismissing keyboard
      • scrolling before bringing up keyboard/dismissing keyboard
      • tapping after dismissing the keyboard should bring the keyboard up
  • Content Conditions
    • html4
    • html5
    • asp
  • HW keys
    • Back button
    • menu button
  • Physical Conditions
    • While Charged
    • While not Charged
    • Power Consumption
    • Performance
      • Speed of functions
      • Processor utilization
      • Memory utilization
        • Memory leaks?
        • Memory efficiency
    • Storage
      • Disk
      • Sim
  • Negative (Tests to Break) Tests
    • Security
      • Buffer Overflow (max characters)
    • removal of characters
  • Race Conditions
    • Lock conditions?
    • tooltips or other dialogs?
    • Network Conditions (Should have no impact)
      • WiFi
      • 3G
      • Bluetooth (Devices)
      • 4G?
      • SMS
    • Signal Conflict
      • Browser notifications
        • clicking in search field (form assistant + virtual keyboard)
        • Restart notification (ie. change in certain preferences in preferences panel )
        • Password notification
        • form manager notification
        • password manager
        • popup blocker
        • offline storage
        • geolocation manager respective to content window
      • Battery
        • Battery Low
        • No Battery
      • Calls
        • Incoming Phone Call
      • Other Apps
        • Calendar notification
        • Alarm Clock notification
        • Sleep notification
        • Screensaver / Lock (system)
        • EnergySaver (Fade) (system)
        • Other?
        • Music playing (should not affect)
        • plugins (youtube and other websites with different media types)
        • Extensions ( addons to fennec)
    • Buttons
      • Hard reset
      • Soft reset
      • Turn off phone
      • force quit
      • Other buttons being pressed on the phone (zoom, picture, power )
    • UI State Change
      • Zoom
        • while bringing up Keyboard
        • while dismissing the keyboard
      • Change Orientation
        • while bringing up keyboard
        • while dismissing the keyboard
  • Device/Platform Specific Issues
    • Portrait/Landscape Orientation
    • Camera (should not conflict?)
    • Microphone (Voice commands? Voice Recognition?)
    • Speaker (should not conflict)
    • headset (should not conflict)
    • Vibrate mode (should not conflict)
    • Volume (display conflict? need to test)
    • GPS
    • Print support?
    • Sync
    • Multiapp?
    • physical keyboard
      • visible
      • hidden
  • Localization
    • Double Byte Characters (Japanese, Chinese, Korean)
    • RTL Languages (Arabic/Hebrew)
    • High ASCII characters (Euro)
    • Date Input/Format (Euro/Japanese/Chinese)
    • Time Format (Chinese/Japanese)
    • Dialog check
    • Change of IME on Mobile OS
  • Help?
    • context sensitive help?

Usability

  • Usability
    • Keyboard Real Estate
    • scrolling away?
    • jumping to another field?
    • Encryption
  • Accessibility (508 compliance)
    • Voice Commands?