Fennec/Features/TabletUI/TestPlan: Difference between revisions
Jump to navigation
Jump to search
Line 55: | Line 55: | ||
== Entrance/Exit Criteria == | == Entrance/Exit Criteria == | ||
= Test Outline = | = Test Outline = | ||
Note : | |||
#This test out line is a brain storm of all possible conditions to consider for testing. The scope of the testing will be narrowed from this list based on design information, risks of breakage, etc. | |||
#When testing, each item has to be checked, for performance, visual impact (ie graphic defects), race conditions, locking, etc. Some things will be called out to have specific instructions to check for, however the testing should not be limited to only the called out item. | |||
=== Functional === | == Positive Smoke/Alpha Tests == | ||
* UI Based Functionality | |||
** verify that the keys function accordingly | === UI === | ||
** special keys : | |||
*** White Space | *General | ||
****Space, Enter, Tab Return | **Keyboard Menu | ||
*** Modifier Keys | **Copy | ||
****Shift, Caps, Option, Command, Control | ***copy one character, see what's in clipboard | ||
*** Positional Keys : | ***copy more than one character, see what's in the clipboard | ||
****Arrows, Home, End, PageUp/Down | ***copy all characters, see what's in the clipboard | ||
*** Symbols: | **Cut | ||
**** Astricks () {} [] & ^ % $ # @ ! ~ etc. | ***cut one character, see what's in the clipboard | ||
*** Other: | ***cut more than one character, see what's in the clipboard | ||
****Esc, Delete, Clear | ***cut all characters, see what's in the clipboard | ||
****[https://wiki.mozilla.org/Mobile/Fennec/Cheat_Codes key combos] | ****hit delete after cutting all characters, and typing | ||
****[http://support.mozilla.com/en-US/kb/mobile-keyboard-shortcuts shortcuts] | **Paste | ||
** Screen size (making sure that things fit) | ***generally after cutting or copying, paste will help see what's in the clipboard | ||
* Conditional Functionality | ***copy from another application and pasting | ||
** dismiss keyboard | ***cutting from another application and pasting | ||
*** click on space above keyboard | **Highlights | ||
*** hit return? | ***select one character and pan | ||
** start virtual keyboard | ***select more than one character and pan | ||
*** click in a text field selection | ***select all characters and pan | ||
*** click in a search field | ***do the above type selections and use copy | ||
*** click in awesome bar | ***do the above type of selections and use cut | ||
** selection | |||
*** drag/drop | **cursor insertions | ||
*** character selection | *Single Touch | ||
*** multicharacter selection | **Long Touch | ||
*** Word selection | **short touch | ||
*** multiword selection | **Single key Press : depends on IME and key | ||
*** split word selection | **Special Key : See Functionality | ||
****hyphenated | *Double Touch | ||
****carriage return | **Two keys pressed : depends on IME and key | ||
*Triple+ Touch (negative test case) | |||
**Three keys pressed : depends on IME and key | |||
**four keys pressed : depends on IME and key | |||
*Keyboard Short Cuts | |||
=== Functional === | |||
*UI Based Functionality | |||
**verify that the keys function accordingly | |||
**special keys : | |||
***White Space | |||
****Space, Enter, Tab Return | |||
***Modifier Keys | |||
****Shift, Caps, Option, Command, Control | |||
***Positional Keys : | |||
****Arrows, Home, End, PageUp/Down | |||
***Symbols: | |||
****Astricks () {} [] & ^ % $ # @ ! ~ etc. | |||
***Other: | |||
****Esc, Delete, Clear | |||
****[https://wiki.mozilla.org/Mobile/Fennec/Cheat_Codes key combos] | |||
****[http://support.mozilla.com/en-US/kb/mobile-keyboard-shortcuts shortcuts] | |||
**Screen size (making sure that things fit) | |||
*Conditional Functionality | |||
**dismiss keyboard | |||
***click on space above keyboard | |||
***hit return? | |||
**start virtual keyboard | |||
***click in a text field selection | |||
***click in a search field | |||
***click in awesome bar | |||
**selection | |||
***drag/drop | |||
***character selection | |||
***multicharacter selection | |||
***Word selection | |||
***multiword selection | |||
***split word selection | |||
****hyphenated | |||
****carriage return | |||
****partial character in words | ****partial character in words | ||
== Beta Conditional == | == Beta Conditional == | ||
*Virtual Conditions | *Virtual Conditions | ||
**click in text box | **click in text box | ||
Line 123: | Line 146: | ||
**scrolling above the on-screen keyboard | **scrolling above the on-screen keyboard | ||
**Change Cursor Focus | **Change Cursor Focus | ||
*** change focus after composition | ***change focus after composition | ||
**slide right, slide left [ Panels ] | **slide right, slide left [ Panels ] | ||
**AwesomePage | **AwesomePage | ||
**Preferences/Feedback/Plugins/etc Panels | **Preferences/Feedback/Plugins/etc Panels | ||
**Context Menus | **Context Menus | ||
**Site Menu | **Site Menu | ||
**Favorites Panel | **Favorites Panel | ||
**Position/Graphical issues | **Position/Graphical issues | ||
*** collapsing before bringing up keyboard/dismissing keyboard | ***collapsing before bringing up keyboard/dismissing keyboard | ||
*** scrolling before bringing up keyboard/dismissing keyboard | ***scrolling before bringing up keyboard/dismissing keyboard | ||
*** tapping after dismissing the keyboard should bring the keyboard up | ***tapping after dismissing the keyboard should bring the keyboard up | ||
*Content Conditions | *Content Conditions | ||
** html4 | **html4 | ||
** html5 | **html5 | ||
** asp | **asp | ||
* HW keys | *HW keys | ||
** Back button | **Back button | ||
** menu button | **menu button | ||
*Physical Conditions | *Physical Conditions | ||
**While Charged | **While Charged | ||
**While not Charged | **While not Charged | ||
**Power Consumption | **Power Consumption | ||
**Performance | **Performance | ||
*** Speed of functions | ***Speed of functions | ||
*** Processor utilization | ***Processor utilization | ||
*** Memory utilization | ***Memory utilization | ||
**** Memory leaks? | ****Memory leaks? | ||
**** Memory efficiency | ****Memory efficiency | ||
**Storage | **Storage | ||
***Disk | ***Disk | ||
***Sim | ***Sim | ||
*Negative (Tests to Break) Tests | *Negative (Tests to Break) Tests | ||
** Security | **Security | ||
*** Buffer Overflow (max characters) | ***Buffer Overflow (max characters) | ||
** removal of characters | **removal of characters | ||
*Race Conditions | *Race Conditions | ||
** Lock conditions? | **Lock conditions? | ||
** tooltips or other dialogs? | **tooltips or other dialogs? | ||
** Network Conditions (Should have no impact) | **Network Conditions (Should have no impact) | ||
*** WiFi | ***WiFi | ||
*** 3G | ***3G | ||
*** Bluetooth (Devices) | ***Bluetooth (Devices) | ||
*** 4G? | ***4G? | ||
*** SMS | ***SMS | ||
**Signal Conflict | **Signal Conflict | ||
*** Browser notifications | ***Browser notifications | ||
**** clicking in search field (form assistant + virtual keyboard) | ****clicking in search field (form assistant + virtual keyboard) | ||
**** Restart notification (ie. change in certain preferences in preferences panel ) | ****Restart notification (ie. change in certain preferences in preferences panel ) | ||
**** Password notification | ****Password notification | ||
**** form manager notification | ****form manager notification | ||
**** password manager | ****password manager | ||
**** popup blocker | ****popup blocker | ||
**** offline storage | ****offline storage | ||
**** geolocation manager respective to content window | ****geolocation manager respective to content window | ||
***Battery | ***Battery | ||
****Battery Low | ****Battery Low | ||
Line 188: | Line 211: | ||
****Calendar notification | ****Calendar notification | ||
****Alarm Clock notification | ****Alarm Clock notification | ||
****Sleep notification | ****Sleep notification | ||
****Screensaver / Lock (system) | ****Screensaver / Lock (system) | ||
****EnergySaver (Fade) (system) | ****EnergySaver (Fade) (system) | ||
****Other? | ****Other? | ||
****Music playing (should not affect) | ****Music playing (should not affect) | ||
****plugins (youtube and other websites with different media types) | ****plugins (youtube and other websites with different media types) | ||
****Extensions ( addons to fennec) | ****Extensions ( addons to fennec) | ||
**Buttons | **Buttons | ||
***Hard reset | ***Hard reset | ||
Line 217: | Line 240: | ||
**Vibrate mode (should not conflict) | **Vibrate mode (should not conflict) | ||
**Volume (display conflict? need to test) | **Volume (display conflict? need to test) | ||
**GPS | **GPS | ||
**Print support? | **Print support? | ||
**Sync | **Sync | ||
** Multiapp? | **Multiapp? | ||
** physical keyboard | **physical keyboard | ||
*** visible | ***visible | ||
*** hidden | ***hidden | ||
*Localization | *Localization | ||
Line 234: | Line 257: | ||
**Change of IME on Mobile OS | **Change of IME on Mobile OS | ||
* Help? | *Help? | ||
** context sensitive help? | **context sensitive help? | ||
== Usability == | |||
*Usability | |||
*Usability | **Keyboard Real Estate | ||
** Keyboard Real Estate | **scrolling away? | ||
** scrolling away? | **jumping to another field? | ||
** jumping to another field? | **Encryption | ||
** Encryption | *Accessibility (508 compliance) | ||
* Accessibility (508 compliance) | **Voice Commands? | ||
** Voice Commands? |
Revision as of 23:18, 17 June 2011
Test Plan
Introduction
Design Documentation/Background Research
The purpose of the virtual keyboard is to provide an interface to fennec for people to type in various languages when a hardware keyboard is closed or not available to the device.
Description of this Document
This document will cover the testing approach for virtual keyboards on the Tablets
Related Documents
See Virtual Keyboard for Android Test Plan
Schedule and Milestones
Resource Requirements
Hardware
Test devices: Handhelds for comparison:
- Motorola Droid 2
- HTC Thunderbolt
Tablets:
- HTC Flyer
- Samsung
System Testing
Android OS 2.2 (Phone) Android OS 2.3 (Gingerbread) Android OS 2.4 (Honeycomb)
Software
Variety of VKB/IMEs : see...
Staffing
Feature Lead
Responsibilities
- Testing Device
- Training other people in VKBs when asked
Training
- none necessary
Note:
- need to know how to install VKBs
- need to know how the VKB works
Features To Be Tested / Test Approach
New Features Testing
Regression Testing
Features Not To Be Tested
Test Deliverables
Dependencies/Risks
Entrance/Exit Criteria
Test Outline
Note :
- This test out line is a brain storm of all possible conditions to consider for testing. The scope of the testing will be narrowed from this list based on design information, risks of breakage, etc.
- When testing, each item has to be checked, for performance, visual impact (ie graphic defects), race conditions, locking, etc. Some things will be called out to have specific instructions to check for, however the testing should not be limited to only the called out item.
Positive Smoke/Alpha Tests
UI
- General
- Keyboard Menu
- Copy
- copy one character, see what's in clipboard
- copy more than one character, see what's in the clipboard
- copy all characters, see what's in the clipboard
- Cut
- cut one character, see what's in the clipboard
- cut more than one character, see what's in the clipboard
- cut all characters, see what's in the clipboard
- hit delete after cutting all characters, and typing
- Paste
- generally after cutting or copying, paste will help see what's in the clipboard
- copy from another application and pasting
- cutting from another application and pasting
- Highlights
- select one character and pan
- select more than one character and pan
- select all characters and pan
- do the above type selections and use copy
- do the above type of selections and use cut
- cursor insertions
- Single Touch
- Long Touch
- short touch
- Single key Press : depends on IME and key
- Special Key : See Functionality
- Double Touch
- Two keys pressed : depends on IME and key
- Triple+ Touch (negative test case)
- Three keys pressed : depends on IME and key
- four keys pressed : depends on IME and key
- Keyboard Short Cuts
Functional
- UI Based Functionality
- verify that the keys function accordingly
- special keys :
- White Space
- Space, Enter, Tab Return
- Modifier Keys
- Shift, Caps, Option, Command, Control
- Positional Keys :
- Arrows, Home, End, PageUp/Down
- Symbols:
- Astricks () {} [] & ^ % $ # @ ! ~ etc.
- Other:
- Esc, Delete, Clear
- key combos
- shortcuts
- White Space
- Screen size (making sure that things fit)
- Conditional Functionality
- dismiss keyboard
- click on space above keyboard
- hit return?
- start virtual keyboard
- click in a text field selection
- click in a search field
- click in awesome bar
- selection
- drag/drop
- character selection
- multicharacter selection
- Word selection
- multiword selection
- split word selection
- hyphenated
- carriage return
- partial character in words
- dismiss keyboard
Beta Conditional
- Virtual Conditions
- click in text box
- double click in text box
- click outside of Virtual Keyboard : dismissing keyboard
- scrolling above the on-screen keyboard
- Change Cursor Focus
- change focus after composition
- slide right, slide left [ Panels ]
- AwesomePage
- Preferences/Feedback/Plugins/etc Panels
- Context Menus
- Site Menu
- Favorites Panel
- Position/Graphical issues
- collapsing before bringing up keyboard/dismissing keyboard
- scrolling before bringing up keyboard/dismissing keyboard
- tapping after dismissing the keyboard should bring the keyboard up
- Content Conditions
- html4
- html5
- asp
- HW keys
- Back button
- menu button
- Physical Conditions
- While Charged
- While not Charged
- Power Consumption
- Performance
- Speed of functions
- Processor utilization
- Memory utilization
- Memory leaks?
- Memory efficiency
- Storage
- Disk
- Sim
- Negative (Tests to Break) Tests
- Security
- Buffer Overflow (max characters)
- removal of characters
- Security
- Race Conditions
- Lock conditions?
- tooltips or other dialogs?
- Network Conditions (Should have no impact)
- WiFi
- 3G
- Bluetooth (Devices)
- 4G?
- SMS
- Signal Conflict
- Browser notifications
- clicking in search field (form assistant + virtual keyboard)
- Restart notification (ie. change in certain preferences in preferences panel )
- Password notification
- form manager notification
- password manager
- popup blocker
- offline storage
- geolocation manager respective to content window
- Battery
- Battery Low
- No Battery
- Calls
- Incoming Phone Call
- Other Apps
- Calendar notification
- Alarm Clock notification
- Sleep notification
- Screensaver / Lock (system)
- EnergySaver (Fade) (system)
- Other?
- Music playing (should not affect)
- plugins (youtube and other websites with different media types)
- Extensions ( addons to fennec)
- Browser notifications
- Buttons
- Hard reset
- Soft reset
- Turn off phone
- force quit
- Other buttons being pressed on the phone (zoom, picture, power )
- UI State Change
- Zoom
- while bringing up Keyboard
- while dismissing the keyboard
- Change Orientation
- while bringing up keyboard
- while dismissing the keyboard
- Zoom
- Device/Platform Specific Issues
- Portrait/Landscape Orientation
- Camera (should not conflict?)
- Microphone (Voice commands? Voice Recognition?)
- Speaker (should not conflict)
- headset (should not conflict)
- Vibrate mode (should not conflict)
- Volume (display conflict? need to test)
- GPS
- Print support?
- Sync
- Multiapp?
- physical keyboard
- visible
- hidden
- Localization
- Double Byte Characters (Japanese, Chinese, Korean)
- RTL Languages (Arabic/Hebrew)
- High ASCII characters (Euro)
- Date Input/Format (Euro/Japanese/Chinese)
- Time Format (Chinese/Japanese)
- Dialog check
- Change of IME on Mobile OS
- Help?
- context sensitive help?
Usability
- Usability
- Keyboard Real Estate
- scrolling away?
- jumping to another field?
- Encryption
- Accessibility (508 compliance)
- Voice Commands?