B2G/QA/Gaia Test Plan/Browser

General Information

Area	Details
Team:	Developers: Designer: QA: Naoki Hirata

Test Plan

Mobile OS

• B2G - Firefox OS 18

Mobile Device

Test devices :

• Otoro
• Unagi

Strategy

• Exploratory Manual testing using outline; see Test Outline section
• Regression testing based on Test Cases
• Eventual automation testing

Signoff Criteria

• All basecamp blockers are closed
• All smoke tests and basic functional tests are ran without finding any basecamp blockers

Test Cases and Results

• Test cases will be tracked in MozTrap under "gaia" and "email"

Test Outline

Note : This test out line is a brain storm of all possible conditions to consider for testing. The scope of the testing will be narrowed from this list based on design information, risks of breakage, etc.

Positive Smoke/Alpha Tests

UI

• General

• Gestures

• Keyboard Short Cuts

Functional

• UI Based Functionality
• Input
  • Symbols:
    • Astricks () {} [] & ^ % $ # @ ! ~ etc.
  • Screen size (making sure that things fit)

• Conditional Functionality

Beta Conditional

• Virtual Conditions

• Content Conditions

• Physical Conditions
  • While Charged
  • While not Charged
  • Power Consumption
  • Performance
    • Speed of functions
    • Processor utilization
    • Memory utilization
      • Memory leaks?
      • Memory efficiency
  • Storage
    • Disk
    • Sim

• Negative (Tests to Break) Tests
  • Security
    • Buffer Overflow (max characters)
  • removal of characters

• Race Conditions
  • Lock conditions?
  • tooltips or other dialogs?
  • Network Conditions (Should have no impact)
    • WiFi
    • 3G
    • Bluetooth (Devices)
    • 4G?
    • SMS
  • Signal Conflict
    • Browser notifications
      • clicking in search field (form assistant + virtual keyboard)
      • Restart notification (ie. change in certain preferences in preferences panel )
      • Password notification
      • form manager notification
      • password manager
      • popup blocker
      • offline storage
      • geolocation manager respective to content window
    • Battery
      • Battery Low
      • No Battery
    • Calls
      • Incoming Phone Call
    • Other Apps
      • Calendar notification
      • Alarm Clock notification
      • Sleep notification
      • Screensaver / Lock (system)
      • EnergySaver (Fade) (system)
      • Other?
      • Music playing (should not affect)
      • plugins (youtube and other websites with different media types)
      • Extensions ( addons to fennec)
  • Buttons
    • Hard reset
    • Soft reset
    • Turn off phone
    • force quit
    • Other buttons being pressed on the phone (zoom, picture, power )
  • UI State Change
    • Zoom
      • while bringing up Keyboard
      • while dismissing the keyboard
    • Change Orientation
      • while bringing up keyboard
      • while dismissing the keyboard

• Device/Platform Specific Issues
  • Portrait/Landscape Orientation
  • Camera (should not conflict?)
  • Microphone (Voice commands? Voice Recognition?)
  • Speaker (should not conflict)
  • headset (should not conflict)
  • Vibrate mode (should not conflict)
  • Volume (display conflict? need to test)
  • GPS
  • Print support?
  • Sync
  • Multiapp?
  • physical keyboard
    • visible
    • hidden

(Note : There may be some difference between maemo and android)

• Localization
  • Double Byte Characters (Japanese, Chinese, Korean)
  • RTL Languages (Arabic/Hebrew)
  • High ASCII characters (Euro)
  • Date Input/Format (Euro/Japanese/Chinese)
  • Time Format (Chinese/Japanese)
  • Dialog check
  • Change of IME on Mobile OS

• Help?

Usability

• Usability
• Accessibility (508 compliance)