Firefox OS/FeatureTesting: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Media: Add test suite links)
Line 7: Line 7:
| QA || [mailto:irios@mozilla.com Isabel Rios]
| QA || [mailto:irios@mozilla.com Isabel Rios]
|-
|-
| How to test || TBC
| How to test || TBD
|-  
|-  
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=215
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=215
Line 20: Line 20:
| QA || [mailto:irios@mozilla.com Isabel Rios]
| QA || [mailto:irios@mozilla.com Isabel Rios]
|-
|-
| How to test || TBC
| How to test || TBD
|-
|-
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=130
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=130
Line 46: Line 46:
| QA || [mailto:iriosg@mozilla.com Isabel Rios]
| QA || [mailto:iriosg@mozilla.com Isabel Rios]
|-
|-
| How to test || TBC
| How to test || TBD
|-
|-
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=430
| Moztrap ||  https://moztrap.mozilla.org/manage/cases/?filter-suite=430

Revision as of 09:58, 11 March 2016

Communications

Feature Contacts
QA Isabel Rios
How to test TBD
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=215
Note Supported since Firefox OS v1.X
Feature Dialer
QA Isabel Rios
How to test TBD
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=130
Note Supported since Firefox OS v1.X
Feature Messages
QA Isabel Rios
How to test You might need to check if your carrier supports MMS sending before testing, some MVNOs don't support MMS.
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=210, suite=497 and suite=687
Note NowSMS can be used to send SMS, OMA CP... etc
Feature Usage (Cost Control)
QA Isabel Rios
How to test TBD
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=430
Note Supported since Firefox OS v1.X

Media

Feature
  • Music
  • Gallery
  • Video
  • Camera
  • FM Radio
QA No-Jun Park
How to test

Test Specification

Moztrap
Note Supported since Firefox OS v1.X
Feature Ringtones
QA TBD
How to test Please refer to MozTrap
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=691
Note Supported since Firefox OS v1.X
Feature Device Storage
QA TBD
How to test Please refer to MozTrap
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=187
Note Supported since Firefox OS v1.X

Multimedia platform

  • Video/Audio:Recording

Productivity

  • Email
Feature Email
QA Teri Wen
How to test 
    1. Turn on logcat: adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V | tee FILENAME-TO-LOG-TO > log.txt 
    2. Start to your manual testing
Moztrap 1. Productivity RAT test cases
Note Supported since Firefox OS v1.X
  • Calendar
Feature Email
QA Teri Wen
How to test 
    1. Turn on logcat: adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V | tee FILENAME-TO-LOG-TO > log.txt 
    2. Start to your manual testing
Moztrap 1. Productivity RAT test cases
Note Supported since Firefox OS v1.X
  • Clock
Feature Email
QA Teri Wen
How to test 
    1. Turn on logcat: adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V | tee FILENAME-TO-LOG-TO > log.txt 
    2. Start to your manual testing
Moztrap 1. Productivity RAT test cases
Note Supported since Firefox OS v1.X

System platform

  • Lock Screen
  • Window Management
  • Settings (general w/o specific feature parts)
  • Built-in Keyboard App & System Keyboard Mgmt
  • Geolocation
  • Selection
Feature Text Selection
QA Gerry Chang
How to test

Guideline: https://etherpad.mozilla.org/TextSelectionTest

Moztrap

(Outdated) https://moztrap.mozilla.org/manage/cases/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-tag=2617

Note
  • WebRTC
  • Wallpaper
  • DOM
  • Loop testing

System frontend

  • Market Customization Framework
Feature Homescreen, App-grouping
QA Hermes Cheng Naoki Hirata
How to test
Moztrap [Sys FE] Vertical Homescreen
Note
  • Notifications
  • Download Manager
  • Browser
  • App/Datastore Permissions
  • First Time Experience
  • E.me Integration
  • Offline Error Handling
Feature Task Manager
QA Hermes ChengNaoki Hirata
How to test
Moztrap [General]Card View/Task Switcher/Task Manager
Note
  • Soft homebutton
  • Find My Device
Feature Rocketbar, Search App
QA Hermes ChengNaoki Hirata
How to test
Moztrap [General]Rocketbar
Note
  • Panning and Zooming

Telephony

  • Multi Sim
  • IPV6
  • LTE
Module RIL
QA Hermes Cheng
How to test Follow the guide to turn on RIL flag for adb debug log
Moztrap
Note
Module CDMA
QA Hermes Cheng
How to test Wasabi is the current CDMA phone we have, full flash, and follow the instruction to hard code the networkType=4 in ril_workers.js
Moztrap
Note
Module STK
QA Hermes Cheng
How to test

Use this script to extract the adb log: https://gist.github.com/shinglyu/e44502cbb78e6e207445

Moztrap

SimToolKit All test cases

Note
Module Cellbroadcast, CMAS
QA Hermes Cheng
How to test Currently they can be tested using emulator.. T
Moztrap

Cell broadcast All test cases

Note

Connectivity

  • RTSP
  • NFC
  • WIFI
  • WIFI Direct
  • WIFI Display

Devices

Module Bluetooth
QA Teri Wen, Alison Shiue
How to test Bluetooth PTS certification will be run twice for a release, when in FL and in FC, see PTS wiki for details; See RD's wiki for other info, currently Gaia-ui-test only test on simple bluetooth menu Settings, no automation to test on bluetooth profiles. 
 Bluetooth tooth daemon implemented after V2.2
 adb shell ps bluetoothd
 or 
 adb shell getprop |grep bluetoothd
 then you will see "ro.moz.bluetooth.backend=bluetoothd"
 & [init.svc.bluetoothd]: [running] 
Moztrap [RAT] Bluetooth Cases for running acceptance test in a limited time.

[Sys PF]Settings - Bluetooth Settings menu related test cases.
[BT]Bluetooth All test cases

Profiles supported HSP, HFP, A2DP, AVRCP, IOPT, OPP
Note Previous PTS Meta bug 1064739 for reference, bluetooth is supported since Firefox OS vX.X
  • SD Card formatting
  • MTP
  • Metrics testing (FTU, APP usage)
Feature Metrics
QA Shing Lyu
How to test

FTU Ping: https://wiki.mozilla.org/B2G/QA/Ping_Testing

App Usage: https://wiki.mozilla.org/B2G/QA/Ping_Testing#App_Usage_Ping

Moztrap

https://moztrap.mozilla.org/manage/cases/?filter-suite=775

Note

OTA/FOTA

Feature FOTA/ OTA
QA Gerry ChangNaoki Hirata
How to test
Moztrap
Document

Device update channel check

OTA flow chart

Graphics

Feature Graphics
QA No-Jun Park
How to test https://wiki.mozilla.org/B2G/QA/Device_Test_Plan/Graphics
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=669
Sanity Test Log https://docs.google.com/spreadsheets/d/1us2Rw-xwKZvuvvTTidy96C5PPt3ivgB58LSDkmV0qnY/edit#gid=2
Document https://developer.mozilla.org/en-US/docs/Mozilla/QA/Marionette/Run_ImageMagick_Tool_with_Python_Marionette

MISC

Feature Market Customization
QA Eric Chang
How to test You can customize Gaia's default settings, like with a different wallpaper or with support phone already stored inside Contacts, or customize by carrier's MNC, MCC, so the settings can be different if you insert a specific SIM card. See wiki and mdn for more details.
Moztrap Customized UI Suite
Note Supported since Firefox OS v1.X
Retrieved from "https://wiki.allizom.org/index.php?title=Firefox_OS/FeatureTesting&oldid=1121519"