Firefox OS/FeatureTesting: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 161: Line 161:


== System platform ==
== System platform ==
{| class="wikitable"
{| class="wikitable"
|-
|-
Line 171: Line 172:
| Moztrap ||
| Moztrap ||
[https://goo.gl/YaJKol Lock Screen and Phone Lock]
[https://goo.gl/YaJKol Lock Screen and Phone Lock]
[https://goo.gl/66tqBi Take action on lock screen notifications]
[https://goo.gl/66tqBi Take action on lock screen notifications]
|-
|-
Line 176: Line 178:
|}
|}


* Window Management
{| class="wikitable"
* Settings (general w/o specific feature parts)
|-
* Built-in Keyboard App & System Keyboard Mgmt
| Feature || Geolocation
* Geolocation
|-
* Selection
| QA || NA
|-
| How to test || TBD
|-
| Moztrap || [https://goo.gl/ONV4wr Geolocation test suites]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature || Settings
|-
| QA || [mailto:ihsiao@mozilla.com Iris Hsiao]
|-
| How to test || [https://goo.gl/OpJO5p SysPF-Settings test specification]
|-
| Moztrap || [https://goo.gl/FNTMhO Settings test suites]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature || Keyboard, Built-in Keyboard App, System Keyboard Mgmt
|-
| QA || [mailto:ihsiao@mozilla.com Iris Hsiao]
|-
| How to test || [https://goo.gl/2PR8NX SysPF-Keyboard test specification]
|-
| Moztrap || [https://goo.gl/TxcqPD Settings test suites]
|-
| Note ||
|}


{| class="wikitable"
{| class="wikitable"
Line 188: Line 223:
| QA || [mailto:gchang@mozilla.com Gerry Chang]
| QA || [mailto:gchang@mozilla.com Gerry Chang]
|-
|-
| How to test ||  
| How to test || [https://etherpad.mozilla.org/TextSelectionTest Guideline]
Guideline: https://etherpad.mozilla.org/TextSelectionTest
|-  
|-  
| Moztrap ||
| Moztrap || [https://moztrap.mozilla.org/manage/cases/?filter-suite=836 Text Selection test cases]
(Outdated)
https://moztrap.mozilla.org/manage/cases/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-tag=2617
|-
|-
| Note ||  
| Note ||  
|}
|}
* Window Management
* WebRTC
* WebRTC
* Wallpaper
* Wallpaper

Revision as of 11:22, 11 March 2016

Communications

Feature Contacts
QA Isabel Rios
How to test TBD
Moztrap Contacts test case
Note Supported since Firefox OS v1.X
Feature Dialer
QA Isabel Rios
How to test TBD
Moztrap Dialer test case
Note Supported since Firefox OS v1.X
Feature Messages
QA Isabel Rios
How to test You might need to check if your carrier supports MMS sending before testing, some MVNOs don't support MMS.
Moztrap

[1] [2] [3]

Note NowSMS can be used to send SMS, OMA CP... etc
Feature Usage (Cost Control)
QA Isabel Rios
How to test TBD
Moztrap Cost Control
Note Supported since Firefox OS v1.X

Media

Feature
  • Music
  • Gallery
  • Video
  • Camera
  • FM Radio
QA No-Jun Park
How to test
Moztrap
Note Supported since Firefox OS v1.X
Feature Ringtones
QA TBD
How to test Please refer to MozTrap
Moztrap Ringtones test suite
Note Supported since Firefox OS v1.X
Feature Device Storage
QA TBD
How to test Please refer to MozTrap
Moztrap Device Storage
Note Supported since Firefox OS v1.X

Multimedia platform

  • Video/Audio:Recording

Productivity

Feature Email
QA Teri Wen
How to test

e-Mail test specification

Moztrap e-Mail RAT test cases
Note Supported since Firefox OS v1.X
Feature Calendar
QA Teri Wen
How to test

Calendar test specification

Moztrap Calendar RAT test cases
Note Supported since Firefox OS v1.X
Feature Clock
QA Teri Wen
How to test

Clock test specification

Moztrap Clock RAT test cases
Note Supported since Firefox OS v1.X

System platform

Feature Lock Screen
QA Gerry Chang
How to test SysPF-Lockscreen test specification
Moztrap

Lock Screen and Phone Lock

Take action on lock screen notifications

Note
Feature Geolocation
QA NA
How to test TBD
Moztrap Geolocation test suites
Note
Feature Settings
QA Iris Hsiao
How to test SysPF-Settings test specification
Moztrap Settings test suites
Note
Feature Keyboard, Built-in Keyboard App, System Keyboard Mgmt
QA Iris Hsiao
How to test SysPF-Keyboard test specification
Moztrap Settings test suites
Note
Feature Text Selection
QA Gerry Chang
How to test Guideline
Moztrap Text Selection test cases
Note
  • Window Management
  • WebRTC
  • Wallpaper
  • DOM
  • Loop testing

System frontend

  • Market Customization Framework
Feature Homescreen, App-grouping
QA Hermes Cheng Naoki Hirata
How to test
Moztrap [Sys FE] Vertical Homescreen
Note
  • Notifications
  • Download Manager
  • Browser
  • App/Datastore Permissions
  • First Time Experience
  • E.me Integration
  • Offline Error Handling
Feature Task Manager
QA Hermes ChengNaoki Hirata
How to test
Moztrap [General]Card View/Task Switcher/Task Manager
Note
  • Soft homebutton
  • Find My Device
Feature Rocketbar, Search App
QA Hermes ChengNaoki Hirata
How to test
Moztrap [General]Rocketbar
Note
  • Panning and Zooming

Telephony

  • Multi Sim
  • IPV6
  • LTE
Module RIL
QA Hermes Cheng
How to test Follow the guide to turn on RIL flag for adb debug log
Moztrap
Note
Module CDMA
QA Hermes Cheng
How to test Wasabi is the current CDMA phone we have, full flash, and follow the instruction to hard code the networkType=4 in ril_workers.js
Moztrap
Note
Module STK
QA Hermes Cheng
How to test

Use this script to extract the adb log: https://gist.github.com/shinglyu/e44502cbb78e6e207445

Moztrap

SimToolKit All test cases

Note
Module Cellbroadcast, CMAS
QA Hermes Cheng
How to test Currently they can be tested using emulator.. T
Moztrap

Cell broadcast All test cases

Note

Connectivity

  • RTSP
  • NFC
  • WIFI
  • WIFI Direct
  • WIFI Display

Devices

Module Bluetooth
QA Teri Wen, Alison Shiue
How to test Bluetooth PTS certification will be run twice for a release, when in FL and in FC, see PTS wiki for details; See RD's wiki for other info, currently Gaia-ui-test only test on simple bluetooth menu Settings, no automation to test on bluetooth profiles. 
 Bluetooth tooth daemon implemented after V2.2
 adb shell ps bluetoothd
 or 
 adb shell getprop |grep bluetoothd
 then you will see "ro.moz.bluetooth.backend=bluetoothd"
 & [init.svc.bluetoothd]: [running] 
Moztrap [RAT] Bluetooth Cases for running acceptance test in a limited time.

[Sys PF]Settings - Bluetooth Settings menu related test cases.
[BT]Bluetooth All test cases

Profiles supported HSP, HFP, A2DP, AVRCP, IOPT, OPP
Note Previous PTS Meta bug 1064739 for reference, bluetooth is supported since Firefox OS vX.X
  • SD Card formatting
  • MTP
  • Metrics testing (FTU, APP usage)
Feature Metrics
QA Shing Lyu
How to test

FTU Ping: https://wiki.mozilla.org/B2G/QA/Ping_Testing

App Usage: https://wiki.mozilla.org/B2G/QA/Ping_Testing#App_Usage_Ping

Moztrap

https://moztrap.mozilla.org/manage/cases/?filter-suite=775

Note

OTA/FOTA

Feature FOTA/ OTA
QA Gerry ChangNaoki Hirata
How to test
Moztrap
Document

Device update channel check

OTA flow chart

Graphics

Feature Graphics
QA No-Jun Park
How to test https://wiki.mozilla.org/B2G/QA/Device_Test_Plan/Graphics
Moztrap https://moztrap.mozilla.org/manage/cases/?filter-suite=669
Sanity Test Log https://docs.google.com/spreadsheets/d/1us2Rw-xwKZvuvvTTidy96C5PPt3ivgB58LSDkmV0qnY/edit#gid=2
Document https://developer.mozilla.org/en-US/docs/Mozilla/QA/Marionette/Run_ImageMagick_Tool_with_Python_Marionette

MISC

Feature Market Customization
QA Eric Chang
How to test You can customize Gaia's default settings, like with a different wallpaper or with support phone already stored inside Contacts, or customize by carrier's MNC, MCC, so the settings can be different if you insert a specific SIM card. See wiki and mdn for more details.
Moztrap Customized UI Suite
Note Supported since Firefox OS v1.X
Retrieved from "https://wiki.allizom.org/index.php?title=Firefox_OS/FeatureTesting&oldid=1121553"