Firefox OS/FeatureTesting: Difference between revisions

 
(18 intermediate revisions by the same user not shown)
Line 104: Line 104:


|-
|-
| QA || TBD
| QA || [mailto:whsu@mozilla.com William Hsu]
|-
|-
| How to test || Please refer to MozTrap
| How to test || Please refer to MozTrap
Line 161: Line 161:


== System platform ==
== System platform ==
{| class="wikitable"
{| class="wikitable"
|-
|-
Line 167: Line 168:
| QA || [mailto:gchang@mozilla.com Gerry Chang]
| QA || [mailto:gchang@mozilla.com Gerry Chang]
|-
|-
| How to test || [https://goo.gl/Rx7yEd SysPF-Lockscreen]
| How to test || [https://goo.gl/Rx7yEd SysPF-Lockscreen test specification]
|-
| Moztrap ||
[https://goo.gl/YaJKol Lock Screen and Phone Lock]
 
[https://goo.gl/66tqBi Take action on lock screen notifications]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature || Geolocation
|-
| QA || NA
|-
| How to test || TBD
|-
| Moztrap || [https://goo.gl/ONV4wr Geolocation test suites]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature || Settings
|-
| QA || [mailto:ihsiao@mozilla.com Iris Hsiao]
|-
| How to test || [https://goo.gl/OpJO5p SysPF-Settings test specification]
|-
| Moztrap || [https://goo.gl/FNTMhO Settings test suites]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature || Keyboard, Built-in Keyboard App, System Keyboard Mgmt
|-
| QA || [mailto:ihsiao@mozilla.com Iris Hsiao]
|-
| How to test || [https://goo.gl/2PR8NX SysPF-Keyboard test specification]
|-  
|-  
| Moztrap || [https://goo.gl/YaJKol Lock Screen and Phone Lock] [https://goo.gl/66tqBi Take action on lock screen notifications]
| Moztrap || [https://goo.gl/TxcqPD Settings test suites]
]
|-
|-
| Note ||  
| Note ||  
|}
|}


* Window Management
* Settings (general w/o specific feature parts)
* Built-in Keyboard App & System Keyboard Mgmt
* Geolocation
* Selection
{| class="wikitable"
{| class="wikitable"
|-
|-
Line 186: Line 223:
| QA || [mailto:gchang@mozilla.com Gerry Chang]
| QA || [mailto:gchang@mozilla.com Gerry Chang]
|-
|-
| How to test ||  
| How to test || [https://etherpad.mozilla.org/TextSelectionTest Guideline]
Guideline: https://etherpad.mozilla.org/TextSelectionTest
|-  
|-  
| Moztrap ||
| Moztrap || [https://moztrap.mozilla.org/manage/cases/?filter-suite=836 Text Selection test cases]
(Outdated)
https://moztrap.mozilla.org/manage/cases/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-tag=2617
|-
|-
| Note ||  
| Note ||  
|}
|}
* Window Management
* WebRTC
* WebRTC
* Wallpaper
* Wallpaper
Line 201: Line 237:


== System frontend ==
== System frontend ==
* Market Customization Framework
{| class="wikitable"
{| class="wikitable"
|-
|-
| Feature|| Homescreen, App-grouping
| Feature|| Homescreen, App-grouping
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng] [mailto:nhirata@mozilla.com Naoki Hirata]
| QA || [mailto:nhirata@mozilla.com Naoki Hirata]
|-
|-
| How to test ||  
| How to test || [https://goo.gl/a14Uuz Homescreen test specification]
|-
|-
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=%5Bsys+fe%5D+vertical+homescreen [Sys FE<nowiki>]</nowiki> Vertical Homescreen]
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=%5Bsys+fe%5D+vertical+homescreen [Sys FE<nowiki>]</nowiki> Vertical Homescreen]
Line 214: Line 249:
| Note ||
| Note ||
|}
|}
* Notifications
 
* Download Manager
{| class="wikitable"
* Browser
|-
* App/Datastore Permissions
| Feature|| Browser
* First Time Experience
|-
* E.me Integration
| QA || [mailto:ashiue@mozilla.com Alison Shiue]
* Offline Error Handling
|-
| How to test || [https://goo.gl/lmsOi0 Browser test specification]
|-
| Moztrap || [https://goo.gl/e9KwQb Browser test cases]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature|| Notifications
|-
| QA || NA
|-
| How to test || TBD
|-
| Moztrap || [https://goo.gl/29Tcg6 Notifications test cases]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature|| First Time Experience
|-
| QA || [mailto:ashiue@mozilla.com Alison Shiue]
|-
| How to test || [https://goo.gl/XRVw6T FTE test specification]
|-
| Moztrap || [https://goo.gl/BPkqdm FTE test cases]
|-
| Note ||
|}
 
{| class="wikitable"
{| class="wikitable"
|-
|-
| Feature|| Task Manager
| Feature|| Task Manager
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng][mailto:nhirata@mozilla.com Naoki Hirata]
| QA || [mailto:nhirata@mozilla.com Naoki Hirata]
|-
|-
| How to test ||  
| How to test ||  
Line 233: Line 301:
| Note ||
| Note ||
|}
|}
* Soft homebutton
 
* Find My Device
{| class="wikitable"
|-
| Feature|| Download Manager
|-
| QA || TBD
|-
| How to test || Please refer to MozTrap
|-
| Moztrap || [https://goo.gl/11QN7D Download manager test cases]
|-
| Note ||
|}
 
{| class="wikitable"
|-
| Feature|| Find My Device
|-
| QA || TBD
|-
| How to test || Please refer to MozTrap
|-
| Moztrap || [https://goo.gl/5AY1qg Find My Device test cases]
|-
| Note ||
|}
 
{| class="wikitable"
{| class="wikitable"
|-
|-
| Feature|| Rocketbar, Search App
| Feature|| Rocketbar, Search App
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng][mailto:nhirata@mozilla.com Naoki Hirata]
| QA || [mailto:nhirata@mozilla.com Naoki Hirata]
|-
|-
| How to test ||  
| How to test || [https://goo.gl/ae1PG3 Rocketbar]
|-
|-
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=%5Bgeneral%5Drocketbar [General<nowiki>]</nowiki>Rocketbar]
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=%5Bgeneral%5Drocketbar [General<nowiki>]</nowiki>Rocketbar]
Line 247: Line 340:
| Note ||
| Note ||
|}
|}
{| class="wikitable"
|-
| Feature || Market Customization
|-
| QA || TBC
|-
| How to test || You can customize Gaia's default settings, like with a different wallpaper or with support phone already stored inside Contacts, or customize by carrier's MNC, MCC, so the settings can be different if you insert a specific SIM card. See [[B2G/QA/Customizations|wiki]] and [https://developer.mozilla.org/en-US/Firefox_OS/Developing_Gaia/Market_customizations_guide mdn] for more details.
|-
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=customized Customized UI Suite] 
|-
| Note || Supported since Firefox OS v1.X
|}
* App/Datastore Permissions
* E.me Integration
* Offline Error Handling
* Soft home button
* Panning and Zooming
* Panning and Zooming


== Telephony ==
== Telephony ==
* Multi Sim
* IPV6
* LTE
{| class="wikitable"
{| class="wikitable"
|-
|-
| Module || RIL
| Module || RIL
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng]
| QA || [mailto:gchang@mozilla.com Gerry Chang]
|-
|-
| How to test || Follow the guide to [https://wiki.mozilla.org/FirefoxOS/DeviceQA/CollectLogs#RIL_Debugging turn on RIL flag for adb debug log ]  
| How to test || Follow the guide to [https://wiki.mozilla.org/FirefoxOS/DeviceQA/CollectLogs#RIL_Debugging turn on RIL flag for adb debug log ]  
|-
|-
| Moztrap ||  
| Moztrap || [https://goo.gl/DKyczb RIL test cases]
|-
|-
| Note ||  
| Note ||  
Line 269: Line 375:
{| class="wikitable"
{| class="wikitable"
|-
|-
| Module || CDMA
| Module || Cellbroadcast, CMAS
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng]
| QA || TBC
|-
|-
| How to test || Wasabi is the current CDMA phone we have, full flash, and follow the [https://intranet.mozilla.org/QA/B2G_Tips_and_Tricks#Wasabi instruction] to hard code the networkType=4 in ril_workers.js
| How to test || Currently they can be tested using emulator.
|-
|-
| Moztrap ||  
| Moztrap ||  
[https://moztrap.mozilla.org/manage/cases/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-tag=2985 Cell broadcast] All test cases
|-
|-
| Note ||  
| Note ||  
|}
|}


== Connectivity ==
{| class="wikitable"
{| class="wikitable"
|-
|-
| Module || STK
| Module || RTSP
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng]
| QA || [mailto:whsu@mozilla.com William Hsu]
|-
|-
| How to test ||  
| How to test || Please refer to MozTrap
Use this script to extract the adb log: https://gist.github.com/shinglyu/e44502cbb78e6e207445
|-
|-
| Moztrap ||  
| Moztrap || [https://goo.gl/F1Bj2H RTSP test cases]
[https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=simtoolkit SimToolKit] All test cases
|-
|-
| Note ||  
| Note ||  
Line 297: Line 403:
{| class="wikitable"
{| class="wikitable"
|-
|-
| Module || Cellbroadcast, CMAS
| Module || NFC
|-
|-
| QA || [mailto:hcheng@mozilla.com Hermes Cheng]
| QA || [mailto:ashiue@mozilla.com Alison Shiue]
|-
|-
| How to test || Currently they can be tested using emulator.. T
| How to test || [https://goo.gl/Cxt3vt NFC test specification]
|-
|-
| Moztrap ||  
| Moztrap || [https://goo.gl/cwULzU NFC test cases]
[https://moztrap.mozilla.org/manage/cases/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-tag=2985 Cell broadcast] All test cases
|-
|-
| Note ||  
| Note ||  
|}
|}


== Connectivity ==
{| class="wikitable"
* RTSP
|-
* NFC
| Module || WIFI
* WIFI
|-
| QA || [mailto:gchang@mozilla.com Gerry Chang]
|-
| How to test || Please refer to MozTrap
|-
| Moztrap || [https://goo.gl/KDsTPG WIFI test cases]
|-
| Note ||
|}
* WIFI Direct
* WIFI Direct
* WIFI Display
* WIFI Display
Line 340: Line 453:
|}
|}


* SD Card formatting
* MTP
* Metrics testing (FTU, APP usage)
{| class="wikitable"
{| class="wikitable"
|-
|-
Line 350: Line 460:
|-
|-
| How to test ||  
| How to test ||  
FTU Ping:  https://wiki.mozilla.org/B2G/QA/Ping_Testing     
[https://wiki.mozilla.org/B2G/QA/Ping_Testing FTU Ping]    


App Usage: https://wiki.mozilla.org/B2G/QA/Ping_Testing#App_Usage_Ping
[https://wiki.mozilla.org/B2G/QA/Ping_Testing#App_Usage_Ping App Usage]


|-  
|-  
| Moztrap ||  
| Moztrap ||  
https://moztrap.mozilla.org/manage/cases/?filter-suite=775  
[https://moztrap.mozilla.org/manage/cases/?filter-suite=775 Metrics test cases]
|-
|-
| Note ||  
| Note ||  
|}
|}
* SD Card formatting
* MTP


== OTA/FOTA ==
== OTA/FOTA ==
Line 396: Line 508:


== MISC ==
== MISC ==
{| class="wikitable"
|-
| Feature || Market Customization
|-
| QA || [mailto:echang@mozilla.com Eric Chang]
|-
| How to test || You can customize Gaia's default settings, like with a different wallpaper or with support phone already stored inside Contacts, or customize by carrier's MNC, MCC, so the settings can be different if you insert a specific SIM card. See [[B2G/QA/Customizations|wiki]] and [https://developer.mozilla.org/en-US/Firefox_OS/Developing_Gaia/Market_customizations_guide mdn] for more details.
|-
| Moztrap || [https://moztrap.mozilla.org/manage/suites/?pagenumber=1&pagesize=20&sortfield=created_on&sortdirection=desc&filter-name=customized Customized UI Suite] 
|-
| Note || Supported since Firefox OS v1.X
|}
Confirmed users
452

edits