MozillaWiki

B2G/QA: Difference between revisions

Page Discussion

B2G/QA (view source)

Revision as of 19:31, 18 December 2015

4,086 bytes removed ,  18 December 2015
New QA wiki page content
(update qa team members)
(New QA wiki page content)
Line 1: Line 1:
= Team Details =
== For Newcomers ==
 
Firefox OS is Mozilla's mobile phone operating system for the open Web, built entirely using HTML5 & standard Web APIs. Community is key to the success of the open Web. If you want to help Firefox OS Quality Assurance activities, it's very easy to start. <br>
== Overview ==
<br>
 
First of all, if you are new to Mozilla Quality Assurance, you will need a [https://oneanddone.mozilla.org/tasks/14/ Bugzilla account].  
The B2G QA team is committed to qualifying the full spectrum of testing from backend (Gecko) to Frontend (Gaia).  Test coverage will include a range of manual execution steps, automated test coverage, proper documentation, and community involvement projects.
<br>
 
<br>
== Join us ==
Also, it is strongly advised to visit [https://quality.mozilla.org/teams/firefox-os-qa/ Firefox OS QA Team Page] in [https://quality.mozilla.org/ QMO] before you proceed, since it gives a good overall introduction of the Firefox OS QA. For new hires, please visit [[B2G/QA/New Hire Doc|Firefox OS QA New Hire Document]].
Firefox OS is Mozilla's mobile phone operating system for the open Web, built entirely using HTML5 & standard Web APIs. Community is key to the success of the open Web.  
 
If you want to help Firefox OS Quality Assurance activities, it's very easy to start.
 
=== New Contributors ===
If you are new to Mozilla Quality Assurance, you will need a [https://oneanddone.mozilla.org/tasks/14/ Bugzilla account].  
 
If you do not have a device running Firefox OS, you can get started with the [https://oneanddone.mozilla.org/tasks/23/ Firefox OS Simulator] inside the desktop Firefox browser.
 
=== Contributors with a Firefox OS Device ===
* If you have a device running Firefox OS, you will need to update it to the latest nightly build.
** For Mozilla's [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame Flame reference device], follow these [https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame/Initial_setup essential steps] to set up your computer to work with your Flame.
** Flash the Flame device with a [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame/Updating_your_Flame#Up-to-date_%28use_these_unless_you_have_a_good_reason_not_to%29 base image].
** Flash the Flame device with the [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame/Updating_your_Flame#Updating_your_Flame_to_a_nightly_build latest nightly build].
 
* If your smartphone is from Geeksphone, please get the latest build from here: http://downloads.geeksphone.com/
 
* If your phone gets soft-bricked, bring it into [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame/Updating_your_Flame#Fastboot_mode fastboot mode] and flash the base build again.
 
=== Simple Tasks ===
Get introduced to Firefox OS with [https://oneanddone.mozilla.org/en-US/tasks/available/?team=4 simple testing tasks in One and Done] that take as little as 15 minutes.


== Team Information / Meetings ==
=== Communication Channels ===
=== Communication Channels ===
A great place to get started is to join one of these communication channels where other people involved with Firefox OS Quality Assurance are available to help. Feel free to join one of the following and introduce yourself.
A great place to get started is to join one of these communication channels where other people involved with Firefox OS Quality Assurance are available to help. Feel free to join one of the following and introduce yourself.
Line 33: Line 13:
* [https://mail.mozilla.org/listinfo/qa-b2g B2G QA] mailing list
* [https://mail.mozilla.org/listinfo/qa-b2g B2G QA] mailing list
* [https://client00.chat.mibbit.com/?url=irc%3A%2F%2Firc.mozilla.org%2Ffxosqa #fxosqa] IRC channel
* [https://client00.chat.mibbit.com/?url=irc%3A%2F%2Firc.mozilla.org%2Ffxosqa #fxosqa] IRC channel
** If you don't know who to talk to? ping local residents like :jlorenzo, :nhirata_, :njpark, :pallavi first.
* [https://client00.chat.mibbit.com/?url=irc%3A%2F%2Firc.mozilla.org%2Ffxos-automation #fxos-automation] IRC channel
** Again, if you don't know who to talk to, :jlorenzo, :mwargers, :njpark are good firsts


== Meetings ==
=== Functional QA Roundtable Meeting ===
=== Functional QA Roundtable ===
* Meeting Time: Wednesdays @ 5pm - 5:45pm PST
* Meeting Time: Wednesdays @ 5pm - 5:45pm PST
* Vidyo Room: QA Vidyo Room
* Vidyo Room: QA Vidyo Room
Line 44: Line 26:
* B2G dashboard: http://charts.mozilla.org
* B2G dashboard: http://charts.mozilla.org


=== Automation QA Roundtable ===
=== Automation QA Roundtable Meeting ===
* Details and minutes can be found [[/Meetings#Automation_QA_Roundtable|here]].
* Details and minutes can be found [[/Meetings#Automation_QA_Roundtable|here]].


=== Device QA Roundtable ===
=== Device QA Roundtable Meeting ===
* Friday 3pm - 4:00pm - [https://wiki.mozilla.org/FirefoxOS/DeviceQA#Meeting_Minutes Taiwan team Meeting], [https://taiwan.etherpad.mozilla.org/510 prev Taiwan team Meeting]
* Friday 3pm - 4:00pm - [https://wiki.mozilla.org/FirefoxOS/DeviceQA#Meeting_Minutes Taiwan team Meeting], [https://taiwan.etherpad.mozilla.org/510 prev Taiwan team Meeting]
* Meeting Notes - https://wiki.mozilla.org/B2G/QA/Meetings
* Meeting Notes - https://wiki.mozilla.org/B2G/QA/Meetings


=== Notes Archives ===
=== Meeting Notes Archives ===
* https://wiki.mozilla.org/B2G/QA/Meetings
* https://wiki.mozilla.org/B2G/QA/Meetings


== Team Members ==
=== Team Members ===


{| class="fullwidth-table"
{| class="fullwidth-table"
|-
|-
| style="background:#EFEFEF; width:25%" | '''Team Member'''  
| style="background:#EFEFEF; width:25%" | '''Team Member'''  
| style="background:#EFEFEF; width:40%" | '''IRC Nick (#fxosqa, #appsqa, #qa)'''
| style="background:#EFEFEF; width:30%" | '''IRC Nick (#fxosqa, #appsqa, #qa)'''
| style="background:#EFEFEF; width:20%" | '''Location'''  
| style="background:#EFEFEF; width:20%" | '''Location'''  
| style="background:#EFEFEF; width:40%" | '''Area[1]'''
|-
|-
| [mailto:nhirata@mozilla.com Naoki Hirata]  
| [mailto:nhirata@mozilla.com Naoki Hirata]  
| nhirata
| nhirata
| San Francisco, CA
| San Francisco, CA
| Geolocation, System Front End, FOTA & OTA update, Vaani, Crash Investigation, & Misc. (ie e.me transition server, Flashing devices, etc )
|-
|-
| [mailto:mwargers@mozilla.com Martijn Wargers]  
| [mailto:mwargers@mozilla.com Martijn Wargers]  
| mwargers
| mwargers
| Wageningen, NL
| Wageningen, NL
| style="background:#EFEFEF" | Automation Tests, DOM
|-
|-
| [mailto:kraj@mozilla.com Krupa Raj]  
| [mailto:kraj@mozilla.com Krupa Raj]  
Line 77: Line 62:
| delphine
| delphine
| Mountain View, CA
| Mountain View, CA
| style="background:#EFEFEF" | L10n, RTL
|-
|-
| [mailto:marcia@mozilla.com Marcia Knous]  
| [mailto:marcia@mozilla.com Marcia Knous]  
| marcia
| marcia
| Mountain View, CA
| Mountain View, CA
| FMD
|-
| [mailto:mbryant@mozilla.com Michael Bryant]
| uber
| Mountain View, CA
|
|-
| [mailto:pyaramada@mozilla.com Pallavi Yaramada]
| pallavi
| Mountain View, CA
|
|-
|-
| [mailto:npark@mozilla.com No-Jun Park]  
| [mailto:npark@mozilla.com No-Jun Park]  
| njpark
| njpark
| Toronto, Canada
| Toronto, Canada
| style="background:#EFEFEF" | All graphics components, All Media (Video, Audio, FMRadio, Camera, Gallery, Music, etc.) components
|-
|-
| [mailto:pyang@mozilla.com Paul Yang]  
| [mailto:pyang@mozilla.com Paul Yang]  
| pyang
| pyang
| Taipei, Taiwan
| Taipei, Taiwan
| MTBF
|-
|-
| [mailto:atsai@mozilla.com Al Tsai]  
| [mailto:atsai@mozilla.com Al Tsai]  
Line 97: Line 96:
| whsu
| whsu
| Taipei, Taiwan
| Taipei, Taiwan
| RTL, data sync, outsource management (Marigold)
|-
|-
| [mailto:fyen@mozilla.com Askeing Yen]  
| [mailto:fyen@mozilla.com Askeing Yen]  
| askeing, fyen
| askeing, fyen
| Taipei, Taiwan
| Taipei, Taiwan
| style="background:#EFEFEF" | Marionette, MozITP, b2g-util, taskcluster-util
|-
|-
| [mailto:wachen@mozilla.com Walter Chen]  
| [mailto:wachen@mozilla.com Walter Chen]  
| ypwalter, wachen
| ypwalter, wachen
| Taipei, Taiwan
| Taipei, Taiwan
| style="background:#EFEFEF" | MCTS
|-
|-
| [mailto:slyu@mozilla.com Shing Lyu]  
| [mailto:slyu@mozilla.com Shing Lyu]  
| slyu
| slyu
| Taipei, Taiwan
| Taipei, Taiwan
| style="background:#EFEFEF" | Marionette, MozIlluminate/MozTrap, MozITP
|-
|-
| [mailto:jlorenzo@mozilla.com Johan Lorenzo]  
| [mailto:jlorenzo@mozilla.com Johan Lorenzo]  
| jlorenzo
| jlorenzo
| Paris, France
| Paris, France
| Gip to Gij, CI, DOM:Apps
|-
|-
| [mailto:ashiue@mozilla.com Alison Shiue]  
| [mailto:ashiue@mozilla.com Alison Shiue]  
| ashiue
| ashiue
| Taipei, Taiwan
| Taipei, Taiwan
|
| style="background:#EFEFEF" | Pin the Web, Browser, FTE, Homescreen, Ringtones, Search, System, Windows Mgmt, Wallpaper, MTP/UMS
|-
|-
| [mailto:mlien@mozilla.com Mike Lien]  
| [mailto:mlien@mozilla.com Mike Lien]  
| mlien
| mlien
| Taipei, Taiwan
| Taipei, Taiwan
|
| style="background:#EFEFEF" | New Security Model, Add-ons, Performance
|-
|-
| [mailto:gchang@mozilla.com Gerry Chang]  
| [mailto:gchang@mozilla.com Gerry Chang]  
| gchang
| gchang
| Taipei, Taiwan
| Taipei, Taiwan
|
| Kill Switch, CDMA, DOM: Dev Interfaces, Build, Cost Control, General, RIL, Wifi
|-
|-
| [mailto:twen@mozilla.com Teri Wen]  
| [mailto:twen@mozilla.com Teri Wen]  
| twen
| twen
| Taipei, Taiwan
| Taipei, Taiwan
| style="background:#EFEFEF" | Control Center, Replaceable Homescreen, Customization, Bluetooth, Calendar, Clock, Email
|-
| [mailto:ihsiao@mozilla.com Iris Hsiao]
| ihsiao
| Taipei, Taiwan
| Web Components, Metrics, Keyboard, Settings, Lockscreen
|-
| [mailto:ctang@mozilla.com Cynthia Tang]
| ctang
| Taipei, Taiwan
| style="background:#EFEFEF" | All features for TV project
|-
|-
| [mailto:shog@mozilla.com Shako Ho]  
| [mailto:shog@mozilla.com Shako Ho]  
| shako
| shako
| Taipei, Taiwan
| Taipei, Taiwan
|-
| MTBF
| [mailto:ihsiao@mozilla.com Iris Hsiao]
| ihsiao
| Taipei, Taiwan
|-
|-
| [mailto:irios@mozilla.com Isabel Rios]  
| [mailto:irios@mozilla.com Isabel Rios]  
| isabel_rios
| isabel_rios
| Madrid, Spain
| Madrid, Spain
| style="background:#EFEFEF" | NGA, Contacts, Dialer, SMS
|-
|-
| [mailto:manelmozz@gmail.com Manel Rhaiem]
| [mailto:manelmozz@gmail.com Manel Rhaiem]
Line 161: Line 174:
|-
|-
| style="background:#EFEFEF; width:25%" | '''Honorary Member'''  
| style="background:#EFEFEF; width:25%" | '''Honorary Member'''  
| style="background:#EFEFEF; width:40%" | '''IRC Nick (#fxosqa, #appsqa, #qa)'''
| style="background:#EFEFEF; width:30%" | '''IRC Nick (#fxosqa, #appsqa, #qa)'''
| style="background:#EFEFEF; width:20%" | '''Location'''  
| style="background:#EFEFEF; width:20%" | '''Location'''  
|-
|-
Line 168: Line 181:
| Mountain View, CA
| Mountain View, CA
|}
|}
[1] Based on  https://public.etherpad-mozilla.org/p/Test-Outline-2.5 and https://public.etherpad-mozilla.org/p/b2g-qa-roundtable


= Projects =
== [[B2G/QA/Process|QA Process (link)]] ==
* [https://wiki.mozilla.org/Modules/FirefoxOS Firefox OS Modules]
* [https://wiki.mozilla.org/B2G/QA/2.5#Feature_Area_Owners Feature Area Owners]
* [https://wiki.mozilla.org/index.php?title=B2G/QA/Daily_Bulletin Daily Bulletin]
== End to End QA ==
 
=== Overview ===
 
This group primarily focuses on doing end to end testing of end to end functionality through Gaia and Gecko, including the apps pre-installed on the device, phone features, etc.
 
=== References ===
==== B2G ====
* RoadMap: https://wiki.mozilla.org/B2G/Roadmap
** 2.5 : https://wiki.mozilla.org/B2G/QA/2.5
*** Documentations: https://etherpad.mozilla.org/QA-Docs-2-5
** 2.2 : https://wiki.mozilla.org/B2G/QA/2.2
** 2.1 : https://wiki.mozilla.org/B2G/QA/2.1
 
==== Test Plans ====
* [https://wiki.mozilla.org/B2G/QA/Device_Test_Plan/NewDevice New Device Test Plan]
* [https://wiki.mozilla.org/B2G/QA/Gaia_Test_Plan/Email 1.0.1 Email Test Plan]
* [https://wiki.mozilla.org/B2G/QA/Gaia_Test_Plan/Browser 1.0.1 Browser Test Plan]
* [https://wiki.mozilla.org/B2G/QA/Gaia_Test_Plan/Crash 1.0.1 Crash Reporting Test Plan]
* [https://wiki.mozilla.org/B2G/QA/Device_Test_Plan/Graphics Graphics Test Plan]
==== Misc References ====
* [https://wiki.mozilla.org/B2G/QA/Bugzilla Bugzilla Usage/Bug creation]
* [https://wiki.mozilla.org/B2G/QA/Bug_Queries Relevant B2G Bug Queries]
* [https://wiki.mozilla.org/Bugmasters/Projects/FirefoxOS Confirming Unconfirmed Firefox OS bugs]
* [https://wiki.mozilla.org/B2G/QA/Tips_And_Tricks B2G Testing Tips & Tricks!]
* [https://wiki.mozilla.org/B2G/QA/Test_Plan_Review Test Plan Review]
* [https://wiki.mozilla.org/B2G/QA/Gaia_Test_Plan/Email_Templates Email Templates]
* [https://www.pivotaltracker.com/projects/741071 B2G QA Process Backlog Tracker]
* [[B2G/QA/Daily_Triage_Schedule|Daily Triage Schedule]]
* [https://wiki.mozilla.org/B2G/QA/Triage QA Triage]
* [https://wiki.mozilla.org/B2G/QA/Git_Commands Useful git commands]
* [[B2G/QA/New Hire Doc|Firefox OS QA New Hire Document]]
 
==== Firefox OS UX SPEC ====
* Ignite https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/2957379877
* v2.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/2243702431
* v2.1: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1759289051
* v2.0: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1732424767
* v1.4: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1226137087
* v1.3: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1147153091
* v1.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1030015572
 
==== Smoke Test ====
* Smoketest Breakdown : https://mozqa.etherpad.mozilla.org/Smoketest-Daily-Workflow
==== Test Run ====
* Testrun communication how-to (with templates) : https://etherpad.mozilla.org/moztrap-testrun-howto
===== Moztrap =====
* How to import testcases to Moztrap : https://etherpad.mozilla.org/howto-import-testcases-moztrap
==== Automation Tests ====
* https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Platform/Automated_testing?redirectlocale=en-US&redirectslug=Mozilla%2FFirefox_OS%2FPlatform%2FTesting
 
==== How to build ====
* How to build : https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Firefox_OS_build_prerequisites?redirectlocale=en-US&redirectslug=Firefox_OS%2FFirefox_OS_build_prerequisites
 
=== Triage Process ===
* https://wiki.mozilla.org/B2G/Triage
* https://etherpad.mozilla.org/leo-triage-criteria
* https://etherpad.mozilla.org/b2g-triage-exceptions
 
=== Checklist for Final Signoffs ===
* https://etherpad.mozilla.org/b2g-release-checklist
 
=== Devices ===
* Flame device -> https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame
 
=== Builds ===
* B2G Gecko and Gaia: http://ftp.mozilla.org/pub/mozilla.org/b2g/nightly/
* Geeksphone Keon and Peak: http://downloads.geeksphone.com/
 
== Automation Development ==
 
=== Overview ===
 
This group primarily focuses on automation development across Gaia & Gecko.
 
* [[/Automation|FxOS QA Automation]]
 
=== References ===
 
* [[/WebAPI Test Plan|WebAPI Test Plan]]
* [https://github.com/zacc/gaia-ui-tests Gaia UI Automation Github]
 
== Performance Acceptance Testing ==
 
=== Overview ===
 
Runs periodic performance acceptance tests at a larger scale than nightly Datazilla results
 
=== Results ===


* 2.1
== [[B2G/QA/Device|Device (link)]] ==
** [[/2014-11-21 Performance Acceptance|2014-11-21]]
** [[/2014-11-14 Performance Acceptance|2014-11-14]]
** [[/2014-11-07 Performance Acceptance|2014-11-07]]
** [[/2014-10-31 Performance Acceptance|2014-10-31]]
** [[/2014-10-20 Performance Acceptance|2014-10-20]]
** [[/2014-10-02 Performance Acceptance|2014-10-02]]


== Device QA outsource ==
== [[B2G/QA/Manual_Test|Manual Tests (link)]] ==
=== Overview ===
Marigold is in charge of executing FxOS testing, and they covers following tasks requested by Mozilla.
(Marigold is located in Chengdu, China)


* Manual Test
== [[B2G/QA/Test_Automation|Test Automation (link)]] ==
** Daily smoke test
** Regression test
** Full test
** RAT test
** Bug work (qawanted,regressionwindow-wanted)
* Power consumption test
* Gaia-UI-test [Planning]
* Performance test [Planning]
* Patch verify [Planning]


=== Information ===
== Efforts to Maintain This Page ==
* [[/Marigold_member_list | Marigold engineer list]]
[https://bugzilla.mozilla.org/show_bug.cgi?id=1228102 A bug] has been created to track the update requests to this page and its subpages.  Please make a comment in the bug and needinfo npark.
Npark
352

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/1109939"