B2G/QA: Difference between revisions
| Line 60: | Line 60: | ||
| style="background:#EFEFEF; width:30%" | '''Team Member''' | | style="background:#EFEFEF; width:30%" | '''Team Member''' | ||
| style="background:#EFEFEF; width:30%" | '''IRC Nick (#fxosqa, #appsqa, #qa)''' | | style="background:#EFEFEF; width:30%" | '''IRC Nick (#fxosqa, #appsqa, #qa)''' | ||
| style="background:#EFEFEF; width: | | style="background:#EFEFEF; width:20%" | '''Location''' | ||
|- | |- | ||
| [mailto:nhirata@mozilla.com Naoki Hirata] | | [mailto:nhirata@mozilla.com Naoki Hirata] | ||
Revision as of 18:46, 25 June 2015
Team Details
Overview
The B2G QA team is committed to qualifying the full spectrum of testing from backend (Gecko) to Frontend (Gaia). Test coverage will include a range of manual execution steps, automated test coverage, proper documentation, and community involvement projects.
Join us
Firefox OS is Mozilla's mobile phone operating system for the open Web, built entirely using HTML5 & standard Web APIs. Community is key to the success of the open Web.
If you want to help Firefox OS Quality Assurance activities, it's very easy to start.
New Contributors
If you are new to Mozilla Quality Assurance, you will need a Bugzilla account.
If you do not have a device running Firefox OS, you can get started with the Firefox OS Simulator inside the desktop Firefox browser.
Contributors with a Firefox OS Device
- If you have a device running Firefox OS, you will need to update it to the latest nightly build.
- For Mozilla's Flame reference device, follow these essential steps to set up your computer to work with your Flame.
- Flash the Flame device with a base image.
- Flash the Flame device with the latest nightly build.
- If your smartphone is from Geeksphone, please get the latest build from here: http://downloads.geeksphone.com/
- If your phone gets soft-bricked, bring it into fastboot mode and flash the base build again.
Simple Tasks
Get introduced to Firefox OS with simple testing tasks in One and Done that take as little as 15 minutes.
Communication Channels
A great place to get started is to join one of these communication channels where other people involved with Firefox OS Quality Assurance are available to help. Feel free to join one of the following and introduce yourself.
Meetings
Functional QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm PST
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
- Dial in: 1-800-707-25331
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org
Automation QA Roundtable
- Details and minutes can be found here.
Device QA Roundtable
- Friday 3pm - 4:00pm - Taiwan team Meeting, prev Taiwan team Meeting
- Meeting Notes - https://wiki.mozilla.org/B2G/QA/Meetings
Notes Archives
Team Members
| Team Member | IRC Nick (#fxosqa, #appsqa, #qa) | Location | |
| Naoki Hirata | nhirata | San Francisco, CA | |
| Marcia Knous | marcia | Mountain View, CA | |
| Geo Mealer | geo | Mountain View, CA | |
| Martijn Wargers | mwargers | Wageningen, NL | |
| John Dorlus | Silne30 | Orlando, FL | |
| Krupa Raj | kraj | San Francisco, CA | |
| Delphine Lebedel | delphine | Mountain View, CA | |
| Paul Yang | pyang | Taipei, Taiwan | |
| Al Tsai | atsai | Taipei, Taiwan | |
| William Hsu | whsu | Taipei, Taiwan | |
| Askeing Yen | askeing | Taipei, Taiwan | |
| Walter Chen | ypwalter, wachen | Taipei, Taiwan | |
| Shing Lyu | slyu | Taipei, Taiwan | |
| Parul Mathur | pragmatic | Mountain View, CA | |
| Johan Lorenzo | jlorenzo | Paris, France | |
| Hermes Cheng | hermescheng | Taipei, Taiwan | |
| Alison Shiue | ashiue | Taipei, Taiwan | |
| Mike Lien | mlien | Taipei, Taiwan |
Projects
End to End QA
Overview
This group primarily focuses on doing end to end testing of end to end functionality through Gaia and Gecko, including the apps pre-installed on the device, phone features, etc.
References
B2G
- RoadMap: https://wiki.mozilla.org/B2G/Roadmap
Test Plans
- New Device Test Plan
- 1.0.1 Email Test Plan
- 1.0.1 Browser Test Plan
- 1.0.1 Crash Reporting Test Plan
- Graphics Test Plan
Misc References
- Bugzilla Usage/Bug creation
- Relevant B2G Bug Queries
- Confirming Unconfirmed Firefox OS bugs
- B2G Testing Tips & Tricks!
- Test Plan Review
- Email Templates
- B2G QA Process Backlog Tracker
- Daily Triage Schedule
- QA Triage
- Useful git commands
- Firefox OS QA New Hire Document
Firefox OS UX SPEC
- Ignite https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/2957379877
- v2.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/2243702431
- v2.1: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1759289051
- v2.0: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1732424767
- v1.4: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1226137087
- v1.3: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1147153091
- v1.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1030015572
Smoke Test
- Smoketest Breakdown : https://mozqa.etherpad.mozilla.org/Smoketest-Daily-Workflow
Test Run
- Testrun communication how-to (with templates) : https://etherpad.mozilla.org/moztrap-testrun-howto
Moztrap
- How to import testcases to Moztrap : https://etherpad.mozilla.org/howto-import-testcases-moztrap
Automation Tests
How to build
Triage Process
- https://wiki.mozilla.org/B2G/Triage
- https://etherpad.mozilla.org/leo-triage-criteria
- https://etherpad.mozilla.org/b2g-triage-exceptions
Checklist for Final Signoffs
Devices
Builds
- B2G Gecko and Gaia: http://ftp.mozilla.org/pub/mozilla.org/b2g/nightly/
- Geeksphone Keon and Peak: http://downloads.geeksphone.com/
Automation Development
Overview
This group primarily focuses on automation development across Gaia & Gecko.
References
Performance Acceptance Testing
Overview
Runs periodic performance acceptance tests at a larger scale than nightly Datazilla results
Results
Device QA outsource
Overview
Marigold is in charge of executing FxOS testing, and they covers following tasks requested by Mozilla. (Marigold is located in Chengdu, China)
- Manual Test
- Daily smoke test
- Regression test
- Full test
- RAT test
- Bug work (qawanted,regressionwindow-wanted)
- Power consumption test
- Gaia-UI-test [Planning]
- Performance test [Planning]
- Patch verify [Planning]