B2G/QA

Team Details

Overview

The B2G QA team is committed to qualifying the full spectrum of testing from backend (Gecko) to Frontend (Gaia). Test coverage will include a range of manual execution steps, automated test coverage, proper documentation, and community involvement projects.

Join us

If you want to help on the B2G project, it's very easy to start.

Subscribe to our B2G QA team mailing list and send us an e-mail presenting yourself and telling us what kind of tasks you would like to do.

Also you can find us on irc.mozilla.org on #appsqa

Meetings

Functional QA Roundtable

• Meeting Time: Wednesdays @ 5pm - 5:45pm PST
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org

Automation QA Roundtable

• Meeting Time: Thursday @ 9:30am - 10am PST
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Previous Meeting: https://wiki.mozilla.org/B2G/QA/Meetings/Automation/2014-09-25

Device QA Roundtable

• Friday 3pm - 4:00pm - Taiwan team Meeting, prev Taiwan team Meeting
• Meeting Notes - https://wiki.mozilla.org/B2G/QA/Meetings

Notes Archives

• https://wiki.mozilla.org/B2G/QA/Meetings

Team Members

Team Member	IRC Nick (#appsqa, #qa)	Location
Bhavana Bajaj	bajaj	Mountain View, CA
Naoki Hirata	nhirata	San Francisco, CA
Marcia Knous	marcia	Mountain View, CA
Geo Mealer	geo	Mountain View, CA
Martijn Wargers	mwargers	Amsterdam?, NL
John Dorlus	Silne30	Orlando, FL
Krupa Raj	kraj	San Francisco, CA
Delphine Lebedel	delphine	Mountain View, CA
Paul Yang	pyang	Taipei, Taiwan
Hubert Lu	hlu	Taipei, Taiwan
Eric Chang	echang	Taipei, Taiwan
Brian Huang	brhuang	Taipei, Taiwan
Al Tsai	atsai	Taipei, Taiwan
William Hsu	whsu	Taipei, Taiwan
Askeing Yen	askeing	Taipei, Taiwan
Walter Chen	ypwalter	Taipei, Taiwan
Shing Lyu	slyu	Taipei, Taiwan
Parul Mathur	pragmatic	Mountain View, CA
Peipei Cheng	pcheng	Beijing, China
Johan Lorenzo	jlorenzo	Paris, France
Hermes Cheng	hermescheng	Taipei, Taiwan

Projects

End to End QA

Overview

This group primarily focuses on doing end to end testing of end to end functionality through Gaia and Gecko, including the apps pre-installed on the device, phone features, etc.

References

B2G

• RoadMap: https://wiki.mozilla.org/B2G/Roadmap
  • 2.2 : https://wiki.mozilla.org/B2G/QA/2.2
  • 2.1 : https://wiki.mozilla.org/B2G/QA/2.1

Test Plans

• New Device Test Plan
• 1.0.1 Email Test Plan
• 1.0.1 Browser Test Plan
• 1.0.1 Crash Reporting Test Plan
• Graphics Test Plan

Misc References

• Bugzilla Usage/Bug creation
• Relevant B2G Bug Queries
• Confirming Unconfirmed Firefox OS bugs
• B2G Testing Tips & Tricks!
• Test Plan Review
• Email Templates
• B2G QA Process Backlog Tracker
• Daily Triage Schedule
• QA Triage
• Useful git commands

Firefox OS UX SPEC

• v2.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/2243702431
• v2.1: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1759289051
• v2.0: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1732424767
• v1.4: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1226137087
• v1.3: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1147153091
• v1.2: https://mozilla.app.box.com/s/44utizl9oz4eupyu3fuu/1/1030015572

Smoke Test

• Smoketest Breakdown : https://mozqa.etherpad.mozilla.org/Smoketest-Daily-Workflow

Test Run

• Testrun communication how-to (with templates) : https://etherpad.mozilla.org/moztrap-testrun-howto

Moztrap

• How to import testcases to Moztrap : https://etherpad.mozilla.org/howto-import-testcases-moztrap

Automation Tests

• https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Platform/Automated_testing?redirectlocale=en-US&redirectslug=Mozilla%2FFirefox_OS%2FPlatform%2FTesting

How to build

• How to build : https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Firefox_OS_build_prerequisites?redirectlocale=en-US&redirectslug=Firefox_OS%2FFirefox_OS_build_prerequisites

Triage Process

• https://wiki.mozilla.org/B2G/Triage
• https://etherpad.mozilla.org/leo-triage-criteria
• https://etherpad.mozilla.org/b2g-triage-exceptions

Checklist for Final Signoffs

• https://etherpad.mozilla.org/b2g-release-checklist

Devices

• Flame device -> https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame

Builds

• B2G Gecko and Gaia: http://ftp.mozilla.org/pub/mozilla.org/b2g/nightly/
• Geeksphone Keon and Peak: http://downloads.geeksphone.com/

Automation Development

Overview

This group primarily focuses on automation development across Gaia & Gecko.

References

• WebAPI Test Plan
• Gaia UI Automation

Performance Acceptance Testing

Overview

Runs periodic performance acceptance tests at a larger scale than nightly Datazilla results

Results

• 2.1
  • 2014-10-31
  • 2014-10-02

Device QA outsource

Overview

Marigold is in charge of executing FxOS testing, and they covers following tasks requested by Mozilla. (Marigold is located in Chengdu, China)

• Manual Test
  • Daily smoke test
  • Regression test
  • Full test
  • RAT test
  • Bug work (qawanted,regressionwindow-wanted)
• Power consumption test
• Gaia-UI-test [Planning]
• Performance test [Planning]
• Patch verify [Planning]

Information

• Marigold engineer list