TestEngineering: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(new team structure)
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:


= Overview =
= Mission Statement =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).
The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.


More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/
More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/


= Mission =
= Focus Areas =
Our mission is to provide testing and tools to positively impact the quality of Mozilla sites, apps, and services.


= The Team =
* Interop
* Manager: Stuart Philp
* Performance
* Technical Lead and Manager, Customization group: Krupa Raj
* GeckoView
* Technical Lead, UI group: [https://mozillians.org/u/davehunt/ Dave Hunt]
* Fenix
* Technical Lead, Services group: Richard Pappalardo
* Amazon
* Staff Engineer: Tarek Ziade
* CI Automation
* Manager, Services group: [https://mozillians.org/u/kthiessen Karl Thiessen]
* Ecosystem
* Senior Test Engineer: Peter deHaan
* Telemetry
* Staff Test Engineer: Chris Hartjes
* Premium Services
* Senior Test Engineer: [https://mozillians.org/en-US/u/stephend/ Stephen Donner]
* Energy
* Senior Test Engineer: Kevin Brosnan
* Accessibility
* Senior Test Engineer: Aaron Train
* Reporting
* Senior Test Engineer: Matt Brandt
* Monitoring
* Senior Test Engineer: Rebecca Billings
* Experiments
* Senior Test Engineer: No-Jun Park
* Junior Test Engineer: Benny Forehand Jr.


=Technical Groups=
= Enduring Objectives =
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.
* Increase visibility into product risks
** Streamline reporting
** Reduce blind spots
* Improve efficiency and clarity of risk assessments
** Tight feedback loops
** Be opinionated (i.e binary or traffic light recommendations)
** Reduce guesswork, roundtrips
** Standardize between projects and types of reports
* Maintain or improve coverage and quality standards
** Identify and fill gaps
** Document and measure existing work
** Establish/Improve release criteria consistency
** Reduce effort on maintenance
* Reduce cross-functional friction
** Advocacy
** Reporting
** Tools
** Benchmarks
** Relationship building


==User Interfaces==
=People=
* https://wiki.mozilla.org/TestEngineering/UI
* Lead: Dave Hunt


==Services==
Director: Stuart Philp
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo
* Manager: Karl Thiessen


==Customization==
Architect: Tarek Ziade
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj


=Full Project List=
==Interop==
Manager: David Burns


The source of truth for FTE Projects is our [https://servicebook.stage.mozaws.net Servicebook].  The table below may be out of date.
==Performance==
Manager: Dave Hunt


{| class="wikitable sortable"
==Ecosystem==
|-
Manager: Krupa Raj
! Project !! Primary !! Secondary !! IRC Channel !! Technical Group !! Test Suite !! Unit !! Functional/UI !! Load !! Performance !! Accessibility !! Security !! Localization !! Swagger (route def)
 
|-
==CI Automation==
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
Manager: Joel Maher
| style="background:lightgray;text-align:center;" | n/a
 
| style="background:lightgray;text-align:center;" | n/a
==Mobile==
| style="background:pink;text-align:center;" | none
Manager: No-Jun Park
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/37]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Socorro || Matt || Richard || #socorro || Customization
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/34]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/socorro/unittest]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/e2e-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Telemetry || John || Softvision || #telemetry || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| addons.mozilla.org || Krupa || Softvision || #amo || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/Addon-Tests] [https://github.com/mozilla/addons-server/tree/master/tests/ui] [https://github.com/mozilla/addons-frontend/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Blok (Test Pilot) || Rebecca || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/blok/tree/master/tests]
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests ]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests/jenkins]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| developer.mozilla.org || Matt || Dave || #mdndev || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/24]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| mozilla.org || Rebecca || Dave || #bedrock || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/bedrock/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| FoxPuppet || Benny || Dave/John || #fx-test || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Android) || Kevin || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Prox (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Focus (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/321]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-mobile/focus/tree/master/XCUITest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| ABSearch || Karl || Chris || #absearch || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://mana.mozilla.org/wiki/display/SVCOPS/ABSearch Private repos]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla/antenna Antenna] || Matt || Richard || #breakpad || Services
| style="background:lightgreen;text-align:center;"  | [https://testrail.stage.mozaws.net/index.php?/projects/overview/40]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/antenna/tree/master/tests/unittest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;"  | [https://github.com/rpappalax/antenna-loadtests/]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [http://autopush.readthedocs.io Autopush] || Richard || Matt || #push || Services
| style="background:lightgreen;text-align:center;" |  [https://testrail.stage.mozaws.net/index.php?/projects/overview/31]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/autopush]
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/ap-loadtester]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Balrog || Chris || Karl || #balrog || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/balrog]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Bouncer || Matt || Dave || #stubby || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/33]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/blob/master/handlers_test.go]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/tree/master/tests/e2e]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/35]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-content-server#testing] [https://github.com/mozilla/fxapom]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-auth-server/tree/master/test/load]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://kinto.readthedocs.io Kinto] || Chris || Karl || #storage || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/23]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/loads Loads Tool] || Richard || Chris || #fx-test || Services
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Shavar (Tracking Protection) || Rebecca || Richard || #shavar || Services
| style="background:lightgreen;text-align:center;"  |[https://testrail.stage.mozaws.net/index.php?/suites/view/354]
| style="background:lightgreen;text-align:center;" |[https://github.com/mozilla-services/shavar/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/rpappalax/shavar-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| SHIELD || Chris || Karl || #normandy || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/153]
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/normandy]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Firefox/Stub_Attribution Stub Attribution] || Stephen || Matt || #stubby || Services
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/406]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/stub_attribution] [https://github.com/mozilla/bedrock/tree/master/bedrock/firefox/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Services/Sync Sync] || Karl || Chris || #sync || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/36]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://developer.mozilla.org/en-US/docs/Mozilla/Projects/TPS]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/server-syncstorage/tree/master/loadtest] [https://github.com/mozilla-services/tokenserver/tree/master/loadtest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla-lockbox Lockbox] || Matt B ||  || #lockbox (Slack) || Services
| style="background:lightgray;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | N/A
| style="background:lightgray;text-align:center;" | TBD
|}

Latest revision as of 16:31, 22 January 2019

Mission Statement

The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.

More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/

Focus Areas

  • Interop
  • Performance
  • GeckoView
  • Fenix
  • Amazon
  • CI Automation
  • Ecosystem
  • Telemetry
  • Premium Services
  • Energy
  • Accessibility
  • Reporting
  • Monitoring
  • Experiments

Enduring Objectives

  • Increase visibility into product risks
    • Streamline reporting
    • Reduce blind spots
  • Improve efficiency and clarity of risk assessments
    • Tight feedback loops
    • Be opinionated (i.e binary or traffic light recommendations)
    • Reduce guesswork, roundtrips
    • Standardize between projects and types of reports
  • Maintain or improve coverage and quality standards
    • Identify and fill gaps
    • Document and measure existing work
    • Establish/Improve release criteria consistency
    • Reduce effort on maintenance
  • Reduce cross-functional friction
    • Advocacy
    • Reporting
    • Tools
    • Benchmarks
    • Relationship building

People

Director: Stuart Philp

Architect: Tarek Ziade

Interop

Manager: David Burns

Performance

Manager: Dave Hunt

Ecosystem

Manager: Krupa Raj

CI Automation

Manager: Joel Maher

Mobile

Manager: No-Jun Park

Retrieved from "https://wiki.allizom.org/index.php?title=TestEngineering&oldid=1206547"