View source for TestEngineering


= Overview =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

= Mission =
Our mission is to provide testing and tools to positively impact the quality of Mozilla sites, apps, and services.

= The Team =
* Manager: Stuart Philp
* Technical Lead: Krupa Raj
* Technical Lead: [https://mozillians.org/u/davehunt/ Dave Hunt]
* Technical Lead: Richard Pappalardo
* Staff Engineer: Tarek Ziade
* Senior Test Engineer: [[User:Kthiessen|Karl Thiessen]]
* Senior Test Engineer: Peter deHaan
* Staff Test Engineer: Chris Hartjes
* Senior Test Engineer: [https://mozillians.org/en-US/u/stephend/ Stephen Donner]
* Senior Test Engineer: Kevin Brosnan
* Senior Test Engineer: Aaron Train
* Senior Test Engineer: Matt Brandt
* Senior Test Engineer: Rebecca Billings
* Senior Test Engineer: John Dorlus
* Senior Test Engineer: No-Jun Park
* Junior Test Engineer: Benny Forehand Jr.

=Technical Groups=
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI
* Lead: Dave Hunt

==Services==
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj

=Full Project List=
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! IRC Channel !! Technical Group !! Test Suite !! Unit !! Functional/UI !! Load !! Performance !! Accessibility !! Security !! Localization !! Swagger (route def)
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization 
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization 
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/37]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Socorro || Matt || Richard || #socorro || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/e2e-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Telemetry || John || Softvision || #telemetry || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| addons.mozilla.org || Krupa || Softvision || #amo || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/Addon-Tests] [https://github.com/mozilla/addons-server/tree/master/tests/ui] [https://github.com/mozilla/addons-frontend/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Blok (Test Pilot) || Rebecca || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| developer.mozilla.org || Matt || Dave || #mdndev || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests/ui] [https://github.com/mozilla/kuma/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| mozilla.org || Rebecca || Dave || #bedrock || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/bedrock/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| FoxPuppet || Benny || Dave/John || #fx-test || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Android) || Kevin || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Prox (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Focus (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/321]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-mobile/focus/tree/master/XCUITest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| ABSearch || Karl || Chris || #absearch || Services
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://mana.mozilla.org/wiki/display/SVCOPS/ABSearch Private repos]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla/antenna Antenna] || Matt || Richard || #breakpad || Services
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [http://autopush.readthedocs.io Autopush] || Richard || Rebecca || #push || Services
| style="background:lightgreen;text-align:center;" |  [https://testrail.stage.mozaws.net/index.php?/projects/overview/31]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/autopush]
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/ap-loadtester] 
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| Balrog || Chris || Karl || #balrog || Services
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | [https://github.com/mozilla/balrog]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a 
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a 
| style="background:lightyellow;text-align:center;" | TBD
|-
| Bouncer || Matt || Dave || #stubby || Services
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/tree/master/tests/e2e]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-content-server#testing] [https://github.com/mozilla/fxapom]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-auth-server/tree/master/test/load]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://kinto.readthedocs.io Kinto] || Chris || Karl || #storage || Services
| style="background:lightgray;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/23]
| style="background:lightgray;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightgrey;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/loads Loads Tool] || Richard || Chris || #fx-test || Services
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightgray;text-align:center;" | n/a
|-
| Shavar (Tracking Protection) || Rebecca || Richard || #shavar || Services
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" |[https://github.com/mozilla-services/shavar/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/rpappalax/shavar-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| SHIELD || Chris || Karl || #normandy || Services
| style="background:lightgray;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/153]
| style="background:lightgray;text-align:center;" | [https://github.com/mozilla/normandy]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Firefox/Stub_Attribution Stub Attribution] || Stephen || Matt || #stubby || Services
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/stub_attribution] [https://github.com/mozilla/bedrock/tree/master/bedrock/firefox/tests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Services/Sync Sync] || Karl || Chris || #sync || Services
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/36]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://developer.mozilla.org/en-US/docs/Mozilla/Projects/TPS]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/server-syncstorage/tree/master/loadtest] [https://github.com/mozilla-services/tokenserver/tree/master/loadtest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightyellow;text-align:center;" | TBD
|}