TestEngineering: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 44: Line 44:


The source of truth for FTE Projects is our [https://servicebook.stage.mozaws.net Servicebook].  The table below may be out of date.
The source of truth for FTE Projects is our [https://servicebook.stage.mozaws.net Servicebook].  The table below may be out of date.
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! IRC Channel !! Technical Group !! Test Suite !! Unit !! Functional/UI !! Load !! Performance !! Accessibility !! Security !! Localization !! Swagger (route def)
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/37]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Socorro || Matt || Richard || #socorro || Customization
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/34]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/socorro/unittest]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/e2e-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Telemetry || John || Softvision || #telemetry || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| addons.mozilla.org || Krupa || Softvision || #amo || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/Addon-Tests] [https://github.com/mozilla/addons-server/tree/master/tests/ui] [https://github.com/mozilla/addons-frontend/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Blok (Test Pilot) || Rebecca || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/blok/tree/master/tests]
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests ]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests/jenkins]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| developer.mozilla.org || Matt || Dave || #mdndev || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/24]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| mozilla.org || Rebecca || Dave || #bedrock || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/bedrock/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| FoxPuppet || Benny || Dave/John || #fx-test || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Android) || Kevin || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Prox (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Focus (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/321]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-mobile/focus/tree/master/XCUITest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| ABSearch || Karl || Chris || #absearch || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://mana.mozilla.org/wiki/display/SVCOPS/ABSearch Private repos]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla/antenna Antenna] || Matt || Richard || #breakpad || Services
| style="background:lightgreen;text-align:center;"  | [https://testrail.stage.mozaws.net/index.php?/projects/overview/40]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/antenna/tree/master/tests/unittest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;"  | [https://github.com/rpappalax/antenna-loadtests/]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [http://autopush.readthedocs.io Autopush] || Richard || Matt || #push || Services
| style="background:lightgreen;text-align:center;" |  [https://testrail.stage.mozaws.net/index.php?/projects/overview/31]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/autopush]
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/ap-loadtester]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Balrog || Chris || Karl || #balrog || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/balrog]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Bouncer || Matt || Dave || #stubby || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/33]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/blob/master/handlers_test.go]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/tree/master/tests/e2e]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/35]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-content-server#testing] [https://github.com/mozilla/fxapom]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-auth-server/tree/master/test/load]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://kinto.readthedocs.io Kinto] || Chris || Karl || #storage || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/23]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/loads Loads Tool] || Richard || Chris || #fx-test || Services
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Shavar (Tracking Protection) || Rebecca || Richard || #shavar || Services
| style="background:lightgreen;text-align:center;"  |[https://testrail.stage.mozaws.net/index.php?/suites/view/354]
| style="background:lightgreen;text-align:center;" |[https://github.com/mozilla-services/shavar/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/rpappalax/shavar-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| SHIELD || Chris || Karl || #normandy || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/153]
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/normandy]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Firefox/Stub_Attribution Stub Attribution] || Stephen || Matt || #stubby || Services
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/406]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/stub_attribution] [https://github.com/mozilla/bedrock/tree/master/bedrock/firefox/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Services/Sync Sync] || Karl || Chris || #sync || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/36]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://developer.mozilla.org/en-US/docs/Mozilla/Projects/TPS]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/server-syncstorage/tree/master/loadtest] [https://github.com/mozilla-services/tokenserver/tree/master/loadtest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla-lockbox Lockbox] || Matt B ||  || #lockbox (Slack) || Services
| style="background:lightgray;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | N/A
| style="background:lightgray;text-align:center;" | TBD
|}

Revision as of 20:19, 17 May 2018

Overview

Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/

Mission

Our mission is to provide testing and tools to positively impact the quality of Mozilla sites, apps, and services.

The Team

  • Manager: Stuart Philp
  • Technical Lead and Manager, Customization group: Krupa Raj
  • Technical Lead, UI group: Dave Hunt
  • Technical Lead, Services group: Richard Pappalardo
  • Staff Engineer: Tarek Ziade
  • Manager, Services group: Karl Thiessen
  • Senior Test Engineer: Peter deHaan
  • Staff Test Engineer: Chris Hartjes
  • Senior Test Engineer: Stephen Donner
  • Senior Test Engineer: Kevin Brosnan
  • Senior Test Engineer: Aaron Train
  • Senior Test Engineer: Matt Brandt
  • Senior Test Engineer: Rebecca Billings
  • Senior Test Engineer: No-Jun Park
  • Junior Test Engineer: Benny Forehand Jr.

Technical Groups

Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.

User Interfaces

Services

Customization

Full Project List

The source of truth for FTE Projects is our Servicebook. The table below may be out of date.