TestEngineering/Performance/Glossary

Backfill

Trigger skipped jobs (Treeherder terminology). Also refers to filling in missing data points from Perfherder's Graphs view.

Data point

Performance metric value visible in Perfherder's Graph view.

DOM Content Flushed (dcf)

Definition needed

Downstream

Definition needed

First Contentful Paint (fcp)

Definition needed

First Non-Blank Paint (fnbpaint)

Definition needed

Gecko profile

Definition needed

mitmproxy

Mitmproxy is a third-party open-source tool (found here in github) that allows the recording of a live web page and saving it as a playback archive. Using Mitmproxy's 'mitmdump' tool, the recorded page can be played back through a local proxy browser proxy; then browsing to the URL loads the page from the mitmproxy recording instead of the live site.

The Raptor performance testing framework uses Mitmproxy for Raptor page-load performance tests. Mitmproxy is available as a python mozbase/mozproxy module for import in any python project.

Noise (regarding performance tests)

Definition needed

Nudge

Definition needed

Perf Sheriff

Definition needed

Perfherder

Definition needed

Raptor

Raptor is a performance testing framework used for running browser page-load and browser benchmark tests. Raptor can run performance tests on Firefox desktop, Firefox android (Fennec, Geckoview example app, and the android components Reference Browser), and Google Chrome/Chromium. For more information please refer to the Raptor wiki page.

RelMan glossary

These terms are of use, especially when doing Performance sheriffing.

Retrigger

Definition needed

SETA

Definition needed

Talos

Definition needed

Treeherder

Definition needed

Time To First Interactive (ttfi)

Definition needed

R/b

Short name for retrigger/backfill.

WebPageTest

Definition needed