TestEngineering/Performance/Talos/Tests: Difference between revisions

Jump to navigation Jump to search

TestEngineering/Performance/Talos/Tests (view source)

Revision as of 11:30, 16 March 2021

10,788 bytes added ,  16 March 2021
Added notifications of content migration to Firefox Source Docs
No edit summary
(Added notifications of content migration to Firefox Source Docs)
 
Line 1: Line 1:
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html|date=2021-03-16}}
= At a glance =
= At a glance =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#at-a-glance|date=2021-03-16|section=yes}}
* Tests are defined in [https://searchfox.org/mozilla-central/source/testing/talos/talos/test.py testing/talos/talos/test.py]
* Tests are defined in [https://searchfox.org/mozilla-central/source/testing/talos/talos/test.py testing/talos/talos/test.py]
* Treeherder abbreviations are defined in [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml taskcluster/ci/test/talos.yml]
* Treeherder abbreviations are defined in [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml taskcluster/ci/test/talos.yml]
Line 5: Line 9:


= Test lifecycle =
= Test lifecycle =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#test-lifecycle|date=2021-03-16|section=yes}}
* Taskcluster schedules [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml talos jobs]
* Taskcluster schedules [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml talos jobs]
* Taskcluster runs a Talos job on a hardware machine when one is available - this is bootstrapped by [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py mozharness]
* Taskcluster runs a Talos job on a hardware machine when one is available - this is bootstrapped by [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py mozharness]
Line 15: Line 21:


= Test types =
= Test types =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#test-types|date=2021-03-16|section=yes}}


There are two different species of Talos tests:
There are two different species of Talos tests:
Line 32: Line 39:


== Startup ==
== Startup ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#startup|date=2021-03-16|section=yes}}
[https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test Startup tests] launch Firefox and measure the time to the onload or paint events. We run this in a series of cycles (default to 20) to generate a full set of data.  Tests that currently are startup tests are:
[https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test Startup tests] launch Firefox and measure the time to the onload or paint events. We run this in a series of cycles (default to 20) to generate a full set of data.  Tests that currently are startup tests are:
* [[#ts_paint]]
* [[#ts_paint]]
Line 41: Line 50:


== Page load ==
== Page load ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#page-load|date=2021-03-16|section=yes}}
Many of the talos tests use the page loader to load a manifest of pages.
Many of the talos tests use the page loader to load a manifest of pages.
These are tests that load a specific page and measure the time it takes to load the page, scroll the page, draw the page etc.  In order to run a page load test, you need a manifest of pages to run.  The manifest is simply a list of URLs of pages to load, separated by carriage returns, e.g.:
These are tests that load a specific page and measure the time it takes to load the page, scroll the page, draw the page etc.  In order to run a page load test, you need a manifest of pages to run.  The manifest is simply a list of URLs of pages to load, separated by carriage returns, e.g.:
Line 64: Line 75:


== Heavy ==
== Heavy ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#heavy|date=2021-03-16|section=yes}}
All our testing is done with empty blank profiles, this is not ideal for finding issues for end users.  We recently undertook a task to create a daily update to a profile so it is modern and relevant.  It browses a variety of web pages, and have history and cache to give us a more realistic scenario.
All our testing is done with empty blank profiles, this is not ideal for finding issues for end users.  We recently undertook a task to create a daily update to a profile so it is modern and relevant.  It browses a variety of web pages, and have history and cache to give us a more realistic scenario.


Line 71: Line 84:


== Web extension ==
== Web extension ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#web-extension|date=2021-03-16|section=yes}}
Web Extensions are what Firefox has switched to and there are different code paths and APIs used vs addons.  Historically we don't test with addons (other than our test addons) and are missing out on common slowdowns.  In 2017 we started running some startup and basic pageload tests with a web extension in the profile ({{bug|1398974}}).  We have updated the Extension to be more real world and will continue to do that.
Web Extensions are what Firefox has switched to and there are different code paths and APIs used vs addons.  Historically we don't test with addons (other than our test addons) and are missing out on common slowdowns.  In 2017 we started running some startup and basic pageload tests with a web extension in the profile ({{bug|1398974}}).  We have updated the Extension to be more real world and will continue to do that.


== Real-world WebExtensions ==
== Real-world WebExtensions ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#real-world-webextensions|date=2021-03-16|section=yes}}
We've added a variation on our test suite that automatically downloads, installs and enables 5 popular WebExtensions. This is used to measure things like the impact of real-world WebExtensions on start-up time.
We've added a variation on our test suite that automatically downloads, installs and enables 5 popular WebExtensions. This is used to measure things like the impact of real-world WebExtensions on start-up time.


Line 87: Line 104:


== Paint ==
== Paint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#paint|date=2021-03-16|section=yes}}
Paint tests are measuring the time to receive both the [https://developer.mozilla.org/en-US/docs/Web/Events/MozAfterPaint MozAfterPaint] and OnLoad event instead of just the OnLoad event.  Most tests now look for this unless they are an ASAP test, or an internal benchmark
Paint tests are measuring the time to receive both the [https://developer.mozilla.org/en-US/docs/Web/Events/MozAfterPaint MozAfterPaint] and OnLoad event instead of just the OnLoad event.  Most tests now look for this unless they are an ASAP test, or an internal benchmark


== ASAP ==
== ASAP ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#asap|date=2021-03-16|section=yes}}
We have a variety of tests which we now run in ASAP mode where we render as fast as possible (disabling vsync and letting the rendering iterate as fast as it can using `requestAnimationFrame`).  In fact we have replaced some original tests with the 'x' versions to make them measure.  We do this with RequestAnimationFrame().
We have a variety of tests which we now run in ASAP mode where we render as fast as possible (disabling vsync and letting the rendering iterate as fast as it can using `requestAnimationFrame`).  In fact we have replaced some original tests with the 'x' versions to make them measure.  We do this with RequestAnimationFrame().


Line 105: Line 126:


== Benchmarks ==
== Benchmarks ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#benchmarks|date=2021-03-16|section=yes}}
Many tests have internal benchmarks which we report as accurately as possible.  These are the exceptions to the general rule of calculating the suite score as a geometric mean of the subtest values (which are median values of the raw data from the subtests).
Many tests have internal benchmarks which we report as accurately as possible.  These are the exceptions to the general rule of calculating the suite score as a geometric mean of the subtest values (which are median values of the raw data from the subtests).


Line 116: Line 139:


== Row major vs. column major ==
== Row major vs. column major ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#row-major-vs-column-major|date=2021-03-16|section=yes}}
To get more stable numbers, tests are run multiple times. There are two ways that we do this: row major and column major. Row major means each test is run multiple times and then we move to the next test (and run it multiple times). Column major means that each test is run once one after the other and then the whole sequence of tests is run again.
To get more stable numbers, tests are run multiple times. There are two ways that we do this: row major and column major. Row major means each test is run multiple times and then we move to the next test (and run it multiple times). Column major means that each test is run once one after the other and then the whole sequence of tests is run again.


Line 121: Line 146:


= Page sets =
= Page sets =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#page-sets|date=2021-03-16|section=yes}}
We run our tests 100% offline, but serve pages via a webserver.  Knowing this we need to store and make available the offline pages we use for testing.
We run our tests 100% offline, but serve pages via a webserver.  Knowing this we need to store and make available the offline pages we use for testing.


== tp5pages ==
== tp5pages ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5pages|date=2021-03-16|section=yes}}
Some tests make use of a set of 50 "real world" pages, known as the tp5n set. These pages are not part of the talos repository, but without them the tests which use them won't run.
Some tests make use of a set of 50 "real world" pages, known as the tp5n set. These pages are not part of the talos repository, but without them the tests which use them won't run.
* To add these pages to your local setup, download the latest tp5n zip from [https://mozilla-releng.net/tooltool/ tooltool], and extract it such that `'''tp5n'''` ends up as `testing/talos/talos/tests/'''tp5n'''`. You can also obtain it by running a talos test locally to get the zip into `testing/talos/talos/tests/`, i.e <tt>./mach talos-test --suite damp</tt>
* To add these pages to your local setup, download the latest tp5n zip from [https://mozilla-releng.net/tooltool/ tooltool], and extract it such that `'''tp5n'''` ends up as `testing/talos/talos/tests/'''tp5n'''`. You can also obtain it by running a talos test locally to get the zip into `testing/talos/talos/tests/`, i.e <tt>./mach talos-test --suite damp</tt>
Line 129: Line 158:


= Test definitions =
= Test definitions =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#test-definitions|date=2021-03-16|section=yes}}


'''Please keep these in alphabetical order'''
'''Please keep these in alphabetical order'''


== a11y ==
== a11y ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#a11yr|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 160: Line 191:


== about-newtab ==
== about-newtab ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#about-newtab-with-snipppets|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 167: Line 199:


== about-preferences ==
== about-preferences ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#about-preferences-basic|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 203: Line 236:


== ARES-6 ==
== ARES-6 ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#ares6|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 217: Line 251:


== Basic compositor video ==
== Basic compositor video ==
 
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#basic-compositor-video|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 265: Line 299:


== cpstartup ==
== cpstartup ==
 
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#cpstartup|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 289: Line 323:


== DAMP ==
== DAMP ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#damp|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 350: Line 385:


== displaylist_mutate ==
== displaylist_mutate ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#displaylist-mutate|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 365: Line 401:


== Dromaeo ==
== Dromaeo ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#dromaeo|date=2021-03-16|section=yes}}
Dromaeo suite of tests for JavaScript performance testing. See the [[Dromaeo|Dromaeo wiki]] for more information.
Dromaeo suite of tests for JavaScript performance testing. See the [[Dromaeo|Dromaeo wiki]] for more information.


Line 372: Line 410:


=== Dromaeo CSS ===
=== Dromaeo CSS ===
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#dromaeo-css|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 402: Line 441:


=== Dromaeo DOM (Linux64 only) ===
=== Dromaeo DOM (Linux64 only) ===
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#dromaeo-dom|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 430: Line 470:


== glterrain ==
== glterrain ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#glterrain|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 457: Line 498:


== glvideo ==
== glvideo ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#glvideo|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 484: Line 526:


== jetstream ==
== jetstream ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#jetstream|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 500: Line 543:


== kraken ==
== kraken ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#kraken|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 539: Line 583:


== motionmark_animometer ==
== motionmark_animometer ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#motionmark-animometer|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 553: Line 598:


== motionmark_html ==
== motionmark_html ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#motionmark-html-suite|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 561: Line 607:


== motionmark_webgl ==
== motionmark_webgl ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#motionmark-webgl|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 575: Line 622:


== pdfpaint ==
== pdfpaint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#pdfpaint|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 587: Line 635:


== perf-reftest ==
== perf-reftest ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#perf-reftest|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 629: Line 678:


== perf-reftest-singletons ==
== perf-reftest-singletons ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#perf-reftest-singletons|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 659: Line 709:


== rasterflood_gradient ==
== rasterflood_gradient ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#rasterflood-gradient|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 676: Line 727:


== rasterflood_svg ==
== rasterflood_svg ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#rasterflood-svg|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 693: Line 745:


== sessionrestore ==
== sessionrestore ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#sessionrestore|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 722: Line 775:


== sessionrestore_many_windows ==
== sessionrestore_many_windows ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#sessionrestore-many-windows|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 730: Line 784:


== sessionrestore_no_auto_restore ==
== sessionrestore_no_auto_restore ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#a11yr|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 738: Line 793:


== startup_about_home_paint ==
== startup_about_home_paint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#startup-about-home-paint|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 757: Line 813:
</pre>
</pre>
|}
|}


== startup_about_home_paint_cached ==
== startup_about_home_paint_cached ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#startup-about-home-paint-cached|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 768: Line 824:


== startup_about_home_paint_realworld_webextensions ==
== startup_about_home_paint_realworld_webextensions ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#startup-about-home-paint-realworld-webextensions|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 789: Line 846:


== stylebench ==
== stylebench ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#stylebench|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 801: Line 859:


== tabpaint ==
== tabpaint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tabpaint|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 831: Line 890:


== tabswitch ==
== tabswitch ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tabswitch|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 907: Line 967:


== tart ==
== tart ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tart|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 977: Line 1,038:


== tart_flex ==
== tart_flex ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tart-flex|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 985: Line 1,047:


== tp5 ==
== tp5 ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5|date=2021-03-16|section=yes}}
Note that the tp5 test no longer exists (only talos-tp5o) though many tests still make use of this pageset. Here, we provide an overview of the tp5 pageset and some information about how data using the tp5 pageset might be used in various suites.
Note that the tp5 test no longer exists (only talos-tp5o) though many tests still make use of this pageset. Here, we provide an overview of the tp5 pageset and some information about how data using the tp5 pageset might be used in various suites.


Line 1,099: Line 1,163:


== tp5o_scroll ==
== tp5o_scroll ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5o-scroll|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,181: Line 1,246:


== tp5o_webext ==
== tp5o_webext ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5o-webext|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,189: Line 1,255:


== tpaint ==
== tpaint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tpaint|date=2021-03-16|section=yes}}


{{warning|This test no longer exists}}
{{warning|This test no longer exists}}
Line 1,223: Line 1,290:


== tresize ==
== tresize ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tresize|date=2021-03-16|section=yes}}
* contact: :jimm
* contact: :jimm
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/tresize/addon/content/tresize-test.html tresize-test.html]
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/tresize/addon/content/tresize-test.html tresize-test.html]
Line 1,252: Line 1,321:


== ts_paint ==
== ts_paint ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#ts-paint|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,280: Line 1,350:


== ts_paint_flex ==
== ts_paint_flex ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#ts-paint-flex|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,288: Line 1,359:


== ts_paint_heavy ==
== ts_paint_heavy ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#ts-paint-heavy|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,298: Line 1,370:


== ts_paint_webext ==
== ts_paint_webext ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#ts-paint-webext|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,306: Line 1,379:


== tscrollx ==
== tscrollx ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tscrollx|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,340: Line 1,414:


== tsvg_static ==
== tsvg_static ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tsvg-static|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,366: Line 1,441:


== tsvgm ==
== tsvgm ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tsvgm|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,377: Line 1,453:


== tsvgr_opacity ==
== tsvgr_opacity ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tsvgr-opacity|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,406: Line 1,483:


== tsvgx ==
== tsvgx ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tsvgx|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,440: Line 1,518:


== twinopen ==
== twinopen ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#twinopen|date=2021-03-16|section=yes}}


'''Test Name'''
'''Test Name'''
Line 1,464: Line 1,543:


== xperf (tp5n) ==
== xperf (tp5n) ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#xperf|date=2021-03-16|section=yes}}
* contact: [mailto:fx-perf@mozilla.com fx-perf@mozilla.com]
* contact: [mailto:fx-perf@mozilla.com fx-perf@mozilla.com]
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xtalos xperf instrumentation]
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xtalos xperf instrumentation]
Line 1,501: Line 1,582:


= Build metrics =
= Build metrics =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#build-metrics|date=2021-03-16|section=yes}}
These are not part of the Talos code, but like Talos they are benchmarks that record data using the graphserver and are analyzed by the same scripts for regressions.
These are not part of the Talos code, but like Talos they are benchmarks that record data using the graphserver and are analyzed by the same scripts for regressions.


Line 1,510: Line 1,593:


= Platform microbenchmark =
= Platform microbenchmark =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#platform-microbenchmark|date=2021-03-16|section=yes}}


== IsASCII and IsUTF8 gtest microbenchmarks ==
== IsASCII and IsUTF8 gtest microbenchmarks ==
Line 1,529: Line 1,613:


== Microbench ==
== Microbench ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#microbench|date=2021-03-16|section=yes}}
* contact: :bholley
* contact: :bholley
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/gtest/mozilla/MozGTestBench.cpp MozGTestBench.cpp]
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/gtest/mozilla/MozGTestBench.cpp MozGTestBench.cpp]
Line 1,536: Line 1,622:


== PerfStrip Tests ==
== PerfStrip Tests ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#perfstrip-tests|date=2021-03-16|section=yes}}
* contact: :davidb
* contact: :davidb
* source: https://dxr.mozilla.org/mozilla-central/source/xpcom/tests/gtest/TestStrings.cpp
* source: https://dxr.mozilla.org/mozilla-central/source/xpcom/tests/gtest/TestStrings.cpp
Line 1,552: Line 1,640:


== Stylo gtest microbenchmarks ==
== Stylo gtest microbenchmarks ==
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#stylo-gtest-microbenchmarks|date=2021-03-16|section=yes}}
* contact: :bholley, :SimonSapin
* contact: :bholley, :SimonSapin
* source: [https://dxr.mozilla.org/mozilla-central/source/layout/style/test/gtest]
* source: [https://dxr.mozilla.org/mozilla-central/source/layout/style/test/gtest]
Line 1,568: Line 1,658:


= History of tp tests =
= History of tp tests =
{{delete|Content has been migrated to https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#history-of-tp-tests|date=2021-03-16|section=yes}}


== tp ==
== tp ==
Davehunt
Confirmed users
2,177

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/1234438"

Navigation menu