Confirmed users
2,177
edits
TestEngineering/Performance/Talos/Tests: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Talos/Tests (view source)
Revision as of 12:48, 10 March 2021
, 10 March 2021no edit summary
No edit summary |
|||
| Line 356: | Line 356: | ||
* contact: :mattwoodrow | * contact: :mattwoodrow | ||
* source: | * source: [https://searchfox.org/mozilla-central/source/testing/talos/talos/tests/layout/benchmarks/displaylist_mutate.html displaylist_mutate.html] | ||
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | * type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | ||
* data: we load the displaylist_mutate.html page five times, measuring pageload each time, generating 5 data points. | * data: we load the displaylist_mutate.html page five times, measuring pageload each time, generating 5 data points. | ||
| Line 490: | Line 490: | ||
* contact: :jandem | * contact: :jandem | ||
* source: | * source: [https://searchfox.org/mozilla-central/source/testing/talos/talos/tests/jetstream/jetstream.manifest jetstream.manifest] and jetstream.zip from tooltool | ||
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | * type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | ||
* measuring: JavaScript performance | * measuring: JavaScript performance | ||
| Line 506: | Line 506: | ||
* contact: :sdetar | * contact: :sdetar | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/kraken kraken.manifest] | ||
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | * type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | ||
* measuring: JavaScript performance | * measuring: JavaScript performance | ||
| Line 545: | Line 545: | ||
* contact: :davidb | * contact: :davidb | ||
* source: | * source: [https://searchfox.org/mozilla-central/source/third_party/webkit/PerformanceTests/MotionMark source] [https://searchfox.org/mozilla-central/source/testing/talos/talos/tests/motionmark manifests] | ||
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | * type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | ||
* measuring: benchmark measuring the time to animate complex scenes | * measuring: benchmark measuring the time to animate complex scenes | ||
| Line 567: | Line 567: | ||
* contact: :jgilbert | * contact: :jgilbert | ||
* source: | * source: [https://searchfox.org/mozilla-central/source/third_party/webkit/PerformanceTests/MotionMark source] [https://searchfox.org/mozilla-central/source/testing/talos/talos/tests/motionmark/webgl.manifest manifest] | ||
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | * type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]] | ||
* measuring: Draw call performance in WebGL | * measuring: Draw call performance in WebGL | ||
| Line 744: | Line 744: | ||
* contact: :mconley | * contact: :mconley | ||
* source: | * source: [https://hg.mozilla.org/mozilla-central/file/tip/testing/talos/talos/startup_test/startup_about_home_paint/addon/] | ||
* type: Startup | * type: Startup | ||
* measuring: The time from process start to the point where the about:home page reports that it has painted the Top Sites. | * measuring: The time from process start to the point where the about:home page reports that it has painted the Top Sites. | ||
| Line 774: | Line 774: | ||
* contact: :mconley | * contact: :mconley | ||
* source: | * source: [https://hg.mozilla.org/mozilla-central/file/tip/testing/talos/talos/startup_test/startup_about_home_paint/addon/] | ||
* type: Startup, Real-world WebExtensions | * type: Startup, Real-world WebExtensions | ||
* measuring: The time from process start to the point where the about:home page reports that it has painted the Top Sites when 5 popular, real-world WebExtensions are installed and enabled. | * measuring: The time from process start to the point where the about:home page reports that it has painted the Top Sites when 5 popular, real-world WebExtensions are installed and enabled. | ||
| Line 1,193: | Line 1,193: | ||
* contact: :davidb | * contact: :davidb | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/tpaint.html tpaint-window.html] | ||
* type: Startup | * type: Startup | ||
* data: we load the tpaint test window 20 times, resulting in 1 set of 20 data points. | * data: we load the tpaint test window 20 times, resulting in 1 set of 20 data points. | ||
| Line 1,224: | Line 1,224: | ||
== tresize == | == tresize == | ||
* contact: :jimm | * contact: :jimm | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/tresize/addon/content/tresize-test.html tresize-test.html] | ||
* type: StartupTest | * type: StartupTest | ||
* measuring: Time to do XUL resize, in ms (lower is better). | * measuring: Time to do XUL resize, in ms (lower is better). | ||
| Line 1,312: | Line 1,312: | ||
* contact: :jrmuizel | * contact: :jrmuizel | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/scroll scroll.manifest] | ||
* type: PageLoader | * type: PageLoader | ||
* measuring: Scroll performance | * measuring: Scroll performance | ||
| Line 1,446: | Line 1,446: | ||
* contact: :bdahl, :jimm | * contact: :bdahl, :jimm | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/twinopen twinopen] | ||
* type: Startup | * type: Startup | ||
* data: we open a new browser window 20 times, resulting in 1 set of 20 data points. | * data: we open a new browser window 20 times, resulting in 1 set of 20 data points. | ||
| Line 1,480: | Line 1,480: | ||
</pre> | </pre> | ||
Talos will turn orange for 'x' jobs on windows 7 if your changeset accesses files which are not predefined in the | Talos will turn orange for 'x' jobs on windows 7 if your changeset accesses files which are not predefined in the [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xtalos/xperf_whitelist.json whitelist] during startup; specifically, before the "[https://hg.mozilla.org/mozilla-central/file/0eebc33d8593/toolkit/components/startup/nsAppStartup.cpp#l631 sessionstore-windows-restored]" Firefox event. If your job turns orange, you will see a list of files in Treeherder (or in the log file) which have been accessed unexpectedly (similar to this): | ||
* TEST-UNEXPECTED-FAIL : xperf: File '{profile}\secmod.db' was accessed and we were not expecting it. DiskReadCount: 6, DiskWriteCount: 0, DiskReadBytes: 16904, DiskWriteBytes: 0 | * TEST-UNEXPECTED-FAIL : xperf: File '{profile}\secmod.db' was accessed and we were not expecting it. DiskReadCount: 6, DiskWriteCount: 0, DiskReadBytes: 16904, DiskWriteBytes: 0 | ||
* TEST-UNEXPECTED-FAIL : xperf: File '{profile}\cert8.db' was accessed and we were not expecting it. DiskReadCount: 4, DiskWriteCount: 0, DiskReadBytes: 33288, DiskWriteBytes: 0 | * TEST-UNEXPECTED-FAIL : xperf: File '{profile}\cert8.db' was accessed and we were not expecting it. DiskReadCount: 4, DiskWriteCount: 0, DiskReadBytes: 33288, DiskWriteBytes: 0 | ||
| Line 1,530: | Line 1,530: | ||
== Microbench == | == Microbench == | ||
* contact: :bholley | * contact: :bholley | ||
* source: | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/gtest/mozilla/MozGTestBench.cpp MozGTestBench.cpp] | ||
* type: Custom GTest micro-benchmarking | * type: Custom GTest micro-benchmarking | ||
* data: Time taken for a GTest function to execute | * data: Time taken for a GTest function to execute | ||