TestEngineering/Performance/Talos/Tests: Difference between revisions

remove V8 docs
(→‎page sets: small update)
(remove V8 docs)
Line 1,356: Line 1,356:
==== Possible regression causes ====
==== Possible regression causes ====
* Did you change the dimensions of the content area? Even a little? The tsvgx test seems to be sensitive to changes like this. See {{bug|1375479}}, for example. Usually, these sorts of "regressions" aren't real regressions - they just mean that we need to re-baseline our expectations from the test.
* Did you change the dimensions of the content area? Even a little? The tsvgx test seems to be sensitive to changes like this. See {{bug|1375479}}, for example. Usually, these sorts of "regressions" aren't real regressions - they just mean that we need to re-baseline our expectations from the test.
=== V8, version 7===
* contact:
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/v8_7 v8.manifest]
* type: PageLoader
* measuring: ???
* reporting: weighted score (higher is better)
* data: there are 10 subtests in kraken, each subtest is an internal benchmark and generates a single replicate.
* summarization:
** subtest: For all of the 10 data points, we take filter with [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#v8_subtest v8_subtest] to apply the reference value for the subtest to generate a single number. [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l489 source: test.py]
** suite: [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#v8_metric v8 metric] is basically the geometric mean of the 10 subtests and multiples the output by 100.
this is the V8 (version 7) javascript benchmark taken verbatim and slightly modified to fit into our pageloader extension and talos harness.
The previous version of this test is V8 version 5 which was run on selective branches and operating systems.
{| class="mw-collapsible mw-collapsed wikitable"
! Example data
|-
| <pre>
0;Richards;152.99877600979192
1;DeltaBlue;210.7481559536354
2;Encrypt;291.29041654529567
3;Decrypt;5358.288770053476
4;RayTrace;1833.3333333333333
5;Earley;678.42605156038
6;Boyer;10265.30612244898
7;RegExp;28333.333333333332
8;Splay;528.2620179609086
9;NavierStokes;5055.555555555556
</pre>
|}


=== xperf ===
=== xperf ===
160

edits