83
edits
TestEngineering/Performance/Raptor: Difference between revisions
→raptor-speedometer v1.0: Update information on how the score is calculated.
(→raptor-speedometer: Add speedometer version specification) |
(→raptor-speedometer v1.0: Update information on how the score is calculated.) |
||
| Line 526: | Line 526: | ||
* data: there are 16 subtests in Speedometer; each of these are made up of 9 internal benchmarks. | * data: there are 16 subtests in Speedometer; each of these are made up of 9 internal benchmarks. | ||
* summarization: | * summarization: | ||
** subtest: For all of the 16 subtests, we collect | ** subtest: For all of the 16 subtests, we collect [https://searchfox.org/mozilla-central/source/third_party/webkit/PerformanceTests/Speedometer/resources/benchmark-report.js#66-67 a summed of all their internal benchmark results] for each of them. To obtain a single score per subtest, we take [https://searchfox.org/mozilla-central/source/testing/raptor/raptor/output.py#427-470 a median of the replicates]. | ||
** score: geometric mean of the 16 | ** score: [https://searchfox.org/mozilla-central/source/testing/raptor/raptor/output.py#317-330 geometric mean of the 16 subtest metrics (along with some special corrections)]. | ||
This is the [http://browserbench.org/Speedometer/ Speedometer v1.0] JavaScript benchmark taken verbatim and slightly modified to work with the Raptor harness. | This is the [http://browserbench.org/Speedometer/ Speedometer v1.0] JavaScript benchmark taken verbatim and slightly modified to work with the Raptor harness. | ||