Confirmed users
3,376
edits
Buildbot/Talos/Tests: Difference between revisions
m
remove graphserver from description
m (→tsvg_static: - update) |
m (remove graphserver from description) |
||
| Line 93: | Line 93: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|basic_compositor_video | |basic_compositor_video | ||
| | | | ||
| Line 149: | Line 147: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|tcanvasmark | |tcanvasmark | ||
| | | | ||
|} | |} | ||
| Line 190: | Line 186: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|glterrain | |glterrain | ||
|Measures average frames interval while animating a simple WebGL scene | |Measures average frames interval while animating a simple WebGL scene | ||
|} | |} | ||
| Line 227: | Line 221: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|tp5o_scroll | |tp5o_scroll | ||
|Measures average frames interval while scrolling the pages of the tp5o set | |Measures average frames interval while scrolling the pages of the tp5o set | ||
|} | |} | ||
| Line 314: | Line 306: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|tp5o | |tp5o | ||
|tp5 with limited pageset (48 pages as others have too much noise) | |tp5 with limited pageset (48 pages as others have too much noise) | ||
|} | |} | ||
| Line 492: | Line 482: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
| Line 565: | Line 554: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|tsvgr_opacity | |tsvgr_opacity | ||
|[[#Row_Major_vs._Column_Major|Row Major]] and 25 cycles/page. | |[[#Row_Major_vs._Column_Major|Row Major]] and 25 cycles/page. | ||
|} | |} | ||
| Line 603: | Line 590: | ||
|- | |- | ||
|Talos test name | |Talos test name | ||
|Description | |Description | ||
|- | |- | ||
|tpaint | |tpaint | ||
|twinopen but measuring the time after we receive the [[Buildbot/Talos/Tests#Paint_Tests|MozAfterPaint and OnLoad event]]. | |twinopen but measuring the time after we receive the [[Buildbot/Talos/Tests#Paint_Tests|MozAfterPaint and OnLoad event]]. | ||
|} | |} | ||
| Line 710: | Line 695: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|a11yr | |a11yr | ||
|[[#Row_Major_vs._Column_Major|Row Major]] testing with 25 cycles per page | |[[#Row_Major_vs._Column_Major|Row Major]] testing with 25 cycles per page | ||
|} | |} | ||
| Line 746: | Line 729: | ||
|- | |- | ||
| Talos test name | | Talos test name | ||
| Description | | Description | ||
|- | |- | ||
|tscrollx | |tscrollx | ||
|[https://groups.google.com/d/topic/mozilla.dev.platform/RICw5SJhNMo/discussion Replacing tscroll,tsvg with tscrollx,tsvgx] | |[https://groups.google.com/d/topic/mozilla.dev.platform/RICw5SJhNMo/discussion Replacing tscroll,tsvg with tscrollx,tsvgx] | ||
|} | |} | ||
| Line 832: | Line 813: | ||
* measuring: JavaScript performance | * measuring: JavaScript performance | ||
* reporting: Total time for all tests, in ms (lower is better) | * reporting: Total time for all tests, in ms (lower is better) | ||
* data: there are 14 subtests in kraken, each subtest is an internal benchmark and generates 10 data points, or 14 sets of 10 data points. | * data: there are 14 subtests in kraken, each subtest is an internal benchmark and generates 10 data points, or 14 sets of 10 data points. | ||
* summarization: | * summarization: | ||
| Line 870: | Line 850: | ||
* measuring: ??? | * measuring: ??? | ||
* reporting: weighted score (higher is better) | * reporting: weighted score (higher is better) | ||
* data: there are 10 subtests in kraken, each subtest is an internal benchmark and generates a single replicate. | * data: there are 10 subtests in kraken, each subtest is an internal benchmark and generates a single replicate. | ||
* summarization: | * summarization: | ||
| Line 906: | Line 885: | ||
* measuring: Desktop Firefox UI animation speed and smoothness | * measuring: Desktop Firefox UI animation speed and smoothness | ||
* reporting: intervals in ms (lower is better) - see below for details | * reporting: intervals in ms (lower is better) - see below for details | ||
* data: there are 30 reported subtests from TART which we load 25 times, resulting in 30 sets of 25 data points. | * data: there are 30 reported subtests from TART which we load 25 times, resulting in 30 sets of 25 data points. | ||
* summarization: | * summarization: | ||
| Line 987: | Line 965: | ||
* measuring: Developer Tools toolbox startup, shutdown, and reload performance | * measuring: Developer Tools toolbox startup, shutdown, and reload performance | ||
* reporting: intervals in ms (lower is better) - see below for details | * reporting: intervals in ms (lower is better) - see below for details | ||
* data: there are 36 reported subtests from DAMP which we load 25 times, resulting in 36 sets of 25 data points. | * data: there are 36 reported subtests from DAMP which we load 25 times, resulting in 36 sets of 25 data points. | ||
* summarization: | * summarization: | ||