Confirmed users, Bureaucrats and Sysops emeriti
998
edits
Buildbot/Talos/Tests: Difference between revisions
Jump to navigation
Jump to search
Add tabpaint
(Added Microbench) |
(Add tabpaint) |
||
| Line 1,061: | Line 1,061: | ||
* data: Time taken for a GTest function to execute | * data: Time taken for a GTest function to execute | ||
* summarization: Not a Talos test. This suite is provides a way to add low level platform performance regression tests for things that are not suited to be tested by Talos. See the [[https://wiki.mozilla.org/Buildbot/Talos/Sheriffing#Microbench_Policy Microbench Sheriffing Policy]] for some notes on how to treat regressions. | * summarization: Not a Talos test. This suite is provides a way to add low level platform performance regression tests for things that are not suited to be tested by Talos. See the [[https://wiki.mozilla.org/Buildbot/Talos/Sheriffing#Microbench_Policy Microbench Sheriffing Policy]] for some notes on how to treat regressions. | ||
==== Possible regression causes ==== | |||
* None listed yet. If you fix a regression for this test and have some tips to share, this is a good place for them. | |||
=== tabpaint === | |||
* contact: :mconley | |||
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/tabpaint tabpaint] | |||
* bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1253382 | |||
* type: Pageloader | |||
* measuring: | |||
** The time it takes to paint the content of a newly opened tab when the tab is opened from the parent (ex: by hitting Ctrl-T) | |||
** The time it takes to paint the content of a newly opened tab when the tab is opened from content (ex: by clicking on a target="_blank" link) | |||
* '''NOT''' measuring: | |||
** The time it takes to animate the tabs. That's the responsibility of the TART test. tabpaint is strictly concerned with the painting of the web content. | |||
* data: we load the tabpaint trigger page 20 times, each run produces two values (the time it takes to paint content when opened from the parent, and the time it takes to paint content when opened from content), resulting in 2 sets of 20 data points. | |||
** Example: | |||
{| class="mw-collapsible mw-collapsed wikitable" | |||
! Example data | |||
|- | |||
| <pre> | |||
0;tabpaint-from-parent;105;76;66;64;64;69;65;63;70;68;64;60;65;63;54;61;64;67;61;64 | |||
1; tabpaint-from-content;129;68;72;72;70;78;86;85;82;79;120;92;76;80;74;82;76;89;77;85 | |||
</pre> | |||
|} | |||
* summarization: | |||
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/Data#median median] of the remaining 19 data points | |||
** suite: geometric_mean(subtests) | |||
==== Possible regression causes ==== | ==== Possible regression causes ==== | ||