TestEngineering/Performance/Talos/Tests: Difference between revisions

Update sessionrestore section to reflect test changes
(→‎Paint Tests: Fixed bad link to MozAfterPaint.)
(Update sessionrestore section to reflect test changes)
Line 581: Line 581:


=== sessionrestore/sessionrestore_no_auto_restore/sessionrestore_many_windows ===
=== sessionrestore/sessionrestore_no_auto_restore/sessionrestore_many_windows ===
* contact: :mikedeboer
* contact: :mikedeboer, :mconley, :felipe
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/sessionrestore talos/sessionrestore]
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/startup_test/sessionrestore talos/sessionrestore]
* bug: https://bugzilla.mozilla.org/show_bug.cgi?id=936630, https://bugzilla.mozilla.org/show_bug.cgi?id=1331937
* bug: [https://bugzilla.mozilla.org/show_bug.cgi?id=936630 bug 936630], [https://bugzilla.mozilla.org/show_bug.cgi?id=1331937 bug 1331937], [https://bugzilla.mozilla.org/show_bug.cgi?id=1531520 bug 1531520]
* type: Startup
* type: Startup
* measuring: time spent reading and restoring the session.
* measuring: time spent reading and restoring the session.
Line 589: Line 589:
* data: we load the session restore index page 10 times to collect 1 set of 10 data points.
* data: we load the session restore index page 10 times to collect 1 set of 10 data points.
* summarization:
* summarization:
** subtest: [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#median median] of the remaining 9 data points; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l305 source: test.py]
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/Data#median median] of the remaining 9 data points; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l305 source: test.py]
** suite: identical to subtest
** suite: identical to subtest


Three tests measure the time spent reading and restoring the session from a valid sessionstore.js. Time starts ticking during event sessionRestoreInit and stops during event sessionRestored.
Three tests measure the time spent reading and restoring the session from a valid sessionstore.js. Time is counted from the ''process start'' until the ''sessionRestored'' event.


In ''sessionrestore'', this is tested with a configuration that requires the session to be restored. In ''sessionrestore_no_auto_restore'', this is tested with a configuration that requires the session to not be restored. Both of the above tests use a sessionstore.js file that contains one window and roughly 89 tabs. In ''sessionrestore_many_windows'', this is tested with a sessionstore.js that contains 3 windows and 130 tabs. The first window contains 50 tabs, 80 remaning tabs are divided equally between the second and the third window.
In ''sessionrestore'', this is tested with a configuration that requires the session to be restored. In ''sessionrestore_no_auto_restore'', this is tested with a configuration that requires the session to not be restored. Both of the above tests use a sessionstore.js file that contains one window and roughly 89 tabs. In ''sessionrestore_many_windows'', this is tested with a sessionstore.js that contains 3 windows and 130 tabs. The first window contains 50 tabs, 80 remaning tabs are divided equally between the second and the third window.
Confirmed users
371

edits