83
edits
TestEngineering/Performance/Talos/Tests: Difference between revisions
TestEngineering/Performance/Talos/Tests (view source)
Revision as of 21:14, 23 September 2019
, 23 September 2019Point to #xperf from fileio section in tp5 test definition.
No edit summary |
(Point to #xperf from fileio section in tp5 test definition.) |
||
| Line 838: | Line 838: | ||
|} | |} | ||
=== File IO === | ==== File IO ==== | ||
==== Possible regression causes ==== | File IO is tested using the tp5 test set in the [[#xperf]] test. | ||
===== Possible regression causes ===== | |||
* '''nonmain_startup_fileio opt (with or without e10s) windows7-32''' – {{bug|1274018}} This test seems to consistently report a higher result for mozilla-central compared to Try even for an identical revision due to extension signing checks. In other words, if you are comparing Try and Mozilla-Central you may see a false-positive regression on perfherder. Graphs: [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Bmozilla-central,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D&series=%5Btry,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D non-e10s] [https://treeherder.mozilla.org/perf.html#/graphs?series=%5B%22mozilla-central%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&series=%5B%22try%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&timerange=604800 e10s] | * '''nonmain_startup_fileio opt (with or without e10s) windows7-32''' – {{bug|1274018}} This test seems to consistently report a higher result for mozilla-central compared to Try even for an identical revision due to extension signing checks. In other words, if you are comparing Try and Mozilla-Central you may see a false-positive regression on perfherder. Graphs: [https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Bmozilla-central,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D&series=%5Btry,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D non-e10s] [https://treeherder.mozilla.org/perf.html#/graphs?series=%5B%22mozilla-central%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&series=%5B%22try%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&timerange=604800 e10s] | ||
=== Xres (X Resource Monitoring) === | ==== Xres (X Resource Monitoring) ==== | ||
A memory metric tracked during tp5 test runs. This metric is sampled every 20 seconds. This metric is collected on linux only. | A memory metric tracked during tp5 test runs. This metric is sampled every 20 seconds. This metric is collected on linux only. | ||
[https://linux.die.net/man/3/xres xres man page]. | [https://linux.die.net/man/3/xres xres man page]. | ||
=== % CPU === | ==== % CPU ==== | ||
Cpu usage tracked during tp5 test runs. This metric is sampled every 20 seconds. This metric is collected on windows only. | Cpu usage tracked during tp5 test runs. This metric is sampled every 20 seconds. This metric is collected on windows only. | ||
=== Responsiveness === | ==== Responsiveness ==== | ||
contact: :jimm, :overholt | contact: :jimm, :overholt | ||