Confirmed users
2,177
edits
TestEngineering/Performance/Talos/Data: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Talos/Data (view source)
Revision as of 11:48, 16 March 2021
, 16 March 2021no edit summary
No edit summary |
No edit summary |
||
| Line 22: | Line 22: | ||
Data Points refer to the single numbers or replicates we collect while executing a talos test. In this regard, we collect a series of numbers (usually 20 or more) for each subtest. Each of these 20+ numbers are called data points. | Data Points refer to the single numbers or replicates we collect while executing a talos test. In this regard, we collect a series of numbers (usually 20 or more) for each subtest. Each of these 20+ numbers are called data points. | ||
We do filtering on the data points, mainly because the first few data points are not a representative sample of the remaining data points we collect. The one exception would be [ | We do filtering on the data points, mainly because the first few data points are not a representative sample of the remaining data points we collect. The one exception would be [https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#benchmarks benchmarks] (generally suites which measure something other than time). For benchmarks, there is usually a special formula applied to the data points. | ||
= Subtest filters = | = Subtest filters = | ||
We have a variety of [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/filter.py filters] defined for Talos. I will explain what each filter is, and you can see the exact settings used for each filter by looking at the individual [ | We have a variety of [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/filter.py filters] defined for Talos. I will explain what each filter is, and you can see the exact settings used for each filter by looking at the individual [https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#test-definitions tests]. | ||
== ignore_first == | == ignore_first == | ||