Confirmed users
3,376
edits
TestEngineering/Performance/Talos: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Talos (view source)
Revision as of 15:59, 22 January 2018
, 22 January 2018→Lifecycle of a Performance Test, from push to graph server: buildbot -> taskcluster
(update link) |
(→Lifecycle of a Performance Test, from push to graph server: buildbot -> taskcluster) |
||
| Line 19: | Line 19: | ||
== Lifecycle of a Performance Test, from push to graph server == | == Lifecycle of a Performance Test, from push to graph server == | ||
* | * Taskcluster schedules [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml talos jobs] | ||
* | * Taskcluster runs a talos job on a hardware machine when one is available - this is bootstrapped by [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py Mozharness] | ||
** | ** [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py Mozharness\ downloads the build, talos.zip (found in [http://hg.mozilla.org/mozilla-central/tip/testing/talos/talos.json talos.json]), and creates a virtualenv for running the test. | ||
** | ** Mozharness[https://wiki.mozilla.org/Buildbot/Talos/Running#How_Talos_is_Run_in_Production configures the test and runs it] | ||
** After the test is completed the data is uploaded to the [http://graphs.mozilla.org/ Graph Server] (and to [https://treeherder.mozilla.org/perf.html#/graphs PerfHerder]) | ** After the test is completed the data is uploaded to the [http://graphs.mozilla.org/ Graph Server] (and to [https://treeherder.mozilla.org/perf.html#/graphs PerfHerder]) | ||
* Treeherder displays a green (all OK) status and has a link to the graph server | * Treeherder displays a green (all OK) status and has a link to the graph server | ||
* 13 pushes later, [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] is ran which compares your push to the previous 12 pushes and next 12 pushes to look for a [https://wiki.mozilla.org/Buildbot/Talos/Data#Regressions regression] | * 13 pushes later, [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] is ran which compares your push to the previous 12 pushes and next 12 pushes to look for a [https://wiki.mozilla.org/Buildbot/Talos/Data#Regressions regression] | ||
** if a regression is found, it will be posted on [ | ** if a regression is found, it will be posted on [https://treeherder.mozilla.org/perf.html#/alerts Perfherder Alerts] | ||
== Resources / How-to == | == Resources / How-to == | ||