Confirmed users
3,376
edits
TestEngineering/Performance/Talos: Difference between revisions
Jump to navigation
Jump to search
→Lifecycle of a Performance Test, from push to graph server: - cleanup
(→Lifecycle of a Performance Test, from push to graph server: buildbot -> taskcluster) |
|||
| Line 17: | Line 17: | ||
[[Performance sheriffing/Talos/Running|See the page on running Talos tests]]. | [[Performance sheriffing/Talos/Running|See the page on running Talos tests]]. | ||
== Lifecycle of a Performance Test, from push to | == Lifecycle of a Performance Test, from push to perfherder == | ||
* Taskcluster schedules [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml talos jobs] | * Taskcluster schedules [https://searchfox.org/mozilla-central/source/taskcluster/ci/test/talos.yml talos jobs] | ||
| Line 23: | Line 23: | ||
** [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py Mozharness\ downloads the build, talos.zip (found in [http://hg.mozilla.org/mozilla-central/tip/testing/talos/talos.json talos.json]), and creates a virtualenv for running the test. | ** [https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py Mozharness\ downloads the build, talos.zip (found in [http://hg.mozilla.org/mozilla-central/tip/testing/talos/talos.json talos.json]), and creates a virtualenv for running the test. | ||
** Mozharness[https://wiki.mozilla.org/Buildbot/Talos/Running#How_Talos_is_Run_in_Production configures the test and runs it] | ** Mozharness[https://wiki.mozilla.org/Buildbot/Talos/Running#How_Talos_is_Run_in_Production configures the test and runs it] | ||
** After the test is completed the data is uploaded | ** After the test is completed the data is uploaded to [https://treeherder.mozilla.org/perf.html#/graphs PerfHerder] | ||
* Treeherder displays a green (all OK) status and has a link to the | * Treeherder displays a green (all OK) status and has a link to the [https://treeherder.mozilla.org/perf.html#/graphs PerfHerder] | ||
* 13 pushes later, [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] is ran which compares your push to the previous 12 pushes and next 12 pushes to look for a [https://wiki.mozilla.org/Buildbot/Talos/Data#Regressions regression] | * 13 pushes later, [http://hg.mozilla.org/graphs/file/tip/server/analysis/analyze_talos.py analyze_talos.py] is ran which compares your push to the previous 12 pushes and next 12 pushes to look for a [https://wiki.mozilla.org/Buildbot/Talos/Data#Regressions regression] | ||
** if a regression is found, it will be posted on [https://treeherder.mozilla.org/perf.html#/alerts Perfherder Alerts] | ** if a regression is found, it will be posted on [https://treeherder.mozilla.org/perf.html#/alerts Perfherder Alerts] | ||