TestEngineering/Performance/Talos/Running: Difference between revisions

no edit summary
No edit summary
No edit summary
 
(One intermediate revision by one other user not shown)
Line 5: Line 5:
{{warning|Firefox must have already been built successfully locally. See [https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/Simple_Firefox_build Building Firefox] for details.}}
{{warning|Firefox must have already been built successfully locally. See [https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/Simple_Firefox_build Building Firefox] for details.}}


[https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/mach mach] is used to run the [[../Tests|Talos tests]] locally. You can run suites of tests or individual tests on their own.
[https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/mach mach] is used to run the [https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#test-definitions Talos tests] locally. You can run suites of tests or individual tests on their own.


For example, to run the 'chromez' test suite:
For example, to run the 'chromez' test suite:
Line 14: Line 14:


   ./mach talos-test --activeTests tart
   ./mach talos-test --activeTests tart
'''Known Issues'''
In some cases, the Talos setup may not finish properly, throwing ''Import Error: No module named'' for packages such as ''wptserve'' and ''simplejson''. This is known to affect MacOS users: [https://bugzilla.mozilla.org/show_bug.cgi?id=1667189 Bug 1667189 - Talos test refuses to run because of missing python packages]
If you encounter this error, running the following command should resolve it:
  brew link python3
Otherwise, you can manually activate Talos's virtual environment (found in your ''obj'' directory, which differs based on your machine architecture and OS, i.e. ''obj-x86_64-apple-darwin19.6.0'') and install the missing packages:
  source mozilla-central/obj-[your directory suffix]/testing/talos-venv/bin/activate
  pip install wptserve simplejson


Certain Talos suites/tests require external pagesets to be downloaded. If pagesets are required, they will be downloaded and extracted automatically when running Talos via mach. To disable this automatic pageset downloading, add the 'no-download' argument:
Certain Talos suites/tests require external pagesets to be downloaded. If pagesets are required, they will be downloaded and extracted automatically when running Talos via mach. To disable this automatic pageset downloading, add the 'no-download' argument:
Confirmed users
2,177

edits