TestEngineering/Performance/Raptor/Browsertime: Difference between revisions

→‎Upgrading Browsertime In-Tree: Update information here.
(→‎Running on Google Chrome: Add raptor-browsertime usage.)
(→‎Upgrading Browsertime In-Tree: Update information here.)
Line 95: Line 95:


=== Upgrading Browsertime In-Tree ===
=== Upgrading Browsertime In-Tree ===
To upgrade the browsertime version used in-tree follow the changes in [https://bugzilla.mozilla.org/show_bug.cgi?id=1592400 bug 1592400].
To upgrade the browsertime version used in-tree you can run, then commit the changes made to <code>package.json</code> and <code>package-lock.json</code>:
  ./mach browsertime --update-upstream-url <TARBALL-URL>


To perform the upgrade, you need to make a change to [https://dxr.mozilla.org/mozilla-central/source/tools/browsertime/package.json?q=tools%2Fbrowsertime%2Fpackage.json&redirect_type=direct#8 <tt>tools/browsertime/package.json</tt>] where you need to change the commit of the browsertime tarball. After making the change, upgrade browsertime locally, then include the <tt>tools/browsertime/package-lock.json</tt> changes in the upgrade patch. There might not be any changes to it. In that case, run <tt>npm install</tt> in <tt>tools/browsertime/</tt> to update it, you should at the least see a change in the "integrity" and "version" fields.
Here is a sample URL that we can update to: https://github.com/sitespeedio/browsertime/tarball/89771a1d6be54114db190427dbc281582cba3d47


To test the upgrade, first run <tt>./mach browsertime https://sitespeed.io</tt> and compare the before/after results. Ensure that --video still works on the upgraded version as well. If all that works, then run all browsertime tests available in production. If everything looks normal, or expected, then the upgrade is good to land.
To test the upgrade, run a raptor test locally (with and without visual-metrics <code>--browsertime-visualmetrics</code> if possible) and test it on try with at least one test on desktop and mobile.


=== Finding the Geckodriver Being Used ===
=== Finding the Geckodriver Being Used ===
83

edits