TestEngineering/Performance/Raptor/Browsertime: Difference between revisions

TestEngineering/Performance/Raptor/Browsertime (view source)

Revision as of 17:19, 11 January 2021

567 bytes removed , 11 January 2021

→‎Upgrading Browsertime In-Tree: Update information here.

Gmierz

83

edits

@@ Line 95: / Line 95: @@
 === Upgrading Browsertime In-Tree ===
-To upgrade the browsertime version used in-tree follow the changes in [https://bugzilla.mozilla.org/show_bug.cgi?id=1592400 bug 1592400].
+To upgrade the browsertime version used in-tree you can run, then commit the changes made to <code>package.json</code> and <code>package-lock.json</code>:
+  ./mach browsertime --update-upstream-url <TARBALL-URL>
-To perform the upgrade, you need to make a change to [https://dxr.mozilla.org/mozilla-central/source/tools/browsertime/package.json?q=tools%2Fbrowsertime%2Fpackage.json&redirect_type=direct#8 <tt>tools/browsertime/package.json</tt>] where you need to change the commit of the browsertime tarball. After making the change, upgrade browsertime locally, then include the <tt>tools/browsertime/package-lock.json</tt> changes in the upgrade patch. There might not be any changes to it. In that case, run <tt>npm install</tt> in <tt>tools/browsertime/</tt> to update it, you should at the least see a change in the "integrity" and "version" fields.
+Here is a sample URL that we can update to: https://github.com/sitespeedio/browsertime/tarball/89771a1d6be54114db190427dbc281582cba3d47
-To test the upgrade, first run <tt>./mach browsertime https://sitespeed.io</tt> and compare the before/after results. Ensure that --video still works on the upgraded version as well. If all that works, then run all browsertime tests available in production. If everything looks normal, or expected, then the upgrade is good to land.
+To test the upgrade, run a raptor test locally (with and without visual-metrics <code>--browsertime-visualmetrics</code> if possible) and test it on try with at least one test on desktop and mobile.
 === Finding the Geckodriver Being Used ===