TestEngineering/Performance/Raptor/Browsertime: Difference between revisions

no edit summary
No edit summary
Line 1: Line 1:
Browsertime is a harness for running performance tests, similar to
Browsertime is a harness for running performance tests, similar to Mozilla's Raptor testing framework. Browsertime is written in Node.js and uses Selenium WebDriver to drive multiple browsers including Chrome, Chrome for Android, Firefox, and (pending the resolution of {{bug|1525126}} and similar tickets) Firefox for Android and GeckoView-based vehicles.
Mozilla's Raptor testing framework. Browsertime is written in Node.js
and uses Selenium WebDriver to drive multiple browsers including
Chrome, Chrome for Android, Firefox, and (pending the resolution of
[https://bugzilla.mozilla.org/show_bug.cgi?id=1525126 Bug 1525126]
and similar tickets) Firefox for Android and GeckoView-based vehicles.


Source code:
Source code:
Line 16: Line 11:
=== Setup ===
=== Setup ===
* Run <code>./mach browsertime --setup</code>
* Run <code>./mach browsertime --setup</code>
* To check your setup, run <code>./mach browsertime --check</code>, which will output something like:<br>
* To check your setup, run <code>./mach browsertime --check</code>, which will output something like:
<code>
 
ffmpeg:  OK<br>
  ffmpeg:  OK  
convert:  OK<br>
  convert:  OK  
compare:  OK<br>
  compare:  OK
Pillow:  OK<br>
  Pillow:  OK
SSIM:    OK<br>
  SSIM:    OK
</code>
 
⚠️ If <tt>ffmpeg</tt> is listed as FAIL, you might want to try this:
* If <code>ffmpeg</code> is listed as FAIL, you might want to try this:
* <code>cd ~/.mozbuild/browsertime/ffmpeg-4.1.1-macos64-static/bin</code>
 
* <code>chmod +x ffmpeg ffplay ffprobe</code>
  cd ~/.mozbuild/browsertime/ffmpeg-4.1.1-macos64-static/bin
  chmod +x ffmpeg ffplay ffprobe}}


Now, try re-running <code>./mach browsertime --check</code>, with <code>ffmpeg</code> hopefully fixed
Now, try re-running <code>./mach browsertime --check</code>, with <code>ffmpeg</code> hopefully fixed


If <tt>convert</tt> and <tt>compare</tt> are also <code>FAIL</code>
If <code>convert</code> and <code>compare</code> are also <code>FAIL</code> bugs which might further help are {{bug|1559168}}, {{bug|1559727}}, and {{bug|1574964}}, for starters.
Bugs which might further help are [https://bugzilla.mozilla.org/show_bug.cgi?id=1559168 bug 1559168], [https://bugzilla.mozilla.org/show_bug.cgi?id=1559727 bug 1559727], and [https://bugzilla.mozilla.org/show_bug.cgi?id=1574964 bug 1574964], for starters
* If you plan on running Browsertime on Android, your Android device must already be set up (see more below in the Android section)
* If you plan on running Browsertime on Android, your Android device must already be set up (see more below in the Android section)


Confirmed users
2,177

edits