Firefox OS/Performance/Automation/Tools: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Added links to make test-perf source code)
Line 18: Line 18:
** Source code and documentation are hosted on github at https://github.com/mozilla/b2gperf
** Source code and documentation are hosted on github at https://github.com/mozilla/b2gperf


== Running B2g Perf ==
== Running b2gperf ==
# Install reqs with 'pip install b2gperf'
# Install reqs with 'pip install b2gperf'
# Update reqs with 'pip  install --upgrade b2gperf'
# Update reqs with 'pip  install --upgrade b2gperf'
Line 24: Line 24:
# Run b2g perf with 'b2gperf --delay=10 --reset --iterations=30 AppNameHere'. For example, to run settings, run 'b2gperf --delay=10 --reset --iterations=30 Settings'. CASE SENSITIVE
# Run b2g perf with 'b2gperf --delay=10 --reset --iterations=30 AppNameHere'. For example, to run settings, run 'b2gperf --delay=10 --reset --iterations=30 Settings'. CASE SENSITIVE


== Make test perf ==
== Make test-perf ==
* Gaia Test Framework aka '''make test-perf'''
* The in-tree Gaia testing framework maintained by the [[FirefoxOS/Performance|FirefoxOS Performance]] team and [https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/Gaia_performance_tests documented on MDN].
** In-tree testing framework for gaia maintained by the [[FirefoxOS/Performance|FirefoxOS Performance]] team.
* '''Code'''
** Documented on MDN at https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/Gaia_performance_tests
** [https://github.com/mozilla-b2g/gaia/blob/master/bin/gaia-perf-marionette          Runner]
** Contains app-specific tests
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/basemozperf.js    Reporter]
*** [https://github.com/mozilla-b2g/gaia/blob/master/apps/communications/dialer/test/performance Dialer Perf Tests]
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/consolemozperf.js Reporter : console]
*** See ''<APP_NAME>/test/performance'' folders within the [https://github.com/mozilla-b2g/gaia/tree/master/apps Gaia Repo] for more performance tests.
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/jsonmozperf.js    Reporter : json]
 
** [https://github.com/mozilla-b2g/gaia/tree/master/tests/performance                 Source]
* [[/FPS|FPS via Eideticker]]
* '''Tests'''
** See ''<APP_NAME>/test/performance'' folders within the [https://github.com/mozilla-b2g/gaia/tree/master/apps Gaia] repository.
** Examples
*** [https://github.com/mozilla-b2g/gaia/blob/master/apps/communications/dialer/test/performance Dialer]
*** [https://github.com/mozilla-b2g/gaia/tree/master/apps/settings/test/performance Settings]


==Endurance==
==Endurance==
Line 42: Line 46:


==References==
==References==
* [[/FPS|FPS via Eideticker]]
* [https://fxos-perf.etherpad.mozilla.org/2013-07-17-kickoff Performance Automation Kickoff]
* [https://fxos-perf.etherpad.mozilla.org/2013-07-17-kickoff Performance Automation Kickoff]
* [[/Regression_Detection_Requirements|Regression Detection Requirements]]
* [[/Regression_Detection_Requirements|Regression Detection Requirements]]

Revision as of 07:31, 18 July 2014

Progress

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Performance

There are two automated performance testing tools for Gaia; b2gperf and make test-perf. Both use marionette.

Running b2gperf

  1. Install reqs with 'pip install b2gperf'
  2. Update reqs with 'pip install --upgrade b2gperf'
  3. run 'adb forward tcp:2828 tcp:2828' - This lets marionette connect to the device
  4. Run b2g perf with 'b2gperf --delay=10 --reset --iterations=30 AppNameHere'. For example, to run settings, run 'b2gperf --delay=10 --reset --iterations=30 Settings'. CASE SENSITIVE

Make test-perf

Endurance

Integration

References

Retrieved from "https://wiki.allizom.org/index.php?title=Firefox_OS/Performance/Automation/Tools&oldid=997943"