Confirmed users
2,177
edits
QA/Automation/Projects/Endurance Tests/Documentation: Difference between revisions
Jump to navigation
Jump to search
QA/Automation/Projects/Endurance Tests/Documentation (view source)
Revision as of 12:27, 24 May 2011
, 24 May 2011Added more details on submitting reports.
(Added Mozmill Crowd and advanced command line options.) |
(Added more details on submitting reports.) |
||
| Line 1: | Line 1: | ||
= Introduction = | = Introduction = | ||
The Endurance Tests are intended for replicating and discovering issues related to degradation of application performance over time. This is achieved by running a snippet of test code repeatedly, gathering details on system resources, and reporting these metrics for review. Check out the [[QA/Mozmill Test Automation/Endurance Tests|project page]] for more details on Endurance Tests. | The Endurance Tests are intended for replicating and discovering issues related to degradation of application performance over time. This is achieved by running a snippet of test code repeatedly, gathering details on system resources, and reporting these metrics for review. Check out the [[QA/Mozmill Test Automation/Endurance Tests|project page]] for more details on Endurance Tests. | ||
| Line 15: | Line 14: | ||
'''Note:''' If this is the first time you have run tests using Mozmill Crowd then you will be prompted to select an location for the Mozmill environment to be downloaded to. | '''Note:''' If this is the first time you have run tests using Mozmill Crowd then you will be prompted to select an location for the Mozmill environment to be downloaded to. | ||
=== Reports === | |||
To submit results to a report server, check the box labelled 'Submit test results to a couchdb server' in the 'Preferences' dialog. By default the value will be http://mozmill-crowd.brasstacks.mozilla.com/db/, which is the preferred target for results. | |||
== Command Line == | == Command Line == | ||
| Line 38: | Line 40: | ||
=== Restarts === | === Restarts === | ||
By default the Endurance Tests will restart the application between each test. If you want to disable these restarts then provide the optional <tt>--no-restart</tt> parameter. | By default the Endurance Tests will restart the application between each test. If you want to disable these restarts then provide the optional <tt>--no-restart</tt> parameter. | ||
=== Reports === | |||
To submit results to a report server, add the <tt>-r URL</tt> or <tt>--report=URL</tt> command line parameter. The preferred target URL for the results is http://mozmill-crowd.brasstacks.mozilla.com/db/ | |||
= Writing Endurance Tests = | = Writing Endurance Tests = | ||
All Endurance Tests need to instantiate an <tt>EnduranceManager</tt> from the <tt>endurance.js</tt> shared-module. The only other requirement is that the test calls the run method, with a single argument. This argument is the function that will be repeated for each iteration. An example endurance test template is below: | All Endurance Tests need to instantiate an <tt>EnduranceManager</tt> from the <tt>endurance.js</tt> shared-module. The only other requirement is that the test calls the run method, with a single argument. This argument is the function that will be repeated for each iteration. An example endurance test template is below: | ||
<pre class="brush:js;toolbar:false;">var Endurance = require("../../../lib/endurance"); | <pre class="brush:js;toolbar:false;">var Endurance = require("../../../lib/endurance"); | ||
| Line 61: | Line 65: | ||
= Reports = | = Reports = | ||
If you have sent the results to the preferred [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Mozmill Test Results Dashboard] instance, then you can see your test result reports at http://mozmill-crowd.brasstacks.mozilla.com/#/endurance/reports | |||