canmove, Confirmed users, Bureaucrats and Sysops emeriti
4,714
edits
QA/Automation/Projects/Addons/MozmillCrowd: Difference between revisions
QA/Automation/Projects/Addons/MozmillCrowd (view source)
Revision as of 00:03, 9 May 2010
, 9 May 2010→Project Details
| Line 28: | Line 28: | ||
=Project Details= | =Project Details= | ||
Only running Mozmill tests on buildbot or on the release-test machine in the QA lab is not sufficient to find misbehavior's of Firefox. A more wide-spread test-run is necessary. Such a possibility will be the result of the cloud testing project. An extension has to be developed which will automatically prepare the system, executes the test-run, and send the results to our report server for analysis. | Only running Mozmill tests on buildbot or on the release-test machine in the QA lab is not sufficient to find misbehavior's of Firefox. A more wide-spread test-run is necessary. Such a possibility will be the result of the cloud testing project. An extension has to be developed which will automatically prepare the system, executes the test-run, and send the results to our report server for analysis. | ||
==The Extension== | |||
The easiest way to add additional features to Firefox is to install an extension. The same way will be used for this project. The extension, which will be offered on [https://addons.mozilla.org/ addons.mozilla.org], will add it's own toolbar right below of the existing ones. With a dropdown field the user will be able to select the wanted test-run, e.g. normal tests, update tests, or l10n tests. By clicking the 'Run' button the test-run gets executed. | |||
==Preparing the System== | ==Preparing the System== | ||
| Line 38: | Line 41: | ||
* Install the latest release of Mozmill | * Install the latest release of Mozmill | ||
* Retrieve the automation scripts | * Retrieve the automation scripts | ||
==Executing Mozmill Tests== | ==Executing Mozmill Tests== | ||
Given by the selected dropdown entry on the toolbar the Python script of the related test-run gets executed. It will perform the following actions: | |||
* Cloning the Mozmill tests from the [http://hg.mozilla.org/qa/mozmill-tests/ mozmill-tests repository] | |||
* Updating the tests branch to the Gecko branch of the currently running version of Firefox | |||
* Starting another instance of Firefox | |||
* Execute all existent tests | |||
==Report Analysis== | ==Report Analysis== | ||