QA/Automation/Projects/Mozmill Automation/Mozmill CI: Difference between revisions

QA/Automation/Projects/Mozmill Automation/Mozmill CI (view source)

Revision as of 15:51, 23 May 2012

931 bytes removed , 23 May 2012

→‎Overview

Whimboo

canmove, Confirmed users, Bureaucrats and Sysops emeriti

4,714

edits

@@ Line 1: / Line 1: @@
 __NOTOC__
 =Overview=
-The Mozmill Automation team currently performs Mozmill tests triggered by a daily cron job. This approach has some weaknesses:
+The Automation Development team is working on a Mozmill CI solution which triggers Mozmill tests immediately when a new build of Firefox has been made available.
-* If no build lands, we still attempt to perform Mozmill tests
-* If a build lands off schedule, we attempt to test it at the wrong time or miss it completely
-* There's no way to use this style of trigger to pre-qualify a build (or even promptly post-qualify it) so results have limited impact
-* Because we update build-over-build, using the same installation, anomalies in testing (or bugs in a given build) can cause the process to get "off-track" and poison subsequent Mozmill tests.
-Instead, we'd like to move towards performing Mozmill tests immediately when a build has been made available. We'd also like to independently download and verify each day's build, rather than relying on using the same install day over day.
 The ultimate goal is to build a system within QA, then hand off the process to Release Engineering for ongoing maintenance.
@@ Line 22: / Line 16: @@
   |- valign="top"
   | '''Contributors:'''
-  | Geo Mealer
+  | n/a
- |- valign="top"
- | '''Tracker:'''
- | https://www.pivotaltracker.com/projects/298905?label=Triggered%20Daily%20Tests
- |- valign="top"
- | '''Tracking Bug:'''
- | https://bugzilla.mozilla.org/show_bug.cgi?id=709052
   |- valign="top"
   | '''Repository:'''
-  | http://hg.mozilla.org/qa/mozmill-automation/
+  | https://github.com/mozilla/mozmill-ci
   |- valign="top"
   | '''Etherpad:'''
-  | http://etherpad.mozilla.com:9000/qas-triggered-tests
+  | https://etherpad.mozilla.org/mozmill-ci
 |}