QA/Automation/Projects/Mozmill Automation/Mozmill CI

From MozillaWiki
Jump to navigation Jump to search

Overview

The Automation Development team is working on a Mozmill CI solution which triggers Mozmill tests immediately when a new build of Firefox has been made available.

The ultimate goal is to build a system within QA, then hand off the process to Release Engineering for ongoing maintenance.

Name: Triggered Daily Test-runs
Leads: Henrik Skupin, Dave Hunt
Contributors: Andreea Matei, Cosmin Malutan
Repository: https://github.com/mozilla/mozmill-ci
Etherpad: https://etherpad.mozilla.org/mozmill-ci

Documentation

A complete set of documents can be found on the pages linked below:

Roadmap

Date Version Details
Dec 12th, 2011 - Documentation ready for CI implementation
Dec 31st, 2011 - CI system running for daily tests
Sep 30th, 2014 Issue #270 Get full coverage of all locales for Firefox beta and release testing

List of Tasks

List of tasks to be done for this goal. Will be updated every week.

Task Assigner Status
Test all locales on a CI instance locally for Beta - functional and remote Andreea Matei, Cosmin Malutan In progress - https://docs.google.com/spreadsheets/d/18dQsatBMlcekK3hc-Zn-Qawq3b6rK_PBek6c2kJxMME/edit?usp=sharing
For the failures that we found, file bugs in Mozmill tests and Localizations (if needed) Andreea Matei, Cosmin Malutan In progress
Create and test the blacklist Andreea Matei, Cosmin Malutan Not started

List of Bugs

In the following table you can find all the bugs we file for the broken locales.

  • Tracking bug: bug 1045009 - Tracking bug for blacklisting broken locales
Bug Assigner Status
bug 1046645 - [l10n] Test failure "There is a lock icon - 'url("chrome://browser/skin/identity-icons-https-mixed-display.png")' should contain 'identity-icons-https.png'" in testDVCertificate.js Cosmin Malutan In progress