QA/Automation/Meetings/140915: Difference between revisions

 
(18 intermediate revisions by 6 users not shown)
Line 11: Line 11:
= Last Weeks Action Items =
= Last Weeks Action Items =
* {{done|}} [Cosmin] Update the bug about the plugin not working on 14.04 and work on the fix;
* {{done|}} [Cosmin] Update the bug about the plugin not working on 14.04 and work on the fix;
* {{new|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)
* {{ok|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)


= Highlights =
= Highlights =
Line 19: Line 19:
** mozdownload 1.12: https://pypi.python.org/pypi/mozdownload/1.12 ( https://github.com/mozilla/mozdownload/issues/227 )
** mozdownload 1.12: https://pypi.python.org/pypi/mozdownload/1.12 ( https://github.com/mozilla/mozdownload/issues/227 )
** mozmill 2.0.7: bug 980801
** mozmill 2.0.7: bug 980801
* mozmill-automation 2.0.7: https://github.com/mozilla/mozmill-automation/pull/172
** mozmill-automation 2.0.7: https://github.com/mozilla/mozmill-automation/pull/172
* [Andrei] Updated documentation:  https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests/Merging_named_branches#Diff_branches_before_pushing_merge
* [Andrei] Updated documentation:  https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests/Merging_named_branches#Diff_branches_before_pushing_merge
* [Cosmin] Checked and did a small script for the failures rate, turns out we have 0.027 for beta-release.
* [Cosmin] Checked and did a small script for the failures rate, turns out we have 0.027 for beta-release.
* [Andreea] Bug 1046645 - Mixed content - verified, shipped in 32.0.1. Release notes: https://www.mozilla.org/en-US/firefox/32.0.1/releasenotes/
* [Andreea] Bug 1046645 - Mixed content - verified, shipped in 32.0.1. Release notes: https://www.mozilla.org/en-US/firefox/32.0.1/releasenotes/
* [Henrik] Mozmill-CI has been upgraded to Mozmill Automation 2.0.7


= Blockers =
= Blockers =
* You can find all open blockers here: http://bit.ly/Tph0NY
* You can find all open blockers here: http://bit.ly/Tph0NY
* New blockers
* New blockers
** [07/10] - Bug 735184 - RFE: Create Pulse notifications for update channel activities (maybe in Q4)
** {{bug|1037084}} Testing TPS Move TPS test framework out of mozilla-central into its own repository
** [08/05] - Bug 980938 - Crash of Adobe Flash with protected mode enabled and clearing cookies [@ F2102588022] (waiting for feedback)
** [08/29] - Bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes (waiting for security review)
** [09/01] - Bug 911048 - [mozinstall] Add support to install Firefox via the stub installer (needs work done by Henrik)
** [09/01] - Bug 1038646 - Broken package dependencies when installing OpenJDK 7 on Ubuntu 12.04 machines (waiting for feedback)
** [09/01] - Bug 891288 - Create subdomains of mozqa with self-signed SSL certificates for all  supported versions versions (SSL3 - TLS 1.1) (waiting for feedback)
** [09/01] - Bug 1037084 - Move TPS test framework out of mozilla-central into its own repository (waiting for feedback)
** [09/03] - Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
** [09/04] - https://getsatisfaction.com/iriscouch/topics/since-a-couple-of-minutes-iriscouch-com-is-not-reachable-anymore?rfm=1#add_product_label (waiting for feedback)
*** Problem solved after around an hour last Friday, but so far no reply on the topic
** Bug 1065627 - Possible massive network issues for hosts in qa.scl3.mozilla.com on Sep 9th (09/10)
* Github blockers:
* Github blockers:
** Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358
** Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358


= Roundtable =
= Roundtable =
* TBD
* Task tracking tool: https://kanbanery.com/ or https://kanbanize.com
** This is used by some teams. Henrik will talk to others for more information
** Seems to have integration for Bugzilla and Github
** Not sure about license costs and if we have a company license yet


= Goals =
= Goals =
Line 58: Line 52:
* Planned for this week:
* Planned for this week:
** Need to figure out how to best work with the jobs retention issue in order to not let it block us in landing the other patches
** Need to figure out how to best work with the jobs retention issue in order to not let it block us in landing the other patches
** https://github.com/mozilla/mozmill-ci/issues/487 - Update pulse script for Pulse Guardian


== Mozmill for Restart Stability (Henrik, Andrei) ==
== Mozmill for Restart Stability (Henrik, Andrei) ==
* Current Status:
* Current Status:
** TBD
** A script Cosmin run on latest beta release showed a 0.027% failure rate (we should check on which the failure rate should be based on: build vs individual tests
* Planned for this week:
* Planned for this week:
** TBD
** Lets try to finish off {{bug|972912}} so we can see not run tests
** Maybe we can also cover {{bug|794020}} for sane application disconnects


== Automation of TPS tests (Daniel, Mihaela) ==
== Automation of TPS tests (Daniel, Mihaela) ==
* Current Status:
* Current Status:
** partially updated test and libraries based on review
** {{bug|1009441}}  - Add automated test to verify the UI and preferences of a signed in account
*** blocked by {{bug|1005811}}
*** partially updated test and libraries based on review
*** blocked by {{bug|1005811}} - Update Mozmill tests for in-content preferences pane
** {{bug|1018931}} - Add automated test to verify that sync options specified at sign in are persisted after restart
*** waiting for feedback
 
* Planned for this week:
* Planned for this week:
** TBD
** Estabilish how exactly to proceed in {{bug|1009441}} so we can also update and work on the other tests


= Project Updates =
= Project Updates =
== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* TBD
* Released Mozmill v2.0.7 (incl automation scripts, and mozmill-environment) with e10s and OS X signing fixes included


== Mozmill Tests (Softvision) ==
== Mozmill Tests (Softvision) ==
* TBD
Closed:
** {{bug|1058025}} - Update Flash to latest version (i.e. 14.0.0.176)
** {{bug|1064281}} - Enhance selectors for the new about:privatebrowsing page


== TPS (Henrik, Cosmin) ==
== TPS (Henrik, Cosmin) ==
* TBD
* Investigated of how to move the tps extension out of mozilla-central


== WebRTC (Nils) ==
== WebRTC (Nils) ==
Line 89: Line 91:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
** TBD
** Fixed 4 github issues:
*** [coversheet] Finished jobs have to send a status email to the mailing list (#45) (#50)
*** [coversheet] Improve sending of status emails (#52)
*** [coversheet] Don't attach logs for successful builds and archive the logs for the rest (#54)
*** [mozmill-ci] Rename OSX 10.7 machines to OSX 10.10 (#479)
 


* Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/%ID%
* Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/I9OwYbJstRk


= Personal Status =
= Personal Status =
Line 104: Line 111:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)
* {{new|}} [Otilia and Andreea] to send a list of features for tracking tool
* {{new|}} [Cosmin] to investigate Discard logs after 3 days (we should get this in ASAP and monitor results) - maybe even check with IT to increase the disk space vailable on master to 100GB
Confirmed users
332

edits