QA/Automation/Meetings/140915: Difference between revisions

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
 
(21 intermediate revisions by 6 users not shown)
Line 11: Line 11:
= Last Weeks Action Items =
= Last Weeks Action Items =
* {{done|}} [Cosmin] Update the bug about the plugin not working on 14.04 and work on the fix;
* {{done|}} [Cosmin] Update the bug about the plugin not working on 14.04 and work on the fix;
* {{new|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)
* {{ok|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)


= Highlights =
= Highlights =
Line 20: Line 20:
** mozmill 2.0.7: bug 980801
** mozmill 2.0.7: bug 980801
** mozmill-automation 2.0.7: https://github.com/mozilla/mozmill-automation/pull/172
** mozmill-automation 2.0.7: https://github.com/mozilla/mozmill-automation/pull/172
** [Andrei] Updated documentation:  https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests/Merging_named_branches#Diff_branches_before_pushing_merge
* [Andrei] Updated documentation:  https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests/Merging_named_branches#Diff_branches_before_pushing_merge
** [Cosmin] Checked and did a small script for the failures rate, turns out we have 0.027 for beta-release.
* [Cosmin] Checked and did a small script for the failures rate, turns out we have 0.027 for beta-release.
* [Andreea] Bug 1046645 - Mixed content - verified, shipped in 32.0.1. Release notes: https://www.mozilla.org/en-US/firefox/32.0.1/releasenotes/
* [Henrik] Mozmill-CI has been upgraded to Mozmill Automation 2.0.7


= Blockers =
= Blockers =
* You can find all open blockers here: http://bit.ly/Tph0NY
* You can find all open blockers here: http://bit.ly/Tph0NY
* New blockers
* New blockers
** [07/10] - Bug 735184 - RFE: Create Pulse notifications for update channel activities (maybe in Q4)
** {{bug|1037084}} Testing TPS Move TPS test framework out of mozilla-central into its own repository
** [08/05] - Bug 980938 - Crash of Adobe Flash with protected mode enabled and clearing cookies [@ F2102588022] (waiting for feedback)
** [08/29] - Bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes (waiting for security review)
** [09/01] - Bug 911048 - [mozinstall] Add support to install Firefox via the stub installer (needs work done by Henrik)
** [09/01] - Bug 1038646 - Broken package dependencies when installing OpenJDK 7 on Ubuntu 12.04 machines (waiting for feedback)
** [09/01] - Bug 891288 - Create subdomains of mozqa with self-signed SSL certificates for all  supported versions versions (SSL3 - TLS 1.1) (waiting for feedback)
** [09/01] - Bug 1037084 - Move TPS test framework out of mozilla-central into its own repository (waiting for feedback)
** [09/03] - Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
** [09/04] - https://getsatisfaction.com/iriscouch/topics/since-a-couple-of-minutes-iriscouch-com-is-not-reachable-anymore?rfm=1#add_product_label (waiting for feedback)
*** Problem solved after around an hour last Friday, but so far no reply on the topic
** Bug 1065627 - Possible massive network issues for hosts in qa.scl3.mozilla.com on Sep 9th (09/10)
* Github blockers:
* Github blockers:
** Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358
** Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358


= Roundtable =
= Roundtable =
* TBD
* Task tracking tool: https://kanbanery.com/ or https://kanbanize.com
** This is used by some teams. Henrik will talk to others for more information
** Seems to have integration for Bugzilla and Github
** Not sure about license costs and if we have a company license yet


= Goals =
= Goals =
Line 54: Line 49:
== Mozmill-CI for testing all Locales (Andreea, Cosmin) ==
== Mozmill-CI for testing all Locales (Andreea, Cosmin) ==
* Current Status:
* Current Status:
** TBD
** Worked on the blacklist,  will add the PR tomorrow
* Planned for this week:
* Planned for this week:
** TBD
** Need to figure out how to best work with the jobs retention issue in order to not let it block us in landing the other patches
** https://github.com/mozilla/mozmill-ci/issues/487 - Update pulse script for Pulse Guardian


== Mozmill for Restart Stability (Henrik, Andrei) ==
== Mozmill for Restart Stability (Henrik, Andrei) ==
* Current Status:
* Current Status:
** TBD
** A script Cosmin run on latest beta release showed a 0.027% failure rate (we should check on which the failure rate should be based on: build vs individual tests
* Planned for this week:
* Planned for this week:
** TBD
** Lets try to finish off {{bug|972912}} so we can see not run tests
** Maybe we can also cover {{bug|794020}} for sane application disconnects


== Automation of TPS tests (Daniel, Mihaela) ==
== Automation of TPS tests (Daniel, Mihaela) ==
* Current Status:
* Current Status:
** TBD
** {{bug|1009441}}  - Add automated test to verify the UI and preferences of a signed in account
*** partially updated test and libraries based on review
*** blocked by {{bug|1005811}} - Update Mozmill tests for in-content preferences pane
** {{bug|1018931}} - Add automated test to verify that sync options specified at sign in are persisted after restart
*** waiting for feedback
 
* Planned for this week:
* Planned for this week:
** TBD
** Estabilish how exactly to proceed in {{bug|1009441}} so we can also update and work on the other tests


= Project Updates =
= Project Updates =
== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* TBD
* Released Mozmill v2.0.7 (incl automation scripts, and mozmill-environment) with e10s and OS X signing fixes included


== Mozmill Tests (Softvision) ==
== Mozmill Tests (Softvision) ==
* TBD
Closed:
** {{bug|1058025}} - Update Flash to latest version (i.e. 14.0.0.176)
** {{bug|1064281}} - Enhance selectors for the new about:privatebrowsing page


== TPS (Henrik, Cosmin) ==
== TPS (Henrik, Cosmin) ==
* TBD
* Investigated of how to move the tps extension out of mozilla-central


== WebRTC (Nils) ==
== WebRTC (Nils) ==
Line 87: Line 91:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
** TBD
** Fixed 4 github issues:
*** [coversheet] Finished jobs have to send a status email to the mailing list (#45) (#50)
*** [coversheet] Improve sending of status emails (#52)
*** [coversheet] Don't attach logs for successful builds and archive the logs for the rest (#54)
*** [mozmill-ci] Rename OSX 10.7 machines to OSX 10.10 (#479)
 


* Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/%ID%
* Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/I9OwYbJstRk


= Personal Status =
= Personal Status =
Line 102: Line 111:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}} [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)
* {{new|}} [Otilia and Andreea] to send a list of features for tracking tool
* {{new|}} [Cosmin] to investigate Discard logs after 3 days (we should get this in ASAP and monitor results) - maybe even check with IT to increase the disk space vailable on master to 100GB

Latest revision as of 15:41, 22 September 2014

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
  • Chair: Cosmin
  • Notes: Mihaela

Last Weeks Action Items

  • [DONE] [Cosmin] Update the bug about the plugin not working on 14.04 and work on the fix;
  • [ON TRACK] [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)

Highlights

Blockers

Roundtable

  • Task tracking tool: https://kanbanery.com/ or https://kanbanize.com
    • This is used by some teams. Henrik will talk to others for more information
    • Seems to have integration for Bugzilla and Github
    • Not sure about license costs and if we have a company license yet

Goals

Puppet for restarting CI Machines (Andrei, Henrik, Andreea)

  • Current Status:
    • TBD
  • Planned for this week:
    • TBD

Mozmill-CI for testing all Locales (Andreea, Cosmin)

  • Current Status:
    • Worked on the blacklist, will add the PR tomorrow
  • Planned for this week:

Mozmill for Restart Stability (Henrik, Andrei)

  • Current Status:
    • A script Cosmin run on latest beta release showed a 0.027% failure rate (we should check on which the failure rate should be based on: build vs individual tests
  • Planned for this week:
    • Lets try to finish off bug 972912 so we can see not run tests
    • Maybe we can also cover bug 794020 for sane application disconnects

Automation of TPS tests (Daniel, Mihaela)

  • Current Status:
    • bug 1009441 - Add automated test to verify the UI and preferences of a signed in account
      • partially updated test and libraries based on review
      • blocked by bug 1005811 - Update Mozmill tests for in-content preferences pane
    • bug 1018931 - Add automated test to verify that sync options specified at sign in are persisted after restart
      • waiting for feedback
  • Planned for this week:
    • Estabilish how exactly to proceed in bug 1009441 so we can also update and work on the other tests

Project Updates

Mozmill (Henrik)

  • Released Mozmill v2.0.7 (incl automation scripts, and mozmill-environment) with e10s and OS X signing fixes included

Mozmill Tests (Softvision)

Closed:

    • bug 1058025 - Update Flash to latest version (i.e. 14.0.0.176)
    • bug 1064281 - Enhance selectors for the new about:privatebrowsing page

TPS (Henrik, Cosmin)

  • Investigated of how to move the tps extension out of mozilla-central

WebRTC (Nils)

  • TBD

Softvision Updates

Desktop Automation

  • Goals progress:
    • Fixed 4 github issues:
      • [coversheet] Finished jobs have to send a status email to the mailing list (#45) (#50)
      • [coversheet] Improve sending of status emails (#52)
      • [coversheet] Don't attach logs for successful builds and archive the logs for the rest (#54)
      • [mozmill-ci] Rename OSX 10.7 machines to OSX 10.10 (#479)


Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [CARRY OVER] [Andrei] run all testruns on 800x600 see if there are any problems on linux (staging puppet box)
  • [NEW] [Otilia and Andreea] to send a list of features for tracking tool
  • [NEW] [Cosmin] to investigate Discard logs after 3 days (we should get this in ASAP and monitor results) - maybe even check with IT to increase the disk space vailable on master to 100GB
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Automation/Meetings/140915&oldid=1016939"