QA/Automation/Meetings/140623: Difference between revisions

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
 
(16 intermediate revisions by 7 users not shown)
Line 5: Line 5:


= General =
= General =
* Attendees:
* Attendees: Daniel, Cosmin, Andreea, Henrik, Otilia, Andrei, Mihaela, Marc, Nils, Syd
* Chair: Cosmin
* Chair: Cosmin
* Notes: Andrei
* Notes: Andrei
Line 14: Line 14:


= Highlights =
= Highlights =
* [henrik] Mozmill-CI production got new features: https://github.com/mozilla/mozmill-ci/compare/7965a0a2b0f0...ddfa59c0bfbb
* [henrik] One more CPU has been added to mm-ci-master.qa.scl3.mozilla.com (Bug 1024549) - it should have become smoother now under high load
* [henrik] The new Ubuntu 14.04 nodes for Mozmill CI in qa.scl3.mozilla.com have been setup (Bug 999435)
* [henrik] The new Ubuntu 14.04 nodes for Mozmill CI in qa.scl3.mozilla.com have been setup (Bug 999435)
* [henrik] TPS-CI production master is up at http://tps-ci-production.qa.scl3.mozilla.com:8080/
* [henrik] TPS-CI production master is up at http://tps-ci-production.qa.scl3.mozilla.com:8080/
* New blockers:
** <strike>{{bug|957852}} - Add files and cronjob for mciconf on mozqa1.qa.scl3 (no cron job is running)</strike>
** <strike>{{bug|1024549}} - Add one more Core (CPU) to mm-ci-master.qa.scl3.mozilla.com</strike>
** {{bug|999435}} - Setup new Ubuntu 14.04 nodes for Mozmill CI in qa.scl3.mozilla.com


Github blockers:
Github blockers:
Line 37: Line 30:
== Puppet for Mozmill CI (Henrik, Andreea, Andrei) ==
== Puppet for Mozmill CI (Henrik, Andreea, Andrei) ==
* Current goal status:
* Current goal status:
** TBD
** Patch for adding the mozauto user and enabling the X environmnet has been landed for Ubuntu. A kickstart works like a charm and the machine directly boots into our os wide environment. Testing and additions for OS X upcoming.
** Started work on the Java and Flash player updates.
** Henrik will also concentrate on other requirements for Jenkins machines (git, virtualenv, pip package mirroring, ...)
* Notes
* Notes
** TBD
** TBD
Line 43: Line 38:
== TPS continuous integration (Henrik, Cosmin) ==
== TPS continuous integration (Henrik, Cosmin) ==
* Current goal status:
* Current goal status:
** TBD
** Initial Jenkins setup has been done including work for plugins and available nodes
** Closed the following issues:
***[https://github.com/mozilla/coversheet/issues/22 Add plain Jenkins support #22]
***[https://github.com/mozilla/coversheet/pull/26 Add necessary Jenkins plugins #26]
***[https://github.com/mozilla/coversheet/issues/27 Add TPS-CI production nodes #27]
** Next is the landing of the required jobs for tps testing, the pulse script, implementing the account creation
* Notes
* Notes
** TBD
** TBD
Line 55: Line 55:
== Automation Trainings (Andreea, Cosmin) ==
== Automation Trainings (Andreea, Cosmin) ==
* Current goal status:
* Current goal status:
** TBD
** Completed
* Notes
* Notes
** TBD
** Received feedback, we will try to accommodate the sessions in different week days and to follow up more with the contributors
** Also we might want to consider live sessions


== Mozmill for Marionette (Andrei, Andreea) ==
== Mozmill for Marionette (Andrei, Andreea) ==
* Current goal status:
* Current goal status:
** TBD
** {{bug|1023790}} - Enhance manifestparser for manifest files to provide a "parent" link
*** There's a problem I'm now facing with inherited DEFAULT values. Since we're passing a path for server-root, the path is relative to the master manifest.ini file... not sure how to solve this.
** {{bug|754847}} - Replace local httpd.js web server with wptserve
*** There is a functional patch, but we're blocked by {{bug|1023790}}. We can skip this dependency and for dev purposes always pass in --server-root=%path% as a cli option.
** {{bug|1028856}} - Prepare mozmill-tests for the new webserver
*** This will require relative small changes (mostly set the server root on the main manifest file) + small changes in a few tests (where the folder was declared differently).
* Notes
* Notes
** TBD
** TBD
Line 67: Line 73:
== Others ==
== Others ==
* Mozmill (Henrik)
* Mozmill (Henrik)
** TBD
** No updates
* WebRTC (Nils)
* WebRTC (Nils)
** TBD
** B2G tests are hopefully moving from virtual machines to real hardware machines to improve problems related to the speed of the emulator on the virtual machines
** We will hopefully soon have support for including loopback in ICE for testing purpose
** It is confirmed now that IPC/e10s code occasionally hands out ports twice


= Softvision Updates =
= Softvision Updates =
Line 77: Line 85:
* Resolved Fixed:
* Resolved Fixed:
** {{bug|?}} - ADD DESCRIPTION HERE
** {{bug|?}} - ADD DESCRIPTION HERE
 
***[TPS] [https://github.com/mozilla/coversheet/issues/22 Add plain Jenkins support #22]
* Working on:
* Working on:
** Andreea
** Andreea
***
*** {{bug|1008880}} - Create module for PuppetAgain to install Java
*** Create a script to download a requested version of Java and Flash
*** {{bug|999372}} - Test failure "[object Object] - got 'false'" in /restartTests/testPreferences_masterPassword/test2.js
*** {{bug|998253}} - Test failure "The tab with index '1' has been selected" in "/testSearch/testSearchSelection.js"
*** {{bug|981641}} - Firefox does not always create or write content into an .extra file when it crashes
** Andrei
** Andrei
***
***{{bug|754847}} - Replace local httpd.js web server with mozhttpd
***{{bug|1023790}} - Enhance manifestparser for manifest files to provide a "parent"
***{{bug|1028856}} - Prepare mozmill-tests for the new webserver
** Cosmin
** Cosmin
***
***
** Daniel
** Daniel
***
*** DUTY
*** {{bug|1008913}} - Add test to verify geolocation sharing option "Always Share Location"
*** {{bug|1021149}} - [OMTC] crash in mozalloc_abort(char const* const) ...
*** {{bug|1020119}} - Update mozmill-ci machines to Java 7 update 60,  latest Flash and MS security updates on related node
** Mihaela
** Mihaela
*** endurance results triage - no new memory spikes
*** Endurance results triage - no new memory spikes
*** Work on tests:
*** Work on tests:
**** {{bug|1025849}} Create Mozmill Test for checking EV certificate status after a restart
**** {{bug|1025849}} Create Mozmill Test for checking EV certificate status after a restart
Line 105: Line 122:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}} [Marc] try getting feedback from RelEng about Q3 update goal
* {{new|}} [everyone] check the TPS > mozmill feedback request from Cosmin
* {{ok|}} [Daniel, Mihaela]: Followup with the shortcut tests, to find the remaining ones

Latest revision as of 09:40, 24 June 2014

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Daniel, Cosmin, Andreea, Henrik, Otilia, Andrei, Mihaela, Marc, Nils, Syd
  • Chair: Cosmin
  • Notes: Andrei

Last Weeks Action Items

  • [DONE] [Cosmin]: Prepare a proposal for the TPS libraries needed from our mozmill-tests repository
  • [ON TRACK] [Daniel, Mihaela]: Followup with the shortcut tests, to find the remaining ones

Highlights

Github blockers: Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358

Roundtable

  • TBD

Goals Overview

Project Updates

Puppet for Mozmill CI (Henrik, Andreea, Andrei)

  • Current goal status:
    • Patch for adding the mozauto user and enabling the X environmnet has been landed for Ubuntu. A kickstart works like a charm and the machine directly boots into our os wide environment. Testing and additions for OS X upcoming.
    • Started work on the Java and Flash player updates.
    • Henrik will also concentrate on other requirements for Jenkins machines (git, virtualenv, pip package mirroring, ...)
  • Notes
    • TBD

TPS continuous integration (Henrik, Cosmin)

Automation of important tests for Desktop QA (Daniel, Mihaela)

  • Current goal status:
    • Geolocation tests are under review
  • Notes
    • TPS tests were reprioritized and scheduled for Q3

Automation Trainings (Andreea, Cosmin)

  • Current goal status:
    • Completed
  • Notes
    • Received feedback, we will try to accommodate the sessions in different week days and to follow up more with the contributors
    • Also we might want to consider live sessions

Mozmill for Marionette (Andrei, Andreea)

  • Current goal status:
    • bug 1023790 - Enhance manifestparser for manifest files to provide a "parent" link
      • There's a problem I'm now facing with inherited DEFAULT values. Since we're passing a path for server-root, the path is relative to the master manifest.ini file... not sure how to solve this.
    • bug 754847 - Replace local httpd.js web server with wptserve
      • There is a functional patch, but we're blocked by bug 1023790. We can skip this dependency and for dev purposes always pass in --server-root=%path% as a cli option.
    • bug 1028856 - Prepare mozmill-tests for the new webserver
      • This will require relative small changes (mostly set the server root on the main manifest file) + small changes in a few tests (where the folder was declared differently).
  • Notes
    • TBD

Others

  • Mozmill (Henrik)
    • No updates
  • WebRTC (Nils)
    • B2G tests are hopefully moving from virtual machines to real hardware machines to improve problems related to the speed of the emulator on the virtual machines
    • We will hopefully soon have support for including loopback in ICE for testing purpose
    • It is confirmed now that IPC/e10s code occasionally hands out ports twice

Softvision Updates

Desktop Automation

  • Goals progress:
  • Resolved Fixed:
  • Working on:
    • Andreea
      • bug 1008880 - Create module for PuppetAgain to install Java
      • Create a script to download a requested version of Java and Flash
      • bug 999372 - Test failure "[object Object] - got 'false'" in /restartTests/testPreferences_masterPassword/test2.js
      • bug 998253 - Test failure "The tab with index '1' has been selected" in "/testSearch/testSearchSelection.js"
      • bug 981641 - Firefox does not always create or write content into an .extra file when it crashes
    • Andrei
      • bug 754847 - Replace local httpd.js web server with mozhttpd
      • bug 1023790 - Enhance manifestparser for manifest files to provide a "parent"
      • bug 1028856 - Prepare mozmill-tests for the new webserver
    • Cosmin
    • Daniel
      • DUTY
      • bug 1008913 - Add test to verify geolocation sharing option "Always Share Location"
      • bug 1021149 - [OMTC] crash in mozalloc_abort(char const* const) ...
      • bug 1020119 - Update mozmill-ci machines to Java 7 update 60, latest Flash and MS security updates on related node
    • Mihaela
      • Endurance results triage - no new memory spikes
      • Work on tests:
        • bug 1025849 Create Mozmill Test for checking EV certificate status after a restart
        • bug 1009441 Add automated test to verify the UI and preferences of a signed in account
        • bug 1008941 Add test to verify dismissing the geolocation sharing hanger

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] [Marc] try getting feedback from RelEng about Q3 update goal
  • [NEW] [everyone] check the TPS > mozmill feedback request from Cosmin
  • [ON TRACK] [Daniel, Mihaela]: Followup with the shortcut tests, to find the remaining ones