QA/Automation/Meetings/141124

From MozillaWiki
Jump to navigation Jump to search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
  • Chair: Andrei
  • Notes: Teodor

Last Weeks Action Items

  • [DONE] [Henrik] follow up on bug 1083166 for network timeouts
    • I triggered the networking team and they will work with Mark to get some more details
  • [NEW] [Andreea] Check in-qa-testsuite flags for proxy/network tests
    • Didn't had time for these yet, will start this week as Florin mentioned they don't cover these so would be good to have
  • [DONE] [Mihaela] Check with the team from AWSY if they have detected our endurance memory increased consumption
    • they had an increase but a few days earlier
    • could not reproduce the increase locally, on staging nor on production
  • [NEW] [Henrik] goals wiki page
  • [DONE] [Henrik] check if we can shutdown the old tps system
    • It's hard to see if there are broken runs with failures given that we do not really log locally on the machine. Also the mailing list for failures is the same as the general one, so I do not see why emails should not come through. Further we would have to implement Pulse Guardian, which is not a good investment of our time

Highlights

  • [Henrik] Mozmill CI got updates: https://github.com/mozilla/mozmill-ci/compare/fed024694316...9ed1b907f73d (dummy nodes, Jenkins 1.580.1, xshell, pulse guardian, Ubuntu 14.04)
    • live on production
    • we updated all machines today => with the change from mm-ci-master to mm-ci-production all testruns were failing to properly finish
  • [SV] Last week in the project for Andrei and we'd like to introduce Daniela, she's been in ramp-up for a while now

Blockers

  • List of blockers (http://bit.ly/Tph0NY):
    • [07/10] - bug 735184 - RFE: Create Pulse notifications for update channel activities (maybe in Q4)
    • [09/01] - bug 1038646 - Broken package dependencies when installing OpenJDK 7 on Ubuntu 12.04 machines (maybe wontfix because we want to get rid of it)
      • Most likely we'll rely on openjdk, will be installed by default on linux
      • We don't use java on our mozmill tests, so we don't need oracle versions
    • [09/03] - bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
    • [10/29] - bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes (waiting setting up network ACLs)
    • [10/29] - bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (depends on bug 1057892)
      • Waiting for the push on production for the database, hopefully by today/tomorrow will be landed and the failures will be fixed
    • [11/05] - bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals (maybe also causing test failures when loading web pages)
    • [11/07] - bug 1094272 - [pulsetranslator] With SSL enabled publishing of normalized messages get stuck
    • [11/11] - bug 1096367 - move aurora updates onto cdn temporarily
      • We might need to find a solution here, it happened only once, in one day, but it might happen again


Contributor Spotlight

  • TBD

Roundtable

  • TBD

Goals

Framework and Tools (Henrik)

Make Marionette ready for Mozmill tests

  • Reorganized the current structure of the green-light tests repository
  • Gave feedback regarding current implementations, which will be discussed later today

Locale Rotation for Aurora builds in Mozmill-CI

  • No update

Turn on PuppetAgain for Mozmill CI and TPS CI

  • No update

Improvements to Testday bot [stretched]

  • No update

Test Automation (Softvision)

Creation of automated tests for important regressions

  • New tests in work:
    • bug 941477 - Create a remote Mozmill test for the 'Get more Search Engines' feature | Blocked by New Beta Search UI
    • bug 1088638 - Add automated test to install, disable, enable and remove services
    • bug 1088534 - Add a test to verify that basic Firefox operations work ok with the enabled complete theme or persona
    • bug 1098351 - Add new automated test for "Override mixed script content blocking"
    • bug 1088561 - Add automated test for plugins in different states

Project Updates

Mozmill (Henrik)

  • Fixed remaining proxy issues on Ubuntu 14.04 machines
  • Finally enrolled all the latest changes from staging to production (Jenkins 1.580.1, Ubuntu 14.04, ...)

Mozmill Tests (Softvision)

  • Will work this sprint on the search library and update the tests as we disabled them on Friday with the changes in beta
  • Merge will happen tonight, Andreea tested today, linux and osx are fine, windows will be done soon
  • Fixed:
    • bug 987612 - The restart functional tests for 'Blocklist Extension' shouldn't fail with no network connection
    • bug 1099123 - [en-US] Test failures in /testSecurity/testSSLDisabledErrorPage.js
  • In Progress:
    • bug 1055453 - Add new ui module for the page-info window
    • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation

TPS (Henrik)

  • Coversheet is running through Pulse Guardian now
  • Have to find a way to check latest server-side changes for signIn() problem against the staging server

WebRTC (Nils, Syd)

  • TBD

Softvision Updates

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] %name%: %task%