MozillaWiki

Auto-tools/Automation Development/Meetings/131021: Difference between revisions

< Auto-tools‎ | Automation Development‎ | Meetings
(Created page with "<small>previous meeting | Meetings | [[Auto-tools/Automation_Development/M...")
 
 
(29 intermediate revisions by 8 users not shown)
Line 7: Line 7:
* Attendees:  
* Attendees:  
** TBD
** TBD
* Chair: TBD
* Chair: Andrei
* Notes: TBD
* Notes: Mario


= Last Weeks Action Items =
= Last Weeks Action Items =
* {{done|}}%name%: %task%
* {{miss|}} Dave: present camera rig
* {{done|}} SV: to test the fix for httpd.js on 3 different platforms
* {{done|}} Henrik: update goals


= Highlights =
= Highlights =
* [%name%] %highlight%
* [henrik] Automation Development report – week 41 2013: http://www.hskupin.info/2013/10/17/automation-development-report-week-41-2013/
* [dave] Released b2gperf 0.11 https://pypi.python.org/pypi/b2gperf/0.11
* [henrik] Mozmill 1.5.24 released: http://www.hskupin.info/2013/10/16/mozmill-1-5-24-released/
* [henrik] Windows 8.1 machines (4x 32bit, 4x 64bit) are online (see bug 919618)
* [henrik] Updated team goals for Q4 2013: https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects
 
* New blockers, any updates?
* New blockers, any updates?
** %new blockers%
** Bug 916746 - System crash affecting all mm-win-81-64-* nodes (unknown cause yet)
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


= Roundtable =
= Roundtable =
* TBD
* [Andrei] Send mails for l10n failures
** Currently we don't receive any notifications for l10n testruns.
** Will it help us to be notified? To avoid spam, maybe just Failures.
* [dave] Handy suggestion from Jarek on testing with a local dumb SMTP server in Python: https://docs.djangoproject.com/en/dev/topics/email/#testing-email-sending


= Goals Overview =
= Goals Overview =
Line 28: Line 38:


== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* Goals progress:
* No progress made yet for Mozmill 2.0.1 nor 2.1
* TBD
* Mozmill CI
** A really bad crash is affecting us on production which happened twice the last 3 days. See https://github.com/mozilla/mozmill-ci/issues/314
** Windows 8.1 64 bit nodes are crashy like hell -> most likely we will get some real machines for now
** Long duration for sending emails -> we are working on the investigation
** New machines for all remaining platforms will come soon too once proxy settings for mozqa.com have been updated


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
* Marionette client 0.6.0 was released last week with breaking changes, so we had to recover from that
* Some progress on flashing issues with Hamachi, but we're still not 100% reliable yet
* Nothing else to update on really, perhaps we should drop this section?


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* No updates this week
* TBD
 
== AWSY (Rob) ==
* Continuing development on AWSY test driver
* Improvements to the orangutan test itself to recover from app crashes
* Working on local Jenkins jobs
* VMs are now available; one will be jenkins master and others test nodes


= Softvision Updates =
= Softvision Updates =
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress: Metro work in progress
* TBD
* We'll do Infrastructure duty starting this week
* Taking care of the merge in {{bug|928124}}
 
* Resolved Fixed:
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org
*** {{bug|872444}} - Add teardown() method in tests that are missing it, in order to clean up
*** {{bug|923098}} - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
*** {{bug|912363}} - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
*** {{bug|898568}} - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
 
* Working on:
** Andreea
*** {{bug|927397}} - Update repository structure by dividing it in application types
*** [mozmill-automation] Add metro testrun and support custom applications
*** [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code
*** {{bug|880417}} - Create user interface shared module for metro
** Cosmin
*** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog
*** {{bug|922967}} - Test failure "Identity is unknown - 'verifiedIdentity' should equal 'unknownIdentity'" in /testSecurity/testSecurityNotification.js
*** {{bug|915563}} - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
** Mario
*** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing
*** {{bug|927361}} - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'"
*** {{bug|905942}} - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
*** {{bug|851502}} - Create an Endurance test to measure html5 video memory use
** Andrei
*** {{bug|922995}} - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
*** {{bug|853865}} - Remove node.hasAttributes() code from "lib/localization.js"
*** {{bug|901946}} - zh-TW builds on Linux wrongly calculate Autocomplete Popup height
*** {{bug|905963}} - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
*** [blocked]{{bug|917771}} - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>
|-
| {{bug|927397}} || Review || Henrik/Dave/Andrei || Andreea || Update repository structure by dividing it in application types
|-
| [https://github.com/mozilla/mozmill-automation/pull/32 Pull Request]|| Review || Henrik || Andreea || Update automation script should exit with a non-zero exit code if unable to get update channel
|-
| {{bug|922995}} || Feedback || Henrik/Dave || Andrei || Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
|-
| {{bug|901946}} || Needinfo || Jared Wein [:jaws]  || Andrei || zh-TW builds on Linux wrongly calculate Autocomplete Popup height
|-
|}
 
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* [https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndHVvZFVudjRPemROeGVSUkFnc3h6Unc&usp=drive_web#gid=0 Robocop bugs Backlog]
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|926394}} - [Robocop] Create a new test for Top Sites
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
** {{Bug|927578}} - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added
* Bugs awaiting integration:
** {{Bug|927394}} - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present
** {{Bug|927582}} - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication
** {{Bug|915350}} - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
* Bugs recently integrated:
** {{Bug|927296}} - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException
** {{Bug|926310}} - Robocop: Add test for 'Reader Mode' feature
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* '''Issues'''
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in - was backed out due to intermittent fails. Working on a new patch.


= Personal Status =
= Personal Status =
For the personal status please check the weekly status updates:
For the personal status please check the weekly status updates:
* [https://ateam.etherpad.mozilla.org/mozauto-130107 130107 - 130113]
* [https://ateam.etherpad.mozilla.org/mozauto-131021 131021 - 131025]


= Meeting Notes =
= Meeting Notes =
The meeting notes for this meeting can be read in the following etherpad:  
The meeting notes for this meeting can be read in the following etherpad:  
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20130107
* https://etherpad.mozilla.org/automation-developer-meeting-20131021


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}}[Dave] present camera rig
* {{done|}}[Henrik] We should stop sending [SUCCESS] mails to prevent spam (should we also remove [FIXED] mails?) 
* {{done|}}[Dave] Add Eideticker to Q4 goals
* {{done|}}[Dave] Replace Gaia UI with Eideticker CI in the Project Updates section of the meeting template

Latest revision as of 16:50, 4 November 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andrei
  • Notes: Mario

Last Weeks Action Items

  • [MISSED] Dave: present camera rig
  • [DONE] SV: to test the fix for httpd.js on 3 different platforms
  • [DONE] Henrik: update goals

Highlights

  • New blockers, any updates?
    • Bug 916746 - System crash affecting all mm-win-81-64-* nodes (unknown cause yet)
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Goals Overview

Project Updates

Mozmill (Henrik)

  • No progress made yet for Mozmill 2.0.1 nor 2.1
  • Mozmill CI
    • A really bad crash is affecting us on production which happened twice the last 3 days. See https://github.com/mozilla/mozmill-ci/issues/314
    • Windows 8.1 64 bit nodes are crashy like hell -> most likely we will get some real machines for now
    • Long duration for sending emails -> we are working on the investigation
    • New machines for all remaining platforms will come soon too once proxy settings for mozqa.com have been updated

Gaia UI (Dave)

  • Goals progress:
  • Marionette client 0.6.0 was released last week with breaking changes, so we had to recover from that
  • Some progress on flashing issues with Hamachi, but we're still not 100% reliable yet
  • Nothing else to update on really, perhaps we should drop this section?

Games Benchmarking (Rob, Joel, BC)

  • No updates this week

AWSY (Rob)

  • Continuing development on AWSY test driver
  • Improvements to the orangutan test itself to recover from app crashes
  • Working on local Jenkins jobs
  • VMs are now available; one will be jenkins master and others test nodes

Softvision Updates

Desktop Automation

  • Goals progress: Metro work in progress
  • We'll do Infrastructure duty starting this week
  • Taking care of the merge in bug 928124
  • Resolved Fixed:
      • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
      • bug 872444 - Add teardown() method in tests that are missing it, in order to clean up
      • bug 923098 - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
      • bug 912363 - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
      • bug 898568 - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
  • Working on:
    • Andreea
      • bug 927397 - Update repository structure by dividing it in application types
      • [mozmill-automation] Add metro testrun and support custom applications
      • [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code
      • bug 880417 - Create user interface shared module for metro
    • Cosmin
      • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
      • bug 922967 - Test failure "Identity is unknown - 'verifiedIdentity' should equal 'unknownIdentity'" in /testSecurity/testSecurityNotification.js
      • bug 915563 - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
    • Mario
      • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
      • bug 927361 - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'"
      • bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
      • bug 851502 - Create an Endurance test to measure html5 video memory use
    • Andrei
      • bug 922995 - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
      • bug 853865 - Remove node.hasAttributes() code from "lib/localization.js"
      • bug 901946 - zh-TW builds on Linux wrongly calculate Autocomplete Popup height
      • bug 905963 - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
      • [blocked]bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 927397 Review Henrik/Dave/Andrei Andreea Update repository structure by dividing it in application types
Pull Request Review Henrik Andreea Update automation script should exit with a non-zero exit code if unable to get update channel
bug 922995 Feedback Henrik/Dave Andrei Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
bug 901946 Needinfo Jared Wein [:jaws] Andrei zh-TW builds on Linux wrongly calculate Autocomplete Popup height

Mobile (Robocop)

  • Progress on Robocop Automation
  • Robocop bugs Backlog
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 836341 - Robocop: Add test for "Clear download history"
    • bug 926394 - [Robocop] Create a new test for Top Sites
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
    • bug 927578 - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added
  • Bugs awaiting integration:
    • bug 927394 - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present
    • bug 927582 - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication
    • bug 915350 - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
  • Bugs recently integrated:
    • bug 927296 - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException
    • bug 926310 - Robocop: Add test for 'Reader Mode' feature
    • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
    • bug 888277 - Robocop: Add test for Private Browsing
  • Issues
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in - was backed out due to intermittent fails. Working on a new patch.

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [CARRY OVER] [Dave] present camera rig
  • [DONE] [Henrik] We should stop sending [SUCCESS] mails to prevent spam (should we also remove [FIXED] mails?)
  • [DONE] [Dave] Add Eideticker to Q4 goals
  • [DONE] [Dave] Replace Gaia UI with Eideticker CI in the Project Updates section of the meeting template
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Automation_Development/Meetings/131021&oldid=750146"