Auto-tools/Automation Development/Meetings/131014: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(23 intermediate revisions by 7 users not shown)
Line 1: Line 1:
<small>[[Auto-tools/Automation_Development/Meetings/130101|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/131231|next meeting &raquo;]]</small>
<small>[[Auto-tools/Automation_Development/Meetings/130930|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/131021|next meeting &raquo;]]</small>


= Dial in =
= Dial in =
Line 14: Line 14:
* {{done|}} Andrei: create a full proposal for metro tests, mail it to the mailing list, open bugs for the tasks needed, create a new metro tracking bug
* {{done|}} Andrei: create a full proposal for metro tests, mail it to the mailing list, open bugs for the tasks needed, create a new metro tracking bug
* {{done|}} Mario: amend template: take out WEBRTC and WebAPI, and insert Mozmill as a project
* {{done|}} Mario: amend template: take out WEBRTC and WebAPI, and insert Mozmill as a project
* {{done|}} Dave: We need a 20D DnD dice to roll for the Chair and Notes taker
 
= Highlights =
= Highlights =
* [%name%] %highlight%
* [henrik] [http://www.hskupin.info/2013/10/10/automation-development-report-week-40-2013/ Automation Development report – week 40 2013]
* [henrik] [https://groups.google.com/forum/#!topic/mozilla.dev.automation/iHsCRJjKJUM New OS X 10.9 machines, 4 nodes per platform, and system upgrades]
* [henrik] Say HI to our new contributor [https://mozillians.org/en-US/u/kjozwiak/ Kamil Kjozwiak]
* New blockers, any updates?
* New blockers, any updates?
** %new blockers%
** %new blockers%
Line 30: Line 32:


== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* Goals progress:
* {{bug|922995}} troubles us with Mozmill 2.0. Something in the Firefox window handling code changed in Aurora and broken our Mozmill restart logic.
* TBD
* The fix for httpd.js landed so it no longer takes about 7s to shutdown the process. No big impact for Mozmill 2.0, but I really wonder if we should get a 1.5.23 version out. That will improve our runs drastically and we would be closer to our goal. Also not sure when we will have the isuse for Mozmill 2.0 fixed.
* CI
** 4 nodes per platform are coming up soon (OS X already done including 10.9)
** Windows 8.1 nodes are coming up in the next days


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
* b2gperf issues are finally getting resolved thanks to bkelly's investigation on {{bug|921194}}
* released gaiatest 0.17
** https://pypi.python.org/pypi/gaiatest/0.17


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
Line 44: Line 51:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
* TBD
* Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
* Resolved Fixed:
*** {{bug|856541}} - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
*** {{bug|924797}} - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'" in testAddons/testPluginDisableAffectsAboutPlugins.js
*** {{bug|925272}} - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
 
* Working on:
** Andreea
*** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|800872}} - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
*** {{bug|758187}} -  Write a new mozmill test for checking location sharing
*** {{bug|925346}} - Test failure "Geolocation position has been found" in /testGeolocation/testShareLocation.js
 
** Cosmin
*** {{bug|890181}} - Test failure "Tab has been closed" when trying to close a tab with close button
*** {{bug|898568}} - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
*** {{bug|599290}} -  Update SoftwareUpdateAPI to support complete relocation to the about dialog
*** {{bug|915563}} - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
 
** Mario
*** {{bug|872444}} - Add teardown() method in tests that are missing it, in order to clean up
*** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org
*** {{bug|923071}} - Test failure "Scroll arrows are visible after a couple tabs have been opened"
*** {{bug|923098}} - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
 
** Andrei
*** {{bug|922995}} - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
|-
| [https://github.com/mozilla/mozmill-automation/pull/32 Pull Request]|| Review || Henrik/Dave || Andreea || Update automation script should exit with a non-zero exit code if unable to get update channel
|-
|}
 
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* [https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndHVvZFVudjRPemROeGVSUkFnc3h6Unc&usp=drive_web#gid=0 Robocop bugs Backlog]
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|926394}} - [Robocop] Create a new test for Top Sites
* Bugs awaiting review:
** {{Bug|926310}} - Robocop: Add test for 'Reader Mode' feature
* Bugs awaiting integration:
** {{Bug|915350}} - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
* Bugs recently integrated:
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* '''Issues'''


= Personal Status =
= Personal Status =
For the personal status please check the weekly status updates:
For the personal status please check the weekly status updates:
* [https://ateam.etherpad.mozilla.org/mozauto-130107 130107 - 130113]
* [https://ateam.etherpad.mozilla.org/mozauto-131014 131014 - 131020]


= Meeting Notes =
= Meeting Notes =
The meeting notes for this meeting can be read in the following etherpad:  
The meeting notes for this meeting can be read in the following etherpad:  
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20130107
* https://etherpad.mozilla.org/automation-developer-meeting-20131014


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}} Dave: present camera rig
* {{new|}} SV: to test the fix for httpd.js on 3 different platforms
* {{new|}} Henrik: update goals

Latest revision as of 15:20, 21 October 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Cosmin
  • Notes: Adrian

Last Weeks Action Items

  • [DONE] Henrik: Check bug 874891 to see if it can be closed
  • [DONE] Andrei: create a full proposal for metro tests, mail it to the mailing list, open bugs for the tasks needed, create a new metro tracking bug
  • [DONE] Mario: amend template: take out WEBRTC and WebAPI, and insert Mozmill as a project

Highlights

Roundtable

  • [dave] What were the highlights from the Summit?

Goals Overview

Project Updates

Mozmill (Henrik)

  • bug 922995 troubles us with Mozmill 2.0. Something in the Firefox window handling code changed in Aurora and broken our Mozmill restart logic.
  • The fix for httpd.js landed so it no longer takes about 7s to shutdown the process. No big impact for Mozmill 2.0, but I really wonder if we should get a 1.5.23 version out. That will improve our runs drastically and we would be closer to our goal. Also not sure when we will have the isuse for Mozmill 2.0 fixed.
  • CI
    • 4 nodes per platform are coming up soon (OS X already done including 10.9)
    • Windows 8.1 nodes are coming up in the next days

Gaia UI (Dave)

Games Benchmarking (Rob, Joel, BC)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Goals progress:
  • Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
  • Resolved Fixed:
      • bug 856541 - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
      • bug 924797 - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'" in testAddons/testPluginDisableAffectsAboutPlugins.js
      • bug 925272 - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
  • Working on:
    • Andreea
      • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
      • bug 880417 - Create user interface shared module for metro
      • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
      • bug 758187 - Write a new mozmill test for checking location sharing
      • bug 925346 - Test failure "Geolocation position has been found" in /testGeolocation/testShareLocation.js
    • Cosmin
      • bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
      • bug 898568 - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
      • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
      • bug 915563 - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
    • Mario
      • bug 872444 - Add teardown() method in tests that are missing it, in order to clean up
      • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
      • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
      • bug 923071 - Test failure "Scroll arrows are visible after a couple tabs have been opened"
      • bug 923098 - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
    • Andrei
      • bug 922995 - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
Pull Request Review Henrik/Dave Andreea Update automation script should exit with a non-zero exit code if unable to get update channel

Mobile (Robocop)

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] Dave: present camera rig
  • [NEW] SV: to test the fix for httpd.js on 3 different platforms
  • [NEW] Henrik: update goals
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Automation_Development/Meetings/131014&oldid=733840"