Auto-tools/Automation Development/Meetings/131028: Difference between revisions
< Auto-tools | Automation Development | Meetings
AndreeaMatei (talk | contribs) |
|||
(14 intermediate revisions by 8 users not shown) | |||
Line 5: | Line 5: | ||
= General = | = General = | ||
* Attendees: | * Attendees: Andrei, Andreea, Rob, Anthony, Dave, Henrik, Adrian, Cosmin, Mario, Otilia | ||
** TBD | ** TBD | ||
* Chair: | * Chair: <strike>Henrik</strike> Need a volunteer! - Andrei | ||
* Notes: | * Notes: Andreea | ||
= Last Weeks Action Items = | = Last Weeks Action Items = | ||
Line 23: | Line 23: | ||
* [henrik] No more crashes of the Win 8.1 64bit nodes due to VMWare vSphere problems (see {{bug|916746}}) | * [henrik] No more crashes of the Win 8.1 64bit nodes due to VMWare vSphere problems (see {{bug|916746}}) | ||
* [dave] Hacked on a [http://davehunt.github.io/mciconf/app/ Mozmill CI configuration generator] during MozFest | * [dave] Hacked on a [http://davehunt.github.io/mciconf/app/ Mozmill CI configuration generator] during MozFest | ||
* [Adrian] I will be leaving Softvision and the Mozilla project. Last day November 4th. Ioana Chiorean (Firefox Mobile Team Lead) to join this meeting at first and the team will decide on a member to join weekly. | |||
* New blockers, any updates? | * New blockers, any updates? | ||
Line 37: | Line 38: | ||
== Mozmill (Henrik) == | == Mozmill (Henrik) == | ||
* | * Cosmin found the fix for {{bug|922995}} which let Mozmill 2.0 to not execute some of our restart tests | ||
* | * We should be able to release Mozmill 2.0.1 ({{bug|931828}}) later this week | ||
* A couple of addon related features are broken in mozprofile and need fixes for Mozmill 2.0 | |||
* Our [https://developer.mozilla.org/en-US/docs/Mozmill_Tests#Installing_Mozmill documentation on MDN] mentions mozmill-env now! | |||
* Mozmill CI | |||
** The crashes of the Windows 8.1 64 bit machines have been fixed | |||
** We have 4 enabled nodes per platform now | |||
** Way faster processing of jobs due to the cancellation of success emails | |||
** The [https://github.com/mozilla/mozmill-ci/pull/338 patch] to let us execute tests for builds from project branches will land soon | |||
== Eideticker CI (Dave) == | == Eideticker CI (Dave) == | ||
* Goals progress: | * Goals progress: | ||
* Initial working version has been running since last week | * Initial working version has been running since last week | ||
** [http://people.mozilla.org/~dhunt/eideticker-ci-dashboard/ Temporary dashboards] | |||
** [https://wiki.mozilla.org/Project_Eideticker/Hardware#Eideticker_camera_setup Eideticker camera setup] | |||
== Games Benchmarking (Rob, Joel, BC) == | == Games Benchmarking (Rob, Joel, BC) == | ||
* | * No updates this week | ||
* | |||
== AWSY (Rob) == | |||
* Jenkins job running on my local test box | |||
* Problem grabbing large numbers of about memory logs from the emulator ({{bug|931198}}) | |||
* Next step: Setup jenkins on the production VMs | |||
= Softvision Updates = | = Softvision Updates = | ||
== Desktop Automation == | == Desktop Automation == | ||
* Goals progress: | * Goals progress: Metro work in progress | ||
* | * Cosmin found the cause for bug {{bug|922995}} and hopefully we'll have 2.0 back in production soon | ||
* Resolved Fixed: | |||
***{{bug|925346}} - Test failure "Geolocation position has been found" in /testGeolocation/testShareLocation.js | |||
***{{bug|930959}} - Increase the timeout for retrieving the geolocation | |||
* Working on: | |||
** Andreea | |||
*** [mozmill-automation] Add metro testrun and support custom applications | |||
*** [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code | |||
*** {{bug|927397}} - Update repository structure by dividing it in application types | |||
*** {{bug|880417}} - Create user interface shared module for metro | |||
** Cosmin | |||
***{{bug|922995}} - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined) | |||
***{{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog | |||
***{{bug|898568}} - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines | |||
** Mario | |||
*** {{bug|851502}} - Create an Endurance test to measure html5 video memory use | |||
*** {{bug|931715}} - Test failure "The add-on has been correctly installed - got 'false'" in /restartTests/testInstallAddonWithoutEULA/test1.js | |||
*** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing | |||
** Andrei | |||
*** buildmaster - tests and infrastructure | |||
*** {{bug|928124}} - Migrate Mozmill Tests for Firefox 25 | |||
*** {{bug|908649}} - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation | |||
{| border="1" cellpadding="2" align="center" | |||
|+<b> Waiting for review/Feedback/Need info</b> | |||
| <b>Bug number</b> || <b>Status</b> || <b>Requestee</b> || <b>Requester</b> || <b>Bug Subject</b> | |||
|- | |||
| {{bug|901946}} || Needinfo || Jared Wein [:jaws] || Andrei || zh-TW builds on Linux wrongly calculate Autocomplete Popup height | |||
|- | |||
|} | |||
== Mobile (Robocop) == | == Mobile (Robocop) == | ||
* | * Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation] | ||
* | * [https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndHVvZFVudjRPemROeGVSUkFnc3h6Unc&usp=drive_web#gid=0 Robocop bugs Backlog] | ||
* Bugs with work in progress: | |||
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data' | |||
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature | |||
** {{Bug|836341}} - Robocop: Add test for "Clear download history" | |||
** {{Bug|926394}} - [Robocop] Create a new test for Top Sites | |||
** {{Bug|927578}} - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added | |||
* Bugs with patches awaiting review: | |||
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in | |||
* Bugs awaiting integration: | |||
** {{Bug|915350}} - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01 | |||
* Bugs recently integrated: | |||
** {{Bug|927394}} - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present | |||
** {{Bug|927582}} - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication | |||
** {{Bug|927296}} - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException | |||
** {{Bug|926310}} - Robocop: Add test for 'Reader Mode' feature | |||
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in | |||
** {{Bug|888277}} - Robocop: Add test for Private Browsing | |||
* '''Issues''' | |||
= Personal Status = | = Personal Status = | ||
Line 65: | Line 129: | ||
==Action items== | ==Action items== | ||
* {{new|}} | * {{new|}} [Cosmin] Cosmin to look at Dave's app for Mozmill CI | ||
* {{new|}} [Anthony] Anthony to provide feedback regarding Dave's app for Mozmill CI | |||
* {{new|}} [Dave] To look into the audio/video recording issue, maybe talk to Marc about it |
Latest revision as of 16:26, 28 October 2013
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees: Andrei, Andreea, Rob, Anthony, Dave, Henrik, Adrian, Cosmin, Mario, Otilia
- TBD
- Chair:
HenrikNeed a volunteer! - Andrei - Notes: Andreea
Last Weeks Action Items
- [CARRY OVER] [Dave] present camera rig
- [DONE] [Henrik] We should stop sending [SUCCESS] mails to prevent spam (should we also remove [FIXED] mails?)
- [DONE] [Dave] Add Eideticker to Q4 goals
- [DONE] [Dave] Replace Gaia UI with Eideticker CI in the Project Updates section of the meeting template
Highlights
- [henrik] Automation Development report – week 42 2013
- [henrik] Upgraded mozmill-ci to Jenkins 1.509.4
- [henrik] To lower time spend in sending emails we disabled them for successful testruns
- [henrik] Automation Development team goals for Q4 2013
- [henrik] No more crashes of the Win 8.1 64bit nodes due to VMWare vSphere problems (see bug 916746)
- [dave] Hacked on a Mozmill CI configuration generator during MozFest
- [Adrian] I will be leaving Softvision and the Mozilla project. Last day November 4th. Ioana Chiorean (Firefox Mobile Team Lead) to join this meeting at first and the team will decide on a member to join weekly.
- New blockers, any updates?
- %new blockers%
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- [henrik] Do we want to record our meetings?
Goals Overview
Project Updates
Mozmill (Henrik)
- Cosmin found the fix for bug 922995 which let Mozmill 2.0 to not execute some of our restart tests
- We should be able to release Mozmill 2.0.1 (bug 931828) later this week
- A couple of addon related features are broken in mozprofile and need fixes for Mozmill 2.0
- Our documentation on MDN mentions mozmill-env now!
- Mozmill CI
- The crashes of the Windows 8.1 64 bit machines have been fixed
- We have 4 enabled nodes per platform now
- Way faster processing of jobs due to the cancellation of success emails
- The patch to let us execute tests for builds from project branches will land soon
Eideticker CI (Dave)
- Goals progress:
- Initial working version has been running since last week
Games Benchmarking (Rob, Joel, BC)
- No updates this week
AWSY (Rob)
- Jenkins job running on my local test box
- Problem grabbing large numbers of about memory logs from the emulator (bug 931198)
- Next step: Setup jenkins on the production VMs
Softvision Updates
Desktop Automation
- Goals progress: Metro work in progress
- Cosmin found the cause for bug bug 922995 and hopefully we'll have 2.0 back in production soon
- Resolved Fixed:
- bug 925346 - Test failure "Geolocation position has been found" in /testGeolocation/testShareLocation.js
- bug 930959 - Increase the timeout for retrieving the geolocation
- Working on:
- Andreea
- [mozmill-automation] Add metro testrun and support custom applications
- [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code
- bug 927397 - Update repository structure by dividing it in application types
- bug 880417 - Create user interface shared module for metro
- Cosmin
- bug 922995 - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
- bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
- bug 898568 - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
- Mario
- bug 851502 - Create an Endurance test to measure html5 video memory use
- bug 931715 - Test failure "The add-on has been correctly installed - got 'false'" in /restartTests/testInstallAddonWithoutEULA/test1.js
- bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
- Andrei
- buildmaster - tests and infrastructure
- bug 928124 - Migrate Mozmill Tests for Firefox 25
- bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
- Andreea
Bug number | Status | Requestee | Requester | Bug Subject |
bug 901946 | Needinfo | Jared Wein [:jaws] | Andrei | zh-TW builds on Linux wrongly calculate Autocomplete Popup height |
Mobile (Robocop)
- Progress on Robocop Automation
- Robocop bugs Backlog
- Bugs with work in progress:
- bug 820859 - Robocop: Add test for 'Clear Private Data'
- bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
- bug 836341 - Robocop: Add test for "Clear download history"
- bug 926394 - [Robocop] Create a new test for Top Sites
- bug 927578 - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added
- Bugs with patches awaiting review:
- bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
- Bugs awaiting integration:
- bug 915350 - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
- Bugs recently integrated:
- bug 927394 - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present
- bug 927582 - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication
- bug 927296 - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException
- bug 926310 - Robocop: Add test for 'Reader Mode' feature
- bug 899182 - [fig] Re-implement robocop testBookmark.java.in
- bug 888277 - Robocop: Add test for Private Browsing
- Issues
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
Action items
- [NEW] [Cosmin] Cosmin to look at Dave's app for Mozmill CI
- [NEW] [Anthony] Anthony to provide feedback regarding Dave's app for Mozmill CI
- [NEW] [Dave] To look into the audio/video recording issue, maybe talk to Marc about it