Auto-tools/Automation Development/Meetings/130826: Difference between revisions
< Auto-tools | Automation Development | Meetings
Jump to navigation
Jump to search
AndreeaMatei (talk | contribs) |
|||
(17 intermediate revisions by 7 users not shown) | |||
Line 15: | Line 15: | ||
* {{new|}} [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report) | * {{new|}} [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report) | ||
* {{new|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th) | * {{new|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th) | ||
* {{ | * {{done|}} [henrik] Update the goals pages on the wiki | ||
** https://wiki.mozilla.org/Auto-tools/Automation_Development/Projects#Prioritized_Projects (Please add links to project pages if you have those available) | |||
= Highlights = | = Highlights = | ||
* [henrik] Automation Development report week | * [henrik] Automation Development report - week 34 2013: | ||
** http://www.hskupin.info/2013/08/ | ** http://www.hskupin.info/2013/08/26/automation-development-report-week-34-2013/ | ||
* [henrik] Workaround for mozmill-tests merge issues and mozmill-ci landed: | * [henrik] Workaround for mozmill-tests merge issues and mozmill-ci landed: | ||
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ | ** https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ | ||
Line 29: | Line 30: | ||
* [henrik] We can now execute l10n builds for beta and release candidate builds: | * [henrik] We can now execute l10n builds for beta and release candidate builds: | ||
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/5TGS-wMh2F8 | ** https://groups.google.com/forum/#!topic/mozilla.dev.automation/5TGS-wMh2F8 | ||
* [henrik] We have enabled Ubuntu 13.04 nodes for mozmill-ci, and will remove the Ubuntu 12.10 nodes soon. | |||
* [rwood] Games benchmarking: Octane is now up and running on Firefox OS via the Speedtests framework | |||
* New blockers, any updates? | * New blockers, any updates? | ||
** Fixed {{bug|906876}} - Please restart qa-masterblaster (release3.qa.mtv1.mozilla.com) | ** Fixed {{bug|906876}} - Please restart qa-masterblaster (release3.qa.mtv1.mozilla.com) | ||
Line 48: | Line 51: | ||
== WebAPI (Rob) == | == WebAPI (Rob) == | ||
* | * [rwood] No updates this week | ||
== WebRTC (Henrik) == | == WebRTC (Henrik) == | ||
* | * No updates | ||
* | |||
== Mozmill (Henrik) == | |||
* Mozmill 1.5.22 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907983) | |||
* Mozmill 2.0rc5 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907984) | |||
* Mozmill 2.0 blockers: http://mzl.la/15cMg3Y | |||
== Games Benchmarking (Rob, Joel, BC) == | == Games Benchmarking (Rob, Joel, BC) == | ||
* | * [rwood] Got the Octane benchmarking test up and running on Firefox OS via Speedtests framework | ||
* | * [rwood] Joel and BC are working on getting stable numbers for benchmarks on Android | ||
= Softvision Updates = | = Softvision Updates = | ||
== Desktop Automation == | == Desktop Automation == | ||
* Goals progress: | * Goals progress: Mozmill 2.0 releases | ||
* | |||
* Fixed: | |||
** {{bug|908185}} - Test failure "There is a globe image" in testMixedContent.js | |||
** {{bug|908195}} - Test failure "Current URL should be identical to the target URL" in testTabbedBrowsinf/testNewWindow.js | |||
** {{bug|905968}} - [bn-BD] Test failure "The previous first search engine is now the third one" in /testSearch/testReorderSearchEngines.js | |||
** {{bug|895843}} - [id] testReorderSearchEngines.js fails with 'Modal dialog has been found and processed' | |||
** {{bug|888182}} - Failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testSecurity/testSafeBrowsingNotificationBar.js | |||
** {{bug|905960}} - [es-CL] Test failure "Owner location string is equal to the Cert location" in /testSecurity/testGreenLarry.js | |||
** {{bug|907101}} - Test failure "Certificate's country code is displayed - '(US)' should equal '(US,postalCode=94041,STREET=650 Castro St Ste 300)'" in testGreenLarry.js | |||
** {{bug|882055}} - Unable to retrieve DTD's in Firefox Metro | |||
** {{bug|898378}} - Mutt test failure "keypress() with pressed shift key succeeded. - '' should equal 'F'" in "mutt/mutt/tests/js/controller/synthesize_events.js" | |||
* Working on: | |||
** Andreea | |||
*** {{bug|880417}} - Create user interface shared module for metro | |||
*** {{bug|905988}} - [ff] Test failure "Search bar has the focus" in /testSearch/testSearchViaShortcut.js | |||
** Cosmin | |||
*** {{bug|890181}} - Test failure "Tab has been closed" when trying to close a tab with close button | |||
*** {{bug|879950}} - Remove Lookup methods and Xpath elements from lib/tabs.js | |||
*** {{bug|880135}} - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js | |||
** Mario | |||
*** {{bug|906599}} - Test failure "controller(): Window could not be initialized" in /ide@seleniumhq.org/tests/testCommands/ | |||
*** {{bug|906591}} - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7 | |||
*** {{bug|905942}} - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js | |||
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org | |||
** Andrei | |||
*** {{bug|906074}} - Mozmill fails to preserve the whole persisted object after a restart if it contains non-serializable data | |||
*** {{bug|886811}} - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0 | |||
*** {{bug|905170}} - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js | |||
*** {{bug|879382}} - Create a mozmill test for finding text in a page | |||
*** {{bug|880426}} - Enhance Mozelement with touch events | |||
*** {{bug|906591}} - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7 -- tried reproducing. does not on OSX 10.8 | |||
*** {{bug|908076}} - Mozmill is unable to type in Metro chrome textbox elements | |||
*** {{bug|908206}} - Failure in testPrivateDownloadPanel.js due to changes in nsIDownloadManager | |||
*** {{bug|908649}} - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation | |||
{| border="1" cellpadding="2" align="center" | |||
|+<b> Waiting for review/Feedback/Need info</b> | |||
| <b>Bug number</b> || <b>Status</b> || <b>Requestee</b> || <b>Requester</b> || <b>Bug Subject</b> | |||
|- | |||
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls | |||
|- | |||
| {{bug|800872}} || Review || Henrik || Andreea || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js | |||
|- | |||
| {{bug|758187}} || Need info || Henrik/Josh Matthews || Andreea || Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js | |||
|- | |||
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic | |||
|- | |||
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module | |||
|- | |||
| {{bug|599290}} || Feedback || Henrik || Cosmin || Update SoftwareUpdateAPI to support complete relocation to the about dialog | |||
|- | |||
| {{bug|886811}} || Review || Dave/Henrik || Andrei || Use controller.restartApplication() or controller.stopApplication() instead of controller.startUserShutdown() for mozmill-2.0 | |||
|} | |||
== Mobile (Robocop) == | == Mobile (Robocop) == | ||
* | * Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation] | ||
* | * Bugs with work in progress: | ||
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data' | |||
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature | |||
** {{Bug|836341}} - Robocop: Add test for "Clear download history | |||
** {{Bug|878587}} - Intermittent testMasterPassword | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | |||
** {{Bug|900664}} - Robocop testImportFromAndroid fails on x86 emulator / RAZR | |||
* Bugs with patches awaiting review: | |||
** {{Bug|897078}} - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found | |||
** {{Bug|908795}} - Intermittent Android testClearPrivateData | Checking history exists - History exists | |||
** {{Bug|907734}} - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better | |||
** {{Bug|896557}} - [fig] Fix and re-enable testWebContentContextMenu | |||
** {{Bug|896574}} - [fig] Fix and re-enable testAddSearchEngine | |||
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in | |||
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in | |||
* Bugs awaiting integration: | |||
** {{Bug|888277}} - Robocop: Add test for Private Browsing | |||
* Bugs recently integrated: | |||
** {{Bug|906662}} - Fix openAboutHomeTab to work with the changes to the tablet about:home UI | |||
** {{Bug|896566}} - [fig] Fix and re-enable testClearPrivateData | |||
** {{Bug|901432}} - [FIG] Cleanup BaseTest and create a new Utility class to organize the methods in BaseTest | |||
** {{Bug|901445}} - [FIG] Add the clickLongOnScreen implementation from robotium 4.0 to Robocop | |||
* '''Issues''' | |||
= Personal Status = | = Personal Status = | ||
Line 77: | Line 156: | ||
==Action items== | ==Action items== | ||
* {{new|}} | * {{ok|}} henrik: Create a hotfix-2.0 branch on mozmill | ||
* {{ok|}} dave: Create a Mozmill CI troubleshooting guide on the github wiki | |||
* {{ok|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th) | |||
* {{new|}} ashughes: Email team l10n priorities based on ADIs |
Latest revision as of 15:57, 30 August 2013
previous meeting | Meetings | next meeting »
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees:
- TBD
- Chair: Andreea
- Notes: Andrei
Last Weeks Action Items
- [NEW] [henrik] Create a hotfix-2.0 branch on mozmill
- [NEW] [dave] Create a Mozmill CI troubleshooting guide on the github wiki
- [NEW] [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report)
- [NEW] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
- [DONE] [henrik] Update the goals pages on the wiki
- https://wiki.mozilla.org/Auto-tools/Automation_Development/Projects#Prioritized_Projects (Please add links to project pages if you have those available)
Highlights
- [henrik] Automation Development report - week 34 2013:
- [henrik] Workaround for mozmill-tests merge issues and mozmill-ci landed:
- [dave] The first test has landed for mozdownload, many thanks to Johannes (nebelhom)!
- [henrik] Johannes (:nebelhom) our new reviewer for mozdownload
- [dave] mozdownload tests are now run using Travis-CI on every commit and pull request
- [dave] Jonathan (:jfrench) submitted an enhancement for the Mozmill dashboard titles and headings to differentiate between databases
- [henrik] We can now execute l10n builds for beta and release candidate builds:
- [henrik] We have enabled Ubuntu 13.04 nodes for mozmill-ci, and will remove the Ubuntu 12.10 nodes soon.
- [rwood] Games benchmarking: Octane is now up and running on Firefox OS via the Speedtests framework
- New blockers, any updates?
- Fixed bug 906876 - Please restart qa-masterblaster (release3.qa.mtv1.mozilla.com)
- Fixed bug 907089 - Please restart qa-set (release2.qa.mtv1.mozilla.com)
- Fixed bug 908211 - Gaia repository in git mirror is stuck on an old revision
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- TBD
Goals Overview
Project Updates
Gaia UI (Dave)
- Goals progress:
- TBD
WebAPI (Rob)
- [rwood] No updates this week
WebRTC (Henrik)
- No updates
Mozmill (Henrik)
- Mozmill 1.5.22 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907983)
- Mozmill 2.0rc5 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907984)
- Mozmill 2.0 blockers: http://mzl.la/15cMg3Y
Games Benchmarking (Rob, Joel, BC)
- [rwood] Got the Octane benchmarking test up and running on Firefox OS via Speedtests framework
- [rwood] Joel and BC are working on getting stable numbers for benchmarks on Android
Softvision Updates
Desktop Automation
- Goals progress: Mozmill 2.0 releases
- Fixed:
- bug 908185 - Test failure "There is a globe image" in testMixedContent.js
- bug 908195 - Test failure "Current URL should be identical to the target URL" in testTabbedBrowsinf/testNewWindow.js
- bug 905968 - [bn-BD] Test failure "The previous first search engine is now the third one" in /testSearch/testReorderSearchEngines.js
- bug 895843 - [id] testReorderSearchEngines.js fails with 'Modal dialog has been found and processed'
- bug 888182 - Failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testSecurity/testSafeBrowsingNotificationBar.js
- bug 905960 - [es-CL] Test failure "Owner location string is equal to the Cert location" in /testSecurity/testGreenLarry.js
- bug 907101 - Test failure "Certificate's country code is displayed - '(US)' should equal '(US,postalCode=94041,STREET=650 Castro St Ste 300)'" in testGreenLarry.js
- bug 882055 - Unable to retrieve DTD's in Firefox Metro
- bug 898378 - Mutt test failure "keypress() with pressed shift key succeeded. - should equal 'F'" in "mutt/mutt/tests/js/controller/synthesize_events.js"
- Working on:
- Andreea
- bug 880417 - Create user interface shared module for metro
- bug 905988 - [ff] Test failure "Search bar has the focus" in /testSearch/testSearchViaShortcut.js
- Cosmin
- bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
- bug 879950 - Remove Lookup methods and Xpath elements from lib/tabs.js
- bug 880135 - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
- Mario
- bug 906599 - Test failure "controller(): Window could not be initialized" in /ide@seleniumhq.org/tests/testCommands/
- bug 906591 - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7
- bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
- bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
- Andrei
- bug 906074 - Mozmill fails to preserve the whole persisted object after a restart if it contains non-serializable data
- bug 886811 - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
- bug 905170 - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
- bug 879382 - Create a mozmill test for finding text in a page
- bug 880426 - Enhance Mozelement with touch events
- bug 906591 - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7 -- tried reproducing. does not on OSX 10.8
- bug 908076 - Mozmill is unable to type in Metro chrome textbox elements
- bug 908206 - Failure in testPrivateDownloadPanel.js due to changes in nsIDownloadManager
- bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
- Andreea
Bug number | Status | Requestee | Requester | Bug Subject |
bug 489474 | Review | Henrik | Andreea | Write automated tests for user generated video controls |
bug 800872 | Review | Henrik | Andreea | Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js |
bug 758187 | Need info | Henrik/Josh Matthews | Andreea | Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js |
bug 786306 | Review | Henrik | Mario | Restart tests logic |
bug 838192 [Pull Request] | Review | Henrik/Dave | Andrei | Add screenshot functionality to assertion module |
bug 599290 | Feedback | Henrik | Cosmin | Update SoftwareUpdateAPI to support complete relocation to the about dialog |
bug 886811 | Review | Dave/Henrik | Andrei | Use controller.restartApplication() or controller.stopApplication() instead of controller.startUserShutdown() for mozmill-2.0 |
Mobile (Robocop)
- Progress on Robocop Automation
- Bugs with work in progress:
- bug 820859 - Robocop: Add test for 'Clear Private Data'
- bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
- bug 836341 - Robocop: Add test for "Clear download history
- bug 878587 - Intermittent testMasterPassword | Exception caught - junit.framework.AssertionFailedError: Click can not be completed!
- bug 900664 - Robocop testImportFromAndroid fails on x86 emulator / RAZR
- Bugs with patches awaiting review:
- bug 897078 - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found
- bug 908795 - Intermittent Android testClearPrivateData | Checking history exists - History exists
- bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
- bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
- bug 896574 - [fig] Fix and re-enable testAddSearchEngine
- bug 899182 - [fig] Re-implement robocop testBookmark.java.in
- bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
- Bugs awaiting integration:
- bug 888277 - Robocop: Add test for Private Browsing
- Bugs recently integrated:
- bug 906662 - Fix openAboutHomeTab to work with the changes to the tablet about:home UI
- bug 896566 - [fig] Fix and re-enable testClearPrivateData
- bug 901432 - [FIG] Cleanup BaseTest and create a new Utility class to organize the methods in BaseTest
- bug 901445 - [FIG] Add the clickLongOnScreen implementation from robotium 4.0 to Robocop
- Issues
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
Action items
- [ON TRACK] henrik: Create a hotfix-2.0 branch on mozmill
- [ON TRACK] dave: Create a Mozmill CI troubleshooting guide on the github wiki
- [ON TRACK] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
- [NEW] ashughes: Email team l10n priorities based on ADIs