Auto-tools/Automation Development/Meetings/130826: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(17 intermediate revisions by 7 users not shown)
Line 15: Line 15:
* {{new|}} [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report)
* {{new|}} [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report)
* {{new|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
* {{new|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
* {{new|}} [henrik] Update the goals pages on the wiki
* {{done|}} [henrik] Update the goals pages on the wiki
** https://wiki.mozilla.org/Auto-tools/Automation_Development/Projects#Prioritized_Projects (Please add links to project pages if you have those available)


= Highlights =
= Highlights =
* [henrik] Automation Development report week 33 2013:
* [henrik] Automation Development report - week 34 2013:
** http://www.hskupin.info/2013/08/20/automation-development-report-week-33-2013/
** http://www.hskupin.info/2013/08/26/automation-development-report-week-34-2013/
* [henrik] Workaround for mozmill-tests merge issues and mozmill-ci landed:
* [henrik] Workaround for mozmill-tests merge issues and mozmill-ci landed:
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ
Line 29: Line 30:
* [henrik] We can now execute l10n builds for beta and release candidate builds:
* [henrik] We can now execute l10n builds for beta and release candidate builds:
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/5TGS-wMh2F8
** https://groups.google.com/forum/#!topic/mozilla.dev.automation/5TGS-wMh2F8
* [henrik] We have enabled Ubuntu 13.04 nodes for mozmill-ci, and will remove the Ubuntu 12.10 nodes soon.
* [rwood] Games benchmarking: Octane is now up and running on Firefox OS via the Speedtests framework
* New blockers, any updates?
* New blockers, any updates?
** Fixed {{bug|906876}} - Please restart qa-masterblaster (release3.qa.mtv1.mozilla.com)
** Fixed {{bug|906876}} - Please restart qa-masterblaster (release3.qa.mtv1.mozilla.com)
Line 48: Line 51:


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* Goals progress:
* [rwood] No updates this week
* TBD


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
* Goals progress:
* No updates
* TBD
 
== Mozmill (Henrik) ==
* Mozmill 1.5.22 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907983)
* Mozmill 2.0rc5 about to be released soon (https://bugzilla.mozilla.org/show_bug.cgi?id=907984)
* Mozmill 2.0 blockers: http://mzl.la/15cMg3Y


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* [rwood] Got the Octane benchmarking test up and running on Firefox OS via Speedtests framework
* TBD
* [rwood] Joel and BC are working on getting stable numbers for benchmarks on Android


= Softvision Updates =
= Softvision Updates =
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress: Mozmill 2.0 releases
* TBD
 
* Fixed:
** {{bug|908185}} - Test failure "There is a globe image" in testMixedContent.js
** {{bug|908195}} - Test failure "Current URL should be identical to the target URL" in testTabbedBrowsinf/testNewWindow.js
** {{bug|905968}} - [bn-BD] Test failure "The previous first search engine is now the third one" in /testSearch/testReorderSearchEngines.js
** {{bug|895843}} - [id] testReorderSearchEngines.js fails with 'Modal dialog has been found and processed'
** {{bug|888182}} - Failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testSecurity/testSafeBrowsingNotificationBar.js
** {{bug|905960}} - [es-CL] Test failure "Owner location string is equal to the Cert location" in /testSecurity/testGreenLarry.js
** {{bug|907101}} - Test failure "Certificate's country code is displayed - '(US)' should equal '(US,postalCode=94041,STREET=650 Castro St Ste 300)'" in testGreenLarry.js
** {{bug|882055}} - Unable to retrieve DTD's in Firefox Metro
** {{bug|898378}} - Mutt test failure "keypress() with pressed shift key succeeded. - '' should equal 'F'" in "mutt/mutt/tests/js/controller/synthesize_events.js"
* Working on:
** Andreea
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|905988}} - [ff] Test failure "Search bar has the focus" in /testSearch/testSearchViaShortcut.js
** Cosmin
*** {{bug|890181}} - Test failure "Tab has been closed" when trying to close a tab with close button
*** {{bug|879950}} - Remove Lookup methods and Xpath elements from lib/tabs.js
*** {{bug|880135}} - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
** Mario
*** {{bug|906599}} - Test failure "controller(): Window could not be initialized" in /ide@seleniumhq.org/tests/testCommands/
*** {{bug|906591}} - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7
*** {{bug|905942}} - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org
** Andrei
*** {{bug|906074}} - Mozmill fails to preserve the whole persisted object after a restart if it contains non-serializable data
*** {{bug|886811}} - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
*** {{bug|905170}} - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
*** {{bug|879382}} - Create a mozmill test for finding text in a page
*** {{bug|880426}} - Enhance Mozelement with touch events
*** {{bug|906591}} - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7 -- tried reproducing. does not on OSX 10.8
*** {{bug|908076}} - Mozmill is unable to type in Metro chrome textbox elements
*** {{bug|908206}} - Failure in testPrivateDownloadPanel.js due to changes in nsIDownloadManager
*** {{bug|908649}} - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
|-
| {{bug|800872}} || Review || Henrik || Andreea || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
|-
| {{bug|758187}} || Need info || Henrik/Josh Matthews || Andreea || Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
|-
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
|-
| {{bug|599290}} || Feedback || Henrik || Cosmin || Update SoftwareUpdateAPI to support complete relocation to the about dialog
|-
| {{bug|886811}} || Review || Dave/Henrik || Andrei || Use controller.restartApplication() or controller.stopApplication() instead of controller.startUserShutdown() for mozmill-2.0
|}


== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history
** {{Bug|878587}} - Intermittent testMasterPassword | Exception caught - junit.framework.AssertionFailedError: Click can not be completed!
** {{Bug|900664}} - Robocop testImportFromAndroid fails on x86 emulator / RAZR
* Bugs with patches awaiting review:
** {{Bug|897078}} - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found
** {{Bug|908795}} - Intermittent Android testClearPrivateData | Checking history exists - History exists
** {{Bug|907734}} - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
** {{Bug|896557}} - [fig] Fix and re-enable testWebContentContextMenu
** {{Bug|896574}} - [fig] Fix and re-enable testAddSearchEngine
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
* Bugs awaiting integration:
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* Bugs recently integrated:
** {{Bug|906662}} - Fix openAboutHomeTab to work with the changes to the tablet about:home UI
** {{Bug|896566}} - [fig] Fix and re-enable testClearPrivateData
** {{Bug|901432}} - [FIG] Cleanup BaseTest and create a new Utility class to organize the methods in BaseTest
** {{Bug|901445}} - [FIG] Add the clickLongOnScreen implementation from robotium 4.0 to Robocop
* '''Issues'''


= Personal Status =
= Personal Status =
Line 77: Line 156:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{ok|}} henrik: Create a hotfix-2.0 branch on mozmill
* {{ok|}} dave: Create a Mozmill CI troubleshooting guide on the github wiki
* {{ok|}} [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
* {{new|}} ashughes: Email team l10n priorities based on ADIs

Latest revision as of 15:57, 30 August 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andreea
  • Notes: Andrei

Last Weeks Action Items

  • [NEW] [henrik] Create a hotfix-2.0 branch on mozmill
  • [NEW] [dave] Create a Mozmill CI troubleshooting guide on the github wiki
  • [NEW] [andrei] talk to Anthony and Juan about what would help him with Release and Beta runs and see how we can help with that (in relation with a tesrun Report)
  • [NEW] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
  • [DONE] [henrik] Update the goals pages on the wiki

Highlights

Roundtable

  • TBD

Goals Overview

Project Updates

Gaia UI (Dave)

  • Goals progress:
  • TBD

WebAPI (Rob)

  • [rwood] No updates this week

WebRTC (Henrik)

  • No updates

Mozmill (Henrik)

Games Benchmarking (Rob, Joel, BC)

  • [rwood] Got the Octane benchmarking test up and running on Firefox OS via Speedtests framework
  • [rwood] Joel and BC are working on getting stable numbers for benchmarks on Android

Softvision Updates

Desktop Automation

  • Goals progress: Mozmill 2.0 releases
  • Fixed:
    • bug 908185 - Test failure "There is a globe image" in testMixedContent.js
    • bug 908195 - Test failure "Current URL should be identical to the target URL" in testTabbedBrowsinf/testNewWindow.js
    • bug 905968 - [bn-BD] Test failure "The previous first search engine is now the third one" in /testSearch/testReorderSearchEngines.js
    • bug 895843 - [id] testReorderSearchEngines.js fails with 'Modal dialog has been found and processed'
    • bug 888182 - Failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 905960 - [es-CL] Test failure "Owner location string is equal to the Cert location" in /testSecurity/testGreenLarry.js
    • bug 907101 - Test failure "Certificate's country code is displayed - '(US)' should equal '(US,postalCode=94041,STREET=650 Castro St Ste 300)'" in testGreenLarry.js
    • bug 882055 - Unable to retrieve DTD's in Firefox Metro
    • bug 898378 - Mutt test failure "keypress() with pressed shift key succeeded. - should equal 'F'" in "mutt/mutt/tests/js/controller/synthesize_events.js"
  • Working on:
    • Andreea
      • bug 880417 - Create user interface shared module for metro
      • bug 905988 - [ff] Test failure "Search bar has the focus" in /testSearch/testSearchViaShortcut.js
    • Cosmin
      • bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
      • bug 879950 - Remove Lookup methods and Xpath elements from lib/tabs.js
      • bug 880135 - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
    • Mario
      • bug 906599 - Test failure "controller(): Window could not be initialized" in /ide@seleniumhq.org/tests/testCommands/
      • bug 906591 - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7
      • bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
      • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
    • Andrei
      • bug 906074 - Mozmill fails to preserve the whole persisted object after a restart if it contains non-serializable data
      • bug 886811 - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
      • bug 905170 - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
      • bug 879382 - Create a mozmill test for finding text in a page
      • bug 880426 - Enhance Mozelement with touch events
      • bug 906591 - Test failure "controller(): Window could not be initialized" across OSX 10.6 and 10.7 -- tried reproducing. does not on OSX 10.8
      • bug 908076 - Mozmill is unable to type in Metro chrome textbox elements
      • bug 908206 - Failure in testPrivateDownloadPanel.js due to changes in nsIDownloadManager
      • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 800872 Review Henrik Andreea Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 758187 Need info Henrik/Josh Matthews Andreea Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
bug 786306 Review Henrik Mario Restart tests logic
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module
bug 599290 Feedback Henrik Cosmin Update SoftwareUpdateAPI to support complete relocation to the about dialog
bug 886811 Review Dave/Henrik Andrei Use controller.restartApplication() or controller.stopApplication() instead of controller.startUserShutdown() for mozmill-2.0

Mobile (Robocop)

  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 836341 - Robocop: Add test for "Clear download history
    • bug 878587 - Intermittent testMasterPassword | Exception caught - junit.framework.AssertionFailedError: Click can not be completed!
    • bug 900664 - Robocop testImportFromAndroid fails on x86 emulator / RAZR
  • Bugs with patches awaiting review:
    • bug 897078 - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found
    • bug 908795 - Intermittent Android testClearPrivateData | Checking history exists - History exists
    • bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
    • bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
    • bug 896574 - [fig] Fix and re-enable testAddSearchEngine
    • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
  • Bugs awaiting integration:
    • bug 888277 - Robocop: Add test for Private Browsing
  • Bugs recently integrated:
    • bug 906662 - Fix openAboutHomeTab to work with the changes to the tablet about:home UI
    • bug 896566 - [fig] Fix and re-enable testClearPrivateData
    • bug 901432 - [FIG] Cleanup BaseTest and create a new Utility class to organize the methods in BaseTest
    • bug 901445 - [FIG] Add the clickLongOnScreen implementation from robotium 4.0 to Robocop
  • Issues

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [ON TRACK] henrik: Create a hotfix-2.0 branch on mozmill
  • [ON TRACK] dave: Create a Mozmill CI troubleshooting guide on the github wiki
  • [ON TRACK] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
  • [NEW] ashughes: Email team l10n priorities based on ADIs