Auto-tools/Automation Development/Meetings/130513: Difference between revisions

(Created page with "<small>previous meeting | Meetings | [[Auto-tools/Automation_Development/M...")
 
 
(18 intermediate revisions by 6 users not shown)
Line 11: Line 11:


= Last Weeks Action Items =
= Last Weeks Action Items =
* {{new|}} Henrik: Send an email to the automation list about the name of the group being called automation
* {{done|}} Henrik: Send an email to the automation list about the name of the group being called automation
* {{new|}} Henrik: File a bug to make public information visible (Mozillians)
** https://groups.google.com/forum/?fromgroups=#!topic/mozilla.dev.automation/LCQ988sCai0
* {{new|}} Henrik: Push the mozmill 2.0 release after the meeting
* {{done|}} Henrik: File a bug to make public information visible (Mozillians)
* {{new|}} Andrei: Send an email to Neil regarding bug 803492
** {{bug|866881}} - Allow groups to be public
* {{prev|}} Henrik: Update the goals page  
* {{done|}} Henrik: Push the mozmill 2.0 release after the meeting
* {{done|}} Andrei: Send an email to Neil regarding bug 803492
* {{done|}} Henrik: Update the goals page  
* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?
* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?


= Highlights =
= Highlights =
 
* [henrik] Mozmill 2.0rc3 released: https://groups.google.com/forum/?fromgroups=#!topic/mozilla.dev.automation/HZVi8zUmo8s
* [henrik] mozdownload 1.7.2 released with support for hidden candidate builds: https://github.com/mozilla/mozdownload/issues/79
* [henrik] mozqa.com lives in-house now, which means we have full control about everything! \o/
* [henrik] pre-info: We will be able to move the new mac minis to the new CI cluster as of today!
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


Line 32: Line 37:


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* no updates
* TBD


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* no updates


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
* No updates


= Softvision Updates =
= Softvision Updates =
== Desktop Automation ==
== Desktop Automation ==
* Goals progress: Mozmill 2.0 release
* Goals progress: Mozmill 2.0 releases


* Fixed:
* Fixed:
** {{bug|864268}} - Lookup class does no longer expose the `expression` property
** {{bug|864268}} - Lookup class does no longer expose the `expression` property
** {{bug|842571}} - Update the process start directory (XCurProcD) in software-update.js library  
** {{bug|842571}} - Update the process start directory (XCurProcD) in software-update.js library  
** {{bug|861520}} - Test failure "Timeout exceeded for waitForElement ID: useSSL3" in testPreferences/testDefaultSecurityPrefs.js
** {{bug|671479}} - Mozmill Endurance test for loading a SWF video via iframe
** {{bug|864268}} - Lookup class does no longer expose the `expression` property
** {{bug|803492}} - Enhance the constructor of MozMillController to set focus on the window
** {{bug|821713}} - Test failure "Autodiscovered OpenSearch Engines - '0' should equal '1'" in testSearch/testOpenSearchAutodiscovery.js
** {{bug|870810}} - Update mozmill tests after BookmarksMenuButton renamed to BookmarkingUI
** {{bug|840485}} - Test failure "The crash reporter executable is present - got 'false'" in /testInstallation/testBreakpadInstalled.js


* Blocked bugs:
* Blocked bugs:
** {{bug|763159}} - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** needs CA certificate, Brandon answered to Henrik that it will be ready in a few days


* Working on:
* Working on:
** [https://github.com/mozilla/mozmill-ci/issues/229 Mozmill-ci] - Log request/response bodies of update requests
** {{bug|865640}} -  3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
*** trying with EnvInject plugin
** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog
** {{bug|732353}} - Disable all Discovery Pane tests due to unpredictable web dependencies
** {{bug|857551}} -  Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
** {{bug|763159}} -  Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
** {{bug|860659}} - elementslib.Lookup() fails with 'Expression \"id(\"main-window\")\" returned null. Anonymous == false"'
** [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] - Update automation script to re-raise exceptions in order to have a non-zero exit code
** {{bug|860662}} - controller.select() fails to select the option by value
** {{bug|859241}} - Add more logic to the restart tests to skip following test files if a test is failing
** {{bug|835132}} - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
** {{bug|862972}} - [ja] Failure "'Phishing protection' element has been found - got 'false'" in testSafeBrowsingWarningPages.js::testWarningPages (ja-JP)
** {{bug|809778}} - Test failure "Selected category has been loaded. " in /restartTests/testAddons_installMultipleExtensions/test2.js
** {{bug|867217}} - restart tests should manually restart for mozmill 2.0 compatibility


** [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] - Update automation script to re-raise exceptions in order to have a non-zero exit code
{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>  
|+<b> Waiting for review/Feedback/Need info</b>  
Line 75: Line 93:
| {{bug|785014}} || Need-info || Alexandre Poirot || Andreea || Build restartless.xpi as a plain bootstrapped extension
| {{bug|785014}} || Need-info || Alexandre Poirot || Andreea || Build restartless.xpi as a plain bootstrapped extension
|-
|-
| {{bug|803492}} || Needinfo || Neil Deakin || Andrei || Enhance the constructor of MozMillController to set focus on the window
| {{bug|860659}} || Feedback || Clint || Daniela ||  elementslib.Lookup() fails with 'Expression \"id(\"main-window\")\" returned null. Anonymous == false"'
|-
| {{bug|791634}} || Feedback || Henrik/Dave || Daniela ||  Make waitFor() method available in the assertions module (also for soft assertions)
|-
|-
| {{bug|827276}} || Needinfo || Alex Keybl || Andrei || Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
| {{bug|827276}} || Needinfo || Alex Keybl || Andrei || Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
|-
| {{bug|864375}} || Feedback || Henrik || Andreea || mozelement/elementslib should not invoke elements at declaration time
|-
| {{bug|864268}} || Review || Henrik || Daniela || Lookup class does no longer expose the `expression` property
|-
| {{bug|865627}} || Review || Henrik/Dave || Daniela || Change exists method for handling Lookup expression that does not exist
|-
| {{bug|671479}} || Review || Andreea || Daniela || Mozmill Endurance test for loading a SWF video via iframe
|-
| {{bug|857551}} || Review || Andreea || Daniela || Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
|-
| {{bug|860662}} || Review || Dave/Henrik || Andrei || controller.select() fails to select the option by value
|}
|}


Line 97: Line 101:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* Bugs with work in progress:
* Bugs with work in progress:
 
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|846340}} - Robocop: Add test for 'Clear Site Settings'
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|838596}} - Robocop: Add test for 'Master Password' feature
** {{Bug|833832}} - Robocop: Add test for Import from Android feature
** {{Bug|855978}} - Robocop: upgrade to robotium-solo-4.0.jar
* Bugs recently integrated:
* Bugs recently integrated:
** {{Bug|846296}} - Robocop: Add test for 'Add Search Engine' feature
** {{Bug|869277}} - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
*Notes/Issues/Questions:
** We have a few patches that have not been yet integrated due to {{Bug|663657}} but need to be modified because of the new Settings menu UI on Tablets


= Personal Status =
= Personal Status =
Line 109: Line 123:


==Action items==
==Action items==
* {{new|}} AdrianT: Demo of robocop by May 27th
Confirmed users
332

edits