Auto-tools/Automation Development/Meetings/130513: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(12 intermediate revisions by 5 users not shown)
Line 16: Line 16:
** {{bug|866881}} - Allow groups to be public
** {{bug|866881}} - Allow groups to be public
* {{done|}} Henrik: Push the mozmill 2.0 release after the meeting
* {{done|}} Henrik: Push the mozmill 2.0 release after the meeting
* {{new|}} Andrei: Send an email to Neil regarding bug 803492
* {{done|}} Andrei: Send an email to Neil regarding bug 803492
* {{done|}} Henrik: Update the goals page  
* {{done|}} Henrik: Update the goals page  
* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?
* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?


= Highlights =
= Highlights =
 
* [henrik] Mozmill 2.0rc3 released: https://groups.google.com/forum/?fromgroups=#!topic/mozilla.dev.automation/HZVi8zUmo8s
* [henrik] mozdownload 1.7.2 released with support for hidden candidate builds: https://github.com/mozilla/mozdownload/issues/79
* [henrik] mozqa.com lives in-house now, which means we have full control about everything! \o/
* [henrik] pre-info: We will be able to move the new mac minis to the new CI cluster as of today!
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


Line 34: Line 37:


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* no updates
* TBD


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* no updates


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
* No updates


= Softvision Updates =
= Softvision Updates =
Line 67: Line 71:
** [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] - Update automation script to re-raise exceptions in order to have a non-zero exit code
** [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] - Update automation script to re-raise exceptions in order to have a non-zero exit code
** {{bug|860662}} - controller.select() fails to select the option by value
** {{bug|860662}} - controller.select() fails to select the option by value
** {{bug|859241}} - Add more logic to the restart tests to skip following test files if a test is failing
** {{bug|835132}} - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
** {{bug|862972}} - [ja] Failure "'Phishing protection' element has been found - got 'false'" in testSafeBrowsingWarningPages.js::testWarningPages (ja-JP)
** {{bug|809778}} - Test failure "Selected category has been loaded. " in /restartTests/testAddons_installMultipleExtensions/test2.js
** {{bug|867217}} - restart tests should manually restart for mozmill 2.0 compatibility


{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"
Line 87: Line 96:
|-
|-
| {{bug|827276}} || Needinfo || Alex Keybl || Andrei || Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
| {{bug|827276}} || Needinfo || Alex Keybl || Andrei || Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
|-
| {{bug|857551}} || Review || Andreea || Daniela || Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
|-
| {{bug|763159}} || Review || Andreea || Daniela ||  Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
|}
|}


Line 96: Line 101:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* Bugs with work in progress:
* Bugs with work in progress:
 
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|846340}} - Robocop: Add test for 'Clear Site Settings'
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|838596}} - Robocop: Add test for 'Master Password' feature
** {{Bug|833832}} - Robocop: Add test for Import from Android feature
** {{Bug|855978}} - Robocop: upgrade to robotium-solo-4.0.jar
* Bugs recently integrated:
* Bugs recently integrated:
** {{Bug|846296}} - Robocop: Add test for 'Add Search Engine' feature
** {{Bug|869277}} - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
*Notes/Issues/Questions:
** We have a few patches that have not been yet integrated due to {{Bug|663657}} but need to be modified because of the new Settings menu UI on Tablets


= Personal Status =
= Personal Status =
Line 108: Line 123:


==Action items==
==Action items==
* {{new|}} AdrianT: Demo of robocop by May 27th

Latest revision as of 13:15, 17 May 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Daniela
  • Notes: Andrei

Last Weeks Action Items

  • [DONE] Henrik: Send an email to the automation list about the name of the group being called automation
  • [DONE] Henrik: File a bug to make public information visible (Mozillians)
  • [DONE] Henrik: Push the mozmill 2.0 release after the meeting
  • [DONE] Andrei: Send an email to Neil regarding bug 803492
  • [DONE] Henrik: Update the goals page
  • [CARRY OVER] Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?

Highlights

Roundtable

Goals Overview

Project Updates

Gaia UI (Dave)

  • no updates

WebAPI (Rob)

  • no updates

WebRTC (Henrik)

  • No updates

Softvision Updates

Desktop Automation

  • Goals progress: Mozmill 2.0 releases
  • Fixed:
    • bug 864268 - Lookup class does no longer expose the `expression` property
    • bug 842571 - Update the process start directory (XCurProcD) in software-update.js library
    • bug 861520 - Test failure "Timeout exceeded for waitForElement ID: useSSL3" in testPreferences/testDefaultSecurityPrefs.js
    • bug 671479 - Mozmill Endurance test for loading a SWF video via iframe
    • bug 864268 - Lookup class does no longer expose the `expression` property
    • bug 803492 - Enhance the constructor of MozMillController to set focus on the window
    • bug 821713 - Test failure "Autodiscovered OpenSearch Engines - '0' should equal '1'" in testSearch/testOpenSearchAutodiscovery.js
    • bug 870810 - Update mozmill tests after BookmarksMenuButton renamed to BookmarkingUI
    • bug 840485 - Test failure "The crash reporter executable is present - got 'false'" in /testInstallation/testBreakpadInstalled.js
  • Blocked bugs:
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
  • Working on:
    • bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
    • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
    • bug 857551 - Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
    • bug 860659 - elementslib.Lookup() fails with 'Expression \"id(\"main-window\")\" returned null. Anonymous == false"'
    • Non-zero exit status 2.0 - Update automation script to re-raise exceptions in order to have a non-zero exit code
    • bug 860662 - controller.select() fails to select the option by value
    • bug 859241 - Add more logic to the restart tests to skip following test files if a test is failing
    • bug 835132 - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
    • bug 862972 - [ja] Failure "'Phishing protection' element has been found - got 'false'" in testSafeBrowsingWarningPages.js::testWarningPages (ja-JP)
    • bug 809778 - Test failure "Selected category has been loaded. " in /restartTests/testAddons_installMultipleExtensions/test2.js
    • bug 867217 - restart tests should manually restart for mozmill 2.0 compatibility
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 800872 Review Henrik Andreea Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module
bug 839996 Feedback Marco Daniela Add event to wait for before importing the default bookmarks through importFromURL function
bug 838192 Review Henrik/Dave Andrei Add screenshot functionality to assertion module (low priority with mozmill 2.0 looming)
bug 785014 Need-info Alexandre Poirot Andreea Build restartless.xpi as a plain bootstrapped extension
bug 860659 Feedback Clint Daniela elementslib.Lookup() fails with 'Expression \"id(\"main-window\")\" returned null. Anonymous == false"'
bug 827276 Needinfo Alex Keybl Andrei Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js

Mobile (Robocop)

  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 846340 - Robocop: Add test for 'Clear Site Settings'
    • bug 836341 - Robocop: Add test for "Clear download history"
    • bug 838596 - Robocop: Add test for 'Master Password' feature
    • bug 833832 - Robocop: Add test for Import from Android feature
    • bug 855978 - Robocop: upgrade to robotium-solo-4.0.jar
  • Bugs recently integrated:
    • bug 846296 - Robocop: Add test for 'Add Search Engine' feature
    • bug 869277 - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
  • Notes/Issues/Questions:
    • We have a few patches that have not been yet integrated due to bug 663657 but need to be modified because of the new Settings menu UI on Tablets

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] AdrianT: Demo of robocop by May 27th