Auto-tools/Automation Development/Meetings/130429: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 21: Line 21:
* New blockers, any updates?
* New blockers, any updates?
** [henrik] We are now skipping update tests for build notifications without a previous build id. Those are related to broken previous builds and RelEng can't fix it as of now
** [henrik] We are now skipping update tests for build notifications without a previous build id. Those are related to broken previous builds and RelEng can't fix it as of now
** [henrik] We most likely want to disable update tests for daily localized builds given that RelEng can't fix the issue with broken AUS snippets as of now ({bug|858953}})
** [henrik] We most likely want to disable update tests for daily localized builds given that RelEng can't fix the issue with broken AUS snippets as of now ({{bug|858953}})
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY



Revision as of 11:25, 29 April 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andreea
  • Notes: Daniela

Last Weeks Action Items

  • [CARRY OVER] Henrik - Update the goals page
  • [CARRY OVER] Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?
  • [DONE] Andreea: File bug about the broken elementslib handling with elements - bug 864375

Highlights

  • [henrik] mozdownload 1.7 released
  • [henrik] Nightly Tester Tools 3.5 released
  • [dave] Reminder: I will be on PTO from Thursday 2nd May to Monday 20th May
  • New blockers, any updates?
    • [henrik] We are now skipping update tests for build notifications without a previous build id. Those are related to broken previous builds and RelEng can't fix it as of now
    • [henrik] We most likely want to disable update tests for daily localized builds given that RelEng can't fix the issue with broken AUS snippets as of now (bug 858953)
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [henrik] Mozillians.org
    • How do we want to name our group: automation development vs. automation?
    • Should we have profiles for each of us with at least the name, picture, and country publicly accessible?
    • I would like to see that groups can also be public so we could reference from our team wiki page. I should possibly file a bug.
  • [henrik] Backports of fixes for mozmill-tests
    • What do we want to backport?
      • No style changes or improvements
      • Major changes which correspond to how the automation scripts drive the tests
      • Absolutely fixes for test failures
      • ...

Goals Overview

Project Updates

Gaia UI (Dave)

  • Goals progress:
  • TBD
  • We are now able to recover from a failure in B2G desktop client tests on Travis, and at last count have 24 failures (and 36 passes). See the results here.
  • Made progress on cleaning up the databases and profile between device tests.

WebAPI (Rob)

  • Goals progress:
  • TBD

WebRTC (Henrik)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Goals progress: Mozmill 2.0 release
  • Fixed:
    • bug 864300 - EV certificate checks are failing for "https://addons.mozilla.org/licenses/5.txt"
    • bug 860382 - Test failure "Search engines drop down has been closed" in testSearchSuggestions.js
    • bug 834163 - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
    • bug 865211 - Test failure "aController.window.PlacesStarButton is undefined" in /testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/test1.js
  • Blocked bugs:
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
      • needs CA certificate
  • Working on:
    • Mozmill-ci - Log request/response bodies of update requests
      • trying with EnvInject plugin
    • bug 864375 - mozelement/elementslib should not invoke elements at declaration time
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • bug 857551 - Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
    • bug 671476 - Mozmill Endurance test for loading a SWF video via URL
    • bug 671479 - Mozmill Endurance test for loading a SWF video via iframe
    • bug 763461 - Mozmill tests for cut-off elements should not report failure for scrollable direction
    • bug 763470 - False positive test for cut-off elements for advanced pane tabs
    • bug 764640 - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
    • bug 860670 - mozmill.utils.getWindowByType fails for type: Addons:Blocklist - Fails with "Window has been found."
    • bug 860662 - controller.select() fails to select the option by value
    • bug 864268 - Lookup class does no longer expose the `expression` property
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 800872 Review Henrik Andreea Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module
bug 839996 Feedback Marco Daniela Add event to wait for before importing the default bookmarks through importFromURL function
bug 838192 Review Henrik/Dave Andrei Add screenshot functionality to assertion module (low priority with mozmill 2.0 looming)
bug 785014 Need-info Alexandre Poirot Andreea Build restartless.xpi as a plain bootstrapped extension
bug 803492 Needinfo Neil Deakin Andrei Enhance the constructor of MozMillController to set focus on the window
bug 791634 Feedback Henrik/Dave Daniela Make waitFor() method available in the assertions module (also for soft assertions)
bug 827276 Needinfo Alex Keybl Andrei Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
Non-zero exit status 2.0 Review Henrik/Dave Andreea Update automation script to re-raise exceptions in order to have a non-zero exit code
bug 864375 Feedback Henrik Andreea mozelement/elementslib should not invoke elements at declaration time
bug 864268 Review Henrik Daniela Lookup class does no longer expose the `expression` property
bug 865627 Review Henrik/Dave Daniela Change exists method for handling Lookup expression that does not exist
bug 671476 Review Andreea Daniela Mozmill Endurance test for loading a SWF video via URL
bug 671479 Review Andreea Daniela Mozmill Endurance test for loading a SWF video via iframe
bug 857551 Review Andreea Daniela Create HTML page containing all the elements necessary for L10N testing of the context menu access keys

Mobile (Robocop)

  • Goals progress:
  • TBD

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] %name%: %task%