Auto-tools/Automation Development/Meetings/130916: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(8 intermediate revisions by 6 users not shown)
Line 30: Line 30:
* [dave] gaia-ui-tests has been moved into the main gaia repository
* [dave] gaia-ui-tests has been moved into the main gaia repository
* [andreea] Remote tests from the functional directory have been moved in the remote directory - {{bug|849962}}  
* [andreea] Remote tests from the functional directory have been moved in the remote directory - {{bug|849962}}  
* [dave] b2gpopulate 0.9 was released with new persistent storage location


* New blockers, any updates?
* New blockers, any updates?
Line 37: Line 38:


= Roundtable =
= Roundtable =
* TBD
* [Andrei] is the Mozilla reorganisation affecting us in any direct way?


= Goals Overview =
= Goals Overview =
Line 45: Line 46:


==Mozmill (Henrik)==
==Mozmill (Henrik)==
* Remaining 3 blockers are worked on
* Remaining [https://bugzilla.mozilla.org/buglist.cgi?resolution=---&status_whiteboard_type=anywordssubstr&query_format=advanced&status_whiteboard=mozmill-2.0%3F%20mozmill-2.0%2B&product=Testing&list_id=7922188 3 blockers] are worked on
* We will have a RC6 to proof the quality in our 2.0 CI
* We will have a RC6 to proof the quality in our 2.0 CI
* Mozmill 1.5.23 should follow soon.
* Mozmill 1.5.23 should follow soon.
Line 54: Line 55:


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* Goals progress:
* No updates (PTO last week)
* TBD


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
Line 61: Line 61:


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* [rwood] I have no updates for this, PTO last week
* TBD


= Softvision Updates =
= Softvision Updates =
Line 71: Line 70:
** {{bug|914528}} - Mutt test failure "Unkown entity 'cmd.neverActivate.label'" in js/testElementsLib/testMenuList.js under ESR17
** {{bug|914528}} - Mutt test failure "Unkown entity 'cmd.neverActivate.label'" in js/testElementsLib/testMenuList.js under ESR17
** {{bug|915139}} - Test failure "The page has mixed content" in /testSecurity/testMixedContentPage.js
** {{bug|915139}} - Test failure "The page has mixed content" in /testSecurity/testMixedContentPage.js
** {{bug|905033}} - Test failure "not-a-web-forgery report page is loaded" in /testSafeBrowsingNotificationBar.js
** {{bug|835132}} - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js


* Working on:
* Working on:
Line 83: Line 84:


** Cosmin
** Cosmin
***  
*** {{bug|916005}} - [sq] Test failure "Timeout exceeded for waitForElement Lookup" in /testSecurity/testSafeBrowsingNotificationBar.js
*** {{bug|856541}} - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
*** {{bug|904577}} - Method exists() from elementslib.Elem returns true even after the node has been removed
*** {{bug|865640}} - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"


** Mario
** Mario
***  
*** {{bug|874344}} - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
*** {{bug|840022}} - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
*** {{bug|905942}} - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js


** Andrei
** Andrei
***  
*** {{bug|818128}} - Failure in testAwesomeBar/testVisibleItemsMax.js | Number of visible rows should equal 6
*** {{bug|912941}} - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
*** {{bug|912363}} - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
*** {{bug|905963}} - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
*** {{bug|905170}} - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
*** {{bug|915550}} - Massive failures for "controller.waitForPageLoad(): Timeout waiting for page loaded" on ESR17 branch
*** {{bug|909237}} - Test failure "The addon is disabled - got 'false'" in /restartTests/testAddons_installUninstallHardBlocklistedExtension/test3.js


{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"
Line 104: Line 116:
|-
|-
|}
|}
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]

Latest revision as of 15:56, 16 September 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andreea
  • Notes: Dave

Last Weeks Action Items

  • [ON TRACK] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
  • [NEW] [Henrik] - Check how Windows Defender works and if we can use it with our tests

Highlights

  • New blockers, any updates?
    • bug 914057 - Request 3 Mac Minis for OSX 10.9 testing in qa.scl3.mozilla.com
    • bug 914061 - Nightly engineering builds missing since 6th September 2013
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [Andrei] is the Mozilla reorganisation affecting us in any direct way?

Goals Overview

Project Updates

Mozmill (Henrik)

  • Remaining 3 blockers are worked on
  • We will have a RC6 to proof the quality in our 2.0 CI
  • Mozmill 1.5.23 should follow soon.

Gaia UI (Dave)

  • Goals progress:
  • TBD

WebAPI (Rob)

  • No updates (PTO last week)

WebRTC (Henrik)

  • No updates

Games Benchmarking (Rob, Joel, BC)

  • [rwood] I have no updates for this, PTO last week

Softvision Updates

Desktop Automation

  • Goals progress:
  • Resolved Fixed:
    • [fixed in bug 912936] bug 909229 - [he] Test failure "'Main feature' element has been found - got 'false'" in /testSecurity/testSafeBrowsingWarningPages.js
    • bug 914528 - Mutt test failure "Unkown entity 'cmd.neverActivate.label'" in js/testElementsLib/testMenuList.js under ESR17
    • bug 915139 - Test failure "The page has mixed content" in /testSecurity/testMixedContentPage.js
    • bug 905033 - Test failure "not-a-web-forgery report page is loaded" in /testSafeBrowsingNotificationBar.js
    • bug 835132 - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
  • Working on:
    • Cosmin
      • bug 916005 - [sq] Test failure "Timeout exceeded for waitForElement Lookup" in /testSecurity/testSafeBrowsingNotificationBar.js
      • bug 856541 - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
      • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
      • bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
    • Mario
      • bug 874344 - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
      • bug 840022 - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
      • bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
    • Andrei
      • bug 818128 - Failure in testAwesomeBar/testVisibleItemsMax.js | Number of visible rows should equal 6
      • bug 912941 - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
      • bug 912363 - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
      • bug 905963 - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
      • bug 905170 - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
      • bug 915550 - Massive failures for "controller.waitForPageLoad(): Timeout waiting for page loaded" on ESR17 branch
      • bug 909237 - Test failure "The addon is disabled - got 'false'" in /restartTests/testAddons_installUninstallHardBlocklistedExtension/test3.js
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 786306 Review Henrik Mario Restart tests logic
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module
bug 599290 Feedback Henrik Cosmin Update SoftwareUpdateAPI to support complete relocation to the about dialog

Mobile (Robocop)

  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 836341 - Robocop: Add test for "Clear download history"
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
  • Bugs with patches awaiting review:
    • bug 896574 - [fig] Fix and re-enable testAddSearchEngine
    • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
    • bug 916107 - Tag the BrowserSearch ListView and the TopBookmarksView in order for UI tests to access them
  • Bugs awaiting integration:
    • bug 888277 - Robocop: Add test for Private Browsing
  • Bugs recently integrated:
    • bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
    • bug 896566 - [fig] Fix and re-enable testClearPrivateData
    • bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
    • bug 897078 - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found
    • bug 908795 - Intermittent Android testClearPrivateData | Checking history exists - History exist
  • Issues
    • During the re-write of the tests to work with the new about:home we discovered that the Robocop api is not as scalable as we would like to. The Mobile Front-End team with the help of Geoff Brown decided that the api needs to be re-written and the progress can be seen in bug 910791 - [meta] New UI testing API. As a first step I grouped all database interactions in a DatabaseHelper class and created a StringHelper class to improve the independence of tests to the String changes in bug 907734. Lucas created a first patch for the new Robocop api structure - bug 910859 - Bootstrap new UI testing API - but we are still analyzing the best approach to these changes

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] %name%: %task%
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Automation_Development/Meetings/130916&oldid=709112"