Auto-tools/Automation Development/Meetings/130916: Difference between revisions

(Created page with "<small>previous meeting | Meetings | [[Auto-tools/Automation_Development/M...")
 
 
(18 intermediate revisions by 8 users not shown)
Line 21: Line 21:
* [henrik] Automation Development report – week 36 2013:  
* [henrik] Automation Development report – week 36 2013:  
** http://www.hskupin.info/2013/09/10/automation-development-report-week-36-2013/
** http://www.hskupin.info/2013/09/10/automation-development-report-week-36-2013/
* [dave] gaia-ui-tests is now using mozdownload for b2g desktop testing
* [henrik] Mozmill l10n tests are running via mozmill-ci now:
** https://github.com/mozilla/mozmill-ci/issues/237
* [henrik] Mozmill-CI got new jobs for the 24.0ESR release:  
* [henrik] Mozmill-CI got new jobs for the 24.0ESR release:  
** https://github.com/mozilla/mozmill-ci/issues/286
** https://github.com/mozilla/mozmill-ci/issues/286
Line 29: Line 26:
* [henrik] mozmill-env contains mozmill-automation package now for Mozmill 1.5.22 and 2.0rc5:
* [henrik] mozmill-env contains mozmill-automation package now for Mozmill 1.5.22 and 2.0rc5:
** https://github.com/whimboo/mozmill-environment/issues/62
** https://github.com/whimboo/mozmill-environment/issues/62
* [nebelhom] First mozdownload tests via mozhttpd landed: https://github.com/mozilla/mozdownload/pull/137
* [henrik] We have a Mozmill 2.0 ci instance running on release2.qa.mtv1.mozilla.com (aka qa-set) (bug 911993)
* [dave] gaia-ui-tests has been moved into the main gaia repository
* [andreea] Remote tests from the functional directory have been moved in the remote directory - {{bug|849962}}
* [dave] b2gpopulate 0.9 was released with new persistent storage location
* New blockers, any updates?
* New blockers, any updates?
** {{bug|914057}} - Request 3 Mac Minis for OSX 10.9 testing in qa.scl3.mozilla.com
** {{bug|914057}} - Request 3 Mac Minis for OSX 10.9 testing in qa.scl3.mozilla.com
** {{bug|914061}} - Nightly engineering builds missing since 6th September 2013
** <strike>{{bug|914061}} - Nightly engineering builds missing since 6th September 2013</strike>
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


= Roundtable =
= Roundtable =
* TBD
* [Andrei] is the Mozilla reorganisation affecting us in any direct way?


= Goals Overview =
= Goals Overview =
Line 41: Line 44:


= Project Updates =
= Project Updates =
==Mozmill (Henrik)==
* Remaining [https://bugzilla.mozilla.org/buglist.cgi?resolution=---&status_whiteboard_type=anywordssubstr&query_format=advanced&status_whiteboard=mozmill-2.0%3F%20mozmill-2.0%2B&product=Testing&list_id=7922188 3 blockers] are worked on
* We will have a RC6 to proof the quality in our 2.0 CI
* Mozmill 1.5.23 should follow soon.


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
Line 47: Line 55:


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* Goals progress:
* No updates (PTO last week)
* TBD


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
* Goals progress:
* No updates
* TBD


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* [rwood] I have no updates for this, PTO last week
* TBD


= Softvision Updates =
= Softvision Updates =
Line 63: Line 68:
* Resolved Fixed:
* Resolved Fixed:
** [fixed in {{bug|912936}}] {{bug|909229}} - [he] Test failure "'Main feature' element has been found - got 'false'" in /testSecurity/testSafeBrowsingWarningPages.js  
** [fixed in {{bug|912936}}] {{bug|909229}} - [he] Test failure "'Main feature' element has been found - got 'false'" in /testSecurity/testSafeBrowsingWarningPages.js  
** {{bug|914528}} - Mutt test failure "Unkown entity 'cmd.neverActivate.label'" in js/testElementsLib/testMenuList.js under ESR17
** {{bug|915139}} - Test failure "The page has mixed content" in /testSecurity/testMixedContentPage.js
** {{bug|905033}} - Test failure "not-a-web-forgery report page is loaded" in /testSafeBrowsingNotificationBar.js
** {{bug|835132}} - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js


* Working on:
* Working on:
Line 75: Line 84:


** Cosmin
** Cosmin
***  
*** {{bug|916005}} - [sq] Test failure "Timeout exceeded for waitForElement Lookup" in /testSecurity/testSafeBrowsingNotificationBar.js
*** {{bug|856541}} - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
*** {{bug|904577}} - Method exists() from elementslib.Elem returns true even after the node has been removed
*** {{bug|865640}} - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"


** Mario
** Mario
***  
*** {{bug|874344}} - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
*** {{bug|840022}} - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
*** {{bug|905942}} - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js


** Andrei
** Andrei
***  
*** {{bug|818128}} - Failure in testAwesomeBar/testVisibleItemsMax.js | Number of visible rows should equal 6
*** {{bug|912941}} - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
*** {{bug|912363}} - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
*** {{bug|905963}} - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
*** {{bug|905170}} - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
*** {{bug|915550}} - Massive failures for "controller.waitForPageLoad(): Timeout waiting for page loaded" on ESR17 branch
*** {{bug|909237}} - Test failure "The addon is disabled - got 'false'" in /restartTests/testAddons_installUninstallHardBlocklistedExtension/test3.js


{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"
Line 88: Line 108:
|-
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
|-
| [[https://github.com/mozilla/mozmill-automation/pull/32 Pull Request]] || Review || Henrik/Dave || Andreea || Update automation script to re-raise exceptions in order to have a non-zero exit code
|-
|-
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
Line 100: Line 118:


== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
* Bugs with patches awaiting review:
** {{Bug|896574}} - [fig] Fix and re-enable testAddSearchEngine
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in
** {{Bug|916107}} - Tag the BrowserSearch ListView and the TopBookmarksView in order for UI tests to access them
* Bugs awaiting integration:
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* Bugs recently integrated:
** {{Bug|907734}} - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
** {{Bug|896566}} - [fig] Fix and re-enable testClearPrivateData
** {{Bug|896557}} - [fig] Fix and re-enable testWebContentContextMenu
** {{Bug|897078}} - [fig] Intermittent testImportFromAndroid | Waiting for search bar - Search bar found
** {{Bug|908795}} - Intermittent Android testClearPrivateData | Checking history exists - History exist
* '''Issues'''
** During the re-write of the tests to work with the new about:home we discovered that the Robocop api is not as scalable as we would like to. The Mobile Front-End team with the help of Geoff Brown decided that the api needs to be re-written and the progress can be seen in {{Bug|910791}} - [meta] New UI testing API. As a first step I grouped all database interactions in a DatabaseHelper class and created a StringHelper class to improve the independence of tests to the String changes in {{Bug|907734}}. Lucas created a first patch for the new Robocop api structure - {{Bug|910859}} - Bootstrap new UI testing API - but we are still analyzing the best approach to these changes


= Personal Status =
= Personal Status =
Confirmed users
332

edits