Auto-tools/Automation Development/Meetings/130909

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
  • Henrik, Andreea, Mario, Cosmin, Dave, Otilia, Samit, Mihai, Anthony
• Chair: Henrik
• Notes: Mario

Last Weeks Action Items

• [DONE] henrik: Create a hotfix-2.0 branch on mozmill
• [DONE] dave: Create a Mozmill CI troubleshooting guide on the github wiki
  • https://github.com/mozilla/mozmill-ci/wiki
• [ON TRACK] [andreea & andrei] create the merge patches for the next Firefox release (September 10th & 17th)
  • Patch up for Beta-Release merge - bug 913200
• [DONE] ashughes: Email team l10n priorities based on ADIs

Highlights

• [henrik] Automation Development report - week 34 2013: http://www.hskupin.info/2013/08/26/automation-development-report-week-34-2013/
• [henrik] Mozmill 1.5.22 and 2.0rc5 released: http://www.hskupin.info/2013/08/28/mozmill-1-5-22-and-2-0rc5-released/
• [henrik] Ubuntu 12.10 (32/64) VMs have been removed from mozmill-ci production
• [henrik] Mozdownload 1.9 has been released: http://www.hskupin.info/2013/08/29/mozdownload-1-9-released/
• [henrik] Started to add the first batch of further locales for testing beta and release candidate builds
• [henrik] Windows 8.1 nodes are online now and can be used for testing (ondemand, pulse)
• [henrik] Automation Development report – week 35 2013: http://www.hskupin.info/2013/09/03/automation-development-report-week-35-2013/
• [henrik] Updated mozmill-ci production to latest Jenkins LTS version: https://github.com/mozilla/mozmill-ci/issues/257
• [henrik] mozmill-automation packages for Mozmill 1.5.22 and 2.0rc5 are ready for testing: https://pypi.python.org/pypi/mozmill-automation
• [dave] Created a command line interface tool for Gaia: https://github.com/davehunt/gcli
• [rob] Thanks to help from Dave, the Gaia-UI Endurance tests are now located in the main Mozilla /gaia repository. I updated the Jenkins instance to run the tests from the new location (running nighlty on Leo v1-train)
• [rob] Blog post re: How to Run the Gaia-UI Endurance Tests: https://woodrobert.wordpress.com/2013/09/03/how-to-run-the-gaia-ui-endurance-tests/
• [dave] Initial working version of Eideticker CI: https://github.com/davehunt/eideticker-ci
• [dave] Released Marionette client 0.5.37
• [henrik] Mozmill l10n tests are running via mozmill-ci now: https://github.com/mozilla/mozmill-ci/issues/237
• [dave] gaia-ui-tests now uses mozdownload for B2G desktop client

• New blockers, any updates?
  • Bug 909734 - Sometimes Firefox needs more than 5s to display the main window after a restart
  • Bug 913448 - [B2G][Settings][Device Information]: Device information > More information doesn't show a lot of data
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• [dave] Do we need antivirus software on our CI nodes?

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Gaia UI (Dave)

• Goals progress:
• TBD

WebAPI (Rob)

• Goals progress:
• TBD

WebRTC (Henrik)

• No updates

Games Benchmarking (Rob, Joel, BC)

• Goals progress:
• TBD

Softvision Updates

Desktop Automation

• Goals progress: Mozmill 2.0 releases

• Fixed:
  • bug 871441 - Focus inside the select method is not set properly on the menulist
  • bug 913450 - Remove duplicated teardownModule() from testAddons_enableDisableExtension/
  • bug 886811 - Use controller.restartApplication() or controller.stopApplication() instead of controller.startUserShutdown() for mozmill-2.0
  • bug 880426 - Enhance Mozelement with touch events
  • bug 900911 - Test failure 'Active tab url should equal the page url' in /testAwesomeBar/testSwitchToTab.js
  • bug 910234 - Test failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testAwesomeBar/testAccessLocationBar.js [duplicate]
  • bug 911976 - Test failure "Disconnect Error: Application unexpectedly closed" in /testPopups/ [dupliacte]
  • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js

• Working on:
  • Andreea
    • bug 880417 - Create user interface shared module for metro
    • bug 913200 - Migrate mozmill-tests for Firefox 24
    • Pull request 32 - https://github.com/mozilla/mozmill-automation/pull/32
    • bug 909229 - [he] Test failure "'Main feature' element has been found - got 'false'" in /testSecurity/testSafeBrowsingWarningPages.js
    • bug 758187 - Write a new mozmill test for checking location sharing

• • Cosmin
    • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
    • bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
    • bug 879950 - Remove Lookup methods and Xpath elements from lib/tabs.js

• • Mario
    • bug 840022 - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
    • bug 905033 - Test failure "not-a-web-forgery report page is loaded" in /testSafeBrowsingNotificationBar.js
    • bug 894269 - Test failure "Selected category has been loaded." in /testAddons_installUninstallHardBlocklistedExtension/test2.js
    • bug 874344 - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js (Australis)

• • Andrei
    • bug 906591 - Test failure "controller(): Window could not be initialized"}}
    • bug 879382 - Create a mozmill test for finding text in a page
    • bug 818128 - Failure in testAwesomeBar/testVisibleItemsMax.js | Number of visible rows should equal 6
    • bug 912941 - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
    • bug 905170 - Test failure "The theme 'plain.theme@quality.mozilla.org' is enabled - got 'false'" in testAddons_changeTheme/test2.js
    • bug 898194 - Disable testLayout/testNavigateFTP.js due to crash on all platforms [updated skip patch as this was causing massive failures o CI]

Waiting for review/Feedback/Need info

Bug number	Status	Requestee	Requester	Bug Subject
bug 489474	Review	Henrik	Andreea	Write automated tests for user generated video controls
[Pull Request]	Review	Henrik/Dave	Andreea	Update automation script to re-raise exceptions in order to have a non-zero exit code
bug 758187	Need info	Henrik/Josh Matthews	Andreea	Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
bug 786306	Review	Henrik	Mario	Restart tests logic
bug 838192 [Pull Request]	Review	Henrik/Dave	Andrei	Add screenshot functionality to assertion module
bug 599290	Feedback	Henrik	Cosmin	Update SoftwareUpdateAPI to support complete relocation to the about dialog

Mobile (Robocop)

• Goals progress:
• TBD

Personal Status

For the personal status please check the weekly status updates:

• 130902 - 130908
• 130909 - 130915

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130909

Action items

• [Henrik] - Check how Windows Defender works and if we can use it with our tests
  • Can we exclude a certain folder from being scanned?
  • Does it scan any file in use?\
  • Does it brings up any pop-ups dialogues that could block our tests and cause failures?
  • This can be useful http://grok.lsu.edu/Article.aspx?articleId=14199