Auto-tools/Automation Development/Meetings/130722

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
  • TBD
• Chair: Andreea
• Notes: Andrei

Last Weeks Action Items

• [DONE] Henrik - Start a thread on the public list to collect ideas for the show and tell
  • Thread: https://groups.google.com/forum/#!topic/mozilla.dev.automation/YXw_C0Sx4XA
• [DONE] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports
• [NEW] Henrik - talk to Clint about next quarter goals
  • Talked with Clint and have to setup the new goals on the wiki now
• [DONE] Andreea - start a mail thread about the bug priorities

Highlights

• [henrik] About to fix a major bug in jsbridge which leds to dataloss when sending too much data. See bug 764640.
• [dave] b2gperf 0.5 released
• [dave] Blog post Running Firefox OS UI Tests Without a Device (revised)
• [henrik] Changes to our dashboard for daily and release testing: https://groups.google.com/forum/#!topic/mozilla.dev.automation/inEkMY5ZiAc
• New blockers, any updates?
  • bug 883539 - Frequent Android 4.0 rc2 retries: "Remote Device Error: unable to connect to %s after %s attempts" % (self.host, retryLimit) - no new tests integrated on Robocop until the Pandaboard runs become stable
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• TBD

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Gaia UI (Dave)

• Goals progress:
• TBD

WebAPI (Rob)

• No updates this week

WebRTC (Henrik)

• Goals progress:
• TBD

Games Benchmarking (Rob, Joel, BC)

• [rwood] Good progress on getting speedtests running on Firefox OS

Softvision Updates

Desktop Automation

• Goals progress: Mozmill 2.0 releases

• Fixed:
  • bug 880220 - Test failure "The crash reporter is enabled - 'false' should equal 'true'" in testBreakpadInstalled.js
  • bug 763461 - Mozmill tests for cut-off elements should not report failure for scrollable direction
  • bug 763470 - False positive test for cut-off elements for advanced pane tabs
  • bug 741301 - Disable broken l10n crop tests until false positives have been resolved

• Working on:
  • Andreea
    • bug 758187 - Write a new mozmill test for checking location sharing - OS X special case
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - update patch
    • bug 877100 - Mozmill 2.0 doesn't always add a list of add-ons to the report: "addons":null - check reproducibility
    • bug 873974 - Test failure 'Disk cache has no entries - '1' should equal '0' ' in /testPrivateBrowsing/testAboutCache.js
    • bug 888182 - Failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 888924 - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js

• • Cosmin
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • bug 885221 - controller.waitForPageLoad() failures with mozmill 2.0 due to closeAllTabs method opening about:newtab instead of about:blank
    • bug 880135 - [1.5] Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
    • bug 791634 - Make waitFor() method available in the assertions module (also for soft assertions)
    • bug 871441 - Focus inside the select method is not set properly on the menulist

• • Mario
    • bug 835383 - Add test that installs an addon without EULA directly from addons.mozilla.org
    • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
    • bug 874395 - Test failure in /testPopups/testPopupsBlocked.js due to the tab browser element not found
    • bug 874344 - test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
    • bug 892388 - Create a clone of restartless.xpi for uploading to AMO with an end user license agreement
    • bug 892388 - Failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testEnableCookies.js and testDisableCookies.js

• • Andrei
    • bug 894400 - Failure 'Disconnect Error: Application unexpectedly closed' in /testAwesomeBar/testGoButton.js
    • bug 896475 - Mozmill 2.0 doesn't show the updater log when performing update tests
    • bug 889817 - Mozmill fails on some locales to correctly set the addonList

Waiting for review/Feedback/Need info

Bug number	Status	Requestee	Requester	Bug Subject
bug 489474	Review	Henrik	Andreea	Write automated tests for user generated video controls
bug 800872	Review	Henrik	Andreea	Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 786306	Review	Henrik	Mario	Restart tests logic
bug 838192 [Pull Request]	Review	Henrik/Dave	Andrei	Add screenshot functionality to assertion module
bug 874393	Review	Andreea/Dave	Mario	Failures in '/testSearch' functional tests due to the fact that the search bar cannot be found
bug 599290	Feedback	Henrik	Cosmin	Update SoftwareUpdateAPI to support complete relocation to the about dialog

Mobile (Robocop)

• Progress on Robocop Automation
• Bugs with work in progress:
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 836341 - Robocop: Add test for "Clear download history"
  • bug 854043 - Intermittent testWebContentContextMenu | Verify that the download started - The download started
• Bugs with patches awaiting review:
  • bug 895716 - [fig] TEST-UNEXPECTED-FAIL | testNewTab | GeckoEventExpecter - blockForEvent timeout: DOMContentLoaded
• Bugs awaiting integration:
  • bug 888277 - Robocop: Add test for Private Browsing
• Bugs recently integrated:
  • bug 869277 - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
  • bug 886299 - Intermittent testShareLink | Exception caught - junit.framework.AssertionFailedError: The text: Share is not found!
• Issues

Personal Status

For the personal status please check the weekly status updates:

• 130722 - 130726

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130722

Action items

• [NEW] %name%: %task%