Auto-tools/Automation Development/Meetings/130422

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
  • TBD
• Chair: Andrei
• Notes: Henrik

Last Weeks Action Items

• [NEW] Henrik - Update the goals page
• [CARRY OVER] Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?

Highlights

• [%name%] %highlight%
• New blockers, any updates?
  • bug 862724 - Additional pulse message for same nightly builds sent (with previous_buildid == buildid)
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• TBD

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Gaia UI (Dave)

• Goals progress:
• TBD

WebAPI (Rob)

• Goals progress:
• TBD

WebRTC (Henrik)

• Goals progress:
• TBD

Softvision Updates

Desktop Automation

• Goals progress: Mozmill 2.0 release

• Fixed:
  • bug 757827 - Preferences are being lost between application restarts
  • bug 853478 - Junit report generation fails if Mozmill is not able to send the report to the dashboard
  • bug 848577 - Create a Mozmill Endurance test to catch regular expression memory leak (bug 837845)
  • bug 860330 - Test failure "searchTerm.getNode(...) is null" in testAwesomeBar/testLocationBarSearches.js
  • bug 708270 - Flash endurance tests expose potential performance degradation regression
  • bug 803489 - Software update tests on Windows 8 fail sometimes due to updater prompt on startup (jsbridge cannot connect)

• Blocked bugs:
  • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
    • needs CA certificate

• Working on:
  • Mozmill-ci - Log request/response bodies of update requests
    • trying with EnvInject plugin
  • bug 758187 - Write a new mozmill test for checking location sharing
  • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
  • bug 857551 - Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
  • bug 671476 - Mozmill Endurance test for loading a SWF video via URL
  • bug 671479 - Mozmill Endurance test for loading a SWF video via iframe
  • bug 860382 - Test failure "Search engines drop down has been closed" in testSearchSuggestions.js
  • bug 860659 - elementslib.Lookup() fails with 'Expression \"id(\"main-window\")\" returned null. Anonymous == false"'
  • bug 791634 - Make waitFor() method available in the assertions module (also for soft assertions)

Waiting for review/Feedback/Need info

Bug number	Status	People	Bug Subject
bug 489474	Review	Henrik	Write automated tests for user generated video controls
bug 800872	Review	Henrik	Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 838192 [Pull Request]	Review	Henrik/Dave	Add screenshot functionality to assertion module
bug 839996	Feedback	Marco	Add event to wait for before importing the default bookmarks through importFromURL function
bug 838192	Review	Henrik/Dave	Add screenshot functionality to assertion module (low priority with mozmill 2.0 looming)
Pull request	Review	Henrik/Dave	Update automation script should exit with a non-zero exit code if unable to get update channel (Mozmill 2.0)
bug 834163	Need-info	Henrik	Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
bug 785014	Need-info	Alexandre Poirot	Build restartless.xpi as a plain bootstrapped extension
bug 859746	Review	Henrik/Dave	Mutt javascript tests do not print the RESULTS block
bug 803492	Needinfo	Neil Deakin	Enhance the constructor of MozMillController to set focus on the window
bug 791634	Feedback	Henrik/Dave	Make waitFor() method available in the assertions module (also for soft assertions)
bug 857551	Feedback	Henrik/Dave	Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
bug 860665	Feedback	Henrik/Dave	controller.waitForPageLoad() fails when working with Private Browsing windows.

Mobile (Robocop)

• Progress on Robocop Automation
• Bugs with work in progress:
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 846340 - Robocop: Add test for 'Clear Site Settings'
  • bug 836341 - Robocop: Add test for "Clear download history"
  • bug 838596 - Robocop: Add test for 'Master Password' feature
  • bug 846296 - Robocop: Add test for 'Add Search Engine' feature
  • bug 833832 - Robocop: Add test for Import from Android feature
  • bug 855978 - Robocop: upgrade to robotium-solo-4.0.jar
• Bugs awaiting review:
  • bug 864280 - Robocop: Cleanup of BaseTest.java.in
• Intermittent fails we investigated:
  • bug 836818 - Intermittent testOverscroll | Checking gecko didn't draw unnecessarily - got true, expected false
  • bug 851861 - Intermittent testOverscroll, testPanCorrectness, testAxisLocking, testLoad, testFlingCorrectness | Pixel at 100, 0 - Color rgba(0,0,0,255) not close enough to expected rgb(32,100,0)
  • bug 854043 - Intermittent testWebContentContextMenu | Verify that the download started - The download started
• New issues found during investigations
  • bug 862695 - Robocop testBrowserProvider test restarts at some point locally and has a lot of database access errors
• Notes/Issues/Questions:
  • We still don't have an update on the robocop build issue - bug 855306 - Robocop build does not re-build tests - still no update from :joey - we are still working with older revisions or rebuilding everything
  • We are still seeing issues with the "Private data cleared" toaster notification not being displayed - bug 837274. The "Clear private data" tests on tryserver seem to constantly fail.
  • We are still trying to reproduce intermittent issues and to find out why they are happening

Personal Status

For the personal status please check the weekly status updates:

• 130422 - 130429

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130422

Action items

• [NEW] %name%: %task%