Auto-tools/Automation Development/Meetings/130708: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(25 intermediate revisions by 8 users not shown)
Line 11: Line 11:


= Last Weeks Action Items =
= Last Weeks Action Items =
* {{done|}}%name%: %task%
* {{prev|}} Henrik - Start a thread on the public list to collect ideas for the show and tell
* {{prev|}} Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
* {{prev|}} Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports


= Highlights =
= Highlights =
Line 20: Line 22:


= Roundtable =
= Roundtable =
* TBD
* [henrik] Do we want to make use of github releases instead of uploading versions to pypi directly?
** See https://github.com/blog/1547-release-your-software
** That would simplify the release process drastically for our projects
** Downside would be when github is not reachable, you wont be able to install applications
* [Andrei] Any news regarding the proposed workweek from end July/early August?
** We need to set our PTO's periods it would be great to know if the date for the workweek has been set.
* [Andrei] Any news regarding Windows8 Touch Tablets?
** They would greatly help on bug 880426 and bug 880417


= Goals Overview =
= Goals Overview =
Line 28: Line 37:


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* [rwood] Expanded endurance test suite (added two more tests)
* TBD
* [rwood] Added code to flag if b2g process memory use increases more than 5% during any endurance test


== WebAPI (Rob) ==
== WebRTC (Henrik) ==
* Goals progress:
* Goals progress:
* TBD
* Have to backport the framework for datachannel tests to Aurora and Beta


== WebRTC (Henrik) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* [rwood] Helped get speedtests running on an initial android device on the game dev team's benchmarking machine
* TBD
* [rwood] Next goal: Get one speedtest running on a Firefox OS device


= Softvision Updates =
= Softvision Updates =
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress: Mozmill 2.0 releases
* TBD
 
* Fixed:
** {{bug|860669}} - addon.getNode().getAttribute("active") returns undefined in "lib/addons.js"
** {{bug|827276}} - Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js due to missing WPAD support in SCL3
** {{bug|890487}} - Test failure "getProperty: Unknown property - identity.encrypted" in testSecurity/testDVCertificate.js
 
* Working on:
** {{bug|732353}} -  Disable all Discovery Pane tests due to unpredictable web dependencies
** {{bug|890883}} - Test failure due to timeout when trying to find the Find Bar in testFindInPage
** {{bug|853005}} - [2.0] Update automation script should exit with a non-zero exit code if unable to get update channel
** {{bug|880417}} - Create user interface shared module for metro
** {{bug|886811}} - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
** {{bug|885723}} - Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
** {{bug|790173}} - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
** {{bug|861521}} - Test failure "Timeout exceeded for waitForElement ID: errorTitleText" in testSecurity/testSSLDisabledErrorPage.js
** {{bug|874393}} - Failures in '/testSearch' functional tests due to the fact that the search bar cannot be found
** {{bug|874394}} - Test failure in '/testAwesomeBar/testPasteLocationBar.js' due to the urlbar-container not being found
** {{bug|874395}} - Test failure in /testPopups/testPopupsBlocked.js due to the tab browser element not found
** {{bug|880426}} - Enhance Mozelement with touch events
** {{bug|764640}} - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
** {{bug|888196}} - Memory increase in endurance testsruns on Win 8 (since June the 16th) -- running endurance tests on a SCL Win8 machine
** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog
 
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>
 
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
|-
| {{bug|800872}} || Review || Henrik || Andreea || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
|-
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
|-
| {{bug|889314 }} || Review || Dave || Mario || Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
|-
| {{bug|835383}} || Feedback || Andreea || Mario || Add test that installs an addon without EULA directly from addons.mozilla.org
|-
| {{bug|880135}} || Need info || Henrik/Dave || Daniela || Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
|-
| {{bug|887258}} || Review || Henrik || Daniela || Disable new tab preloading preference in mozmill 1.5
|-
| {{bug|799149}} || Review || Henrik || Daniela || Add mozmill test to ensure that there are no conflicts in context menu access keys.
|-
| {{bug|791634}} || Review || Henrik || Daniela || Make waitFor() method available in the assertions module (also for soft assertions)
|-
| {{bug|871441}} || Feedback || Henrik || Daniela || Focus inside the select method is not set properly on the menulist
|-
| {{bug|890883}} || Review || Andreea || Daniela || Test failure due to timeout when trying to find the Find Bar in testFindInPage
|-
| {{bug|888853}} || Review || Henrik || Andrei || Enhance controller.restartApllication() to handle custom restart flags
|-
| {{bug|886811}} || Review || Henrik || Andrei || Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
|-
| {{bug|885723}} || Needinfo || Mano || Andrei || Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
|-
| {{bug|887315}} || Review || Henrik || Andrei || Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
|}
 
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* TBD


= Personal Status =
= Personal Status =
For the personal status please check the weekly status updates:
For the personal status please check the weekly status updates:
* [https://ateam.etherpad.mozilla.org/mozauto-130107 130107 - 130113]
* [https://ateam.etherpad.mozilla.org/mozauto-130708 130107 - 130113]


= Meeting Notes =
= Meeting Notes =
Line 56: Line 124:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}} Henrik - Start a thread on the public list to collect ideas for the show and tell
* {{prev|}} Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
* {{prev|}} Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports

Latest revision as of 16:02, 15 July 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andrei
  • Notes: Mario

Last Weeks Action Items

  • [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
  • [CARRY OVER] Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
  • [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports

Highlights

  • [%name%] %highlight%
  • New blockers, any updates?
    • %new blockers%
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [henrik] Do we want to make use of github releases instead of uploading versions to pypi directly?
  • [Andrei] Any news regarding the proposed workweek from end July/early August?
    • We need to set our PTO's periods it would be great to know if the date for the workweek has been set.
  • [Andrei] Any news regarding Windows8 Touch Tablets?
    • They would greatly help on bug 880426 and bug 880417

Goals Overview

Project Updates

Gaia UI (Dave)

  • [rwood] Expanded endurance test suite (added two more tests)
  • [rwood] Added code to flag if b2g process memory use increases more than 5% during any endurance test

WebRTC (Henrik)

  • Goals progress:
  • Have to backport the framework for datachannel tests to Aurora and Beta

Games Benchmarking (Rob, Joel, BC)

  • [rwood] Helped get speedtests running on an initial android device on the game dev team's benchmarking machine
  • [rwood] Next goal: Get one speedtest running on a Firefox OS device

Softvision Updates

Desktop Automation

  • Goals progress: Mozmill 2.0 releases
  • Fixed:
    • bug 860669 - addon.getNode().getAttribute("active") returns undefined in "lib/addons.js"
    • bug 827276 - Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js due to missing WPAD support in SCL3
    • bug 890487 - Test failure "getProperty: Unknown property - identity.encrypted" in testSecurity/testDVCertificate.js
  • Working on:
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • bug 890883 - Test failure due to timeout when trying to find the Find Bar in testFindInPage
    • bug 853005 - [2.0] Update automation script should exit with a non-zero exit code if unable to get update channel
    • bug 880417 - Create user interface shared module for metro
    • bug 886811 - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
    • bug 885723 - Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
    • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 861521 - Test failure "Timeout exceeded for waitForElement ID: errorTitleText" in testSecurity/testSSLDisabledErrorPage.js
    • bug 874393 - Failures in '/testSearch' functional tests due to the fact that the search bar cannot be found
    • bug 874394 - Test failure in '/testAwesomeBar/testPasteLocationBar.js' due to the urlbar-container not being found
    • bug 874395 - Test failure in /testPopups/testPopupsBlocked.js due to the tab browser element not found
    • bug 880426 - Enhance Mozelement with touch events
    • bug 764640 - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
    • bug 888196 - Memory increase in endurance testsruns on Win 8 (since June the 16th) -- running endurance tests on a SCL Win8 machine
    • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog


Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 800872 Review Henrik Andreea Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 786306 Review Henrik Mario Restart tests logic
bug 889314 Review Dave Mario Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
bug 835383 Feedback Andreea Mario Add test that installs an addon without EULA directly from addons.mozilla.org
bug 880135 Need info Henrik/Dave Daniela Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
bug 887258 Review Henrik Daniela Disable new tab preloading preference in mozmill 1.5
bug 799149 Review Henrik Daniela Add mozmill test to ensure that there are no conflicts in context menu access keys.
bug 791634 Review Henrik Daniela Make waitFor() method available in the assertions module (also for soft assertions)
bug 871441 Feedback Henrik Daniela Focus inside the select method is not set properly on the menulist
bug 890883 Review Andreea Daniela Test failure due to timeout when trying to find the Find Bar in testFindInPage
bug 888853 Review Henrik Andrei Enhance controller.restartApllication() to handle custom restart flags
bug 886811 Review Henrik Andrei Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
bug 885723 Needinfo Mano Andrei Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
bug 887315 Review Henrik Andrei Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module

Mobile (Robocop)

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
  • [CARRY OVER] Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
  • [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports