Auto-tools/Automation Development/Meetings/130708: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(15 intermediate revisions by 7 users not shown)
Line 27: Line 27:
** Downside would be when github is not reachable, you wont be able to install applications
** Downside would be when github is not reachable, you wont be able to install applications
* [Andrei] Any news regarding the proposed workweek from end July/early August?
* [Andrei] Any news regarding the proposed workweek from end July/early August?
** Some of us have plans for early August and it would be great to know if the date for the workweek has been set.
** We need to set our PTO's periods it would be great to know if the date for the workweek has been set.
* [Andrei] Any news regarding Windows8 Touch Tablets?
* [Andrei] Any news regarding Windows8 Touch Tablets?
** They would greatly help on bug 880426 and bug 880417
** They would greatly help on bug 880426 and bug 880417
Line 37: Line 37:


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* [rwood] Expanded endurance test suite (added two more tests)
* TBD
* [rwood] Added code to flag if b2g process memory use increases more than 5% during any endurance test


== WebAPI (Rob) ==
== WebRTC (Henrik) ==
* Goals progress:
* Goals progress:
* TBD
* Have to backport the framework for datachannel tests to Aurora and Beta


== WebRTC (Henrik) ==
== Games Benchmarking (Rob, Joel, BC) ==
* Goals progress:
* [rwood] Helped get speedtests running on an initial android device on the game dev team's benchmarking machine
* TBD
* [rwood] Next goal: Get one speedtest running on a Firefox OS device


= Softvision Updates =
= Softvision Updates =
Line 55: Line 55:
** {{bug|860669}} - addon.getNode().getAttribute("active") returns undefined in "lib/addons.js"  
** {{bug|860669}} - addon.getNode().getAttribute("active") returns undefined in "lib/addons.js"  
** {{bug|827276}} - Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js due to missing WPAD support in SCL3
** {{bug|827276}} - Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js due to missing WPAD support in SCL3
** {{bug|890487}} - Test failure "getProperty: Unknown property - identity.encrypted" in testSecurity/testDVCertificate.js


* Working on:
* Working on:
** {{bug|732353}} -  Disable all Discovery Pane tests due to unpredictable web dependencies
** {{bug|732353}} -  Disable all Discovery Pane tests due to unpredictable web dependencies
** {{bug|890883}} - Test failure due to timeout when trying to find the Find Bar in testFindInPage
** {{bug|853005}} - [2.0] Update automation script should exit with a non-zero exit code if unable to get update channel
** {{bug|853005}} - [2.0] Update automation script should exit with a non-zero exit code if unable to get update channel
** {{bug|880417}} - Create user interface shared module for metro
** {{bug|880417}} - Create user interface shared module for metro
Line 70: Line 72:
** {{bug|764640}} - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
** {{bug|764640}} - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
** {{bug|888196}} - Memory increase in endurance testsruns on Win 8 (since June the 16th) -- running endurance tests on a SCL Win8 machine
** {{bug|888196}} - Memory increase in endurance testsruns on Win 8 (since June the 16th) -- running endurance tests on a SCL Win8 machine
** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog




Line 75: Line 78:
|+<b> Waiting for review/Feedback/Need info</b>  
|+<b> Waiting for review/Feedback/Need info</b>  
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>  
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>  
|-
 
| {{bug|889314 }} || Review || Dave || Mario || Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
|-
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
Line 82: Line 84:
| {{bug|800872}} || Review || Henrik || Andreea || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
| {{bug|800872}} || Review || Henrik || Andreea || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
|-
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
|-
|-
| {{bug|887315}} || Review || Henrik || Andrei || Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
| {{bug|889314 }} || Review || Dave || Mario || Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
|-
|-
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
| {{bug|835383}} || Feedback || Andreea || Mario || Add test that installs an addon without EULA directly from addons.mozilla.org
|-
|-
| {{bug|880135}} || Need info || Henrik/Dave || Daniela || Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
| {{bug|880135}} || Need info || Henrik/Dave || Daniela || Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
|-
| {{bug|835296}} || Feedback || Henrik/Dave || Mario || Add test that installs an addon with EULA directly from addons.mozilla.org
|-
|-
| {{bug|887258}} || Review || Henrik || Daniela || Disable new tab preloading preference in mozmill 1.5
| {{bug|887258}} || Review || Henrik || Daniela || Disable new tab preloading preference in mozmill 1.5
Line 99: Line 99:
|-
|-
| {{bug|871441}} || Feedback || Henrik || Daniela || Focus inside the select method is not set properly on the menulist
| {{bug|871441}} || Feedback || Henrik || Daniela || Focus inside the select method is not set properly on the menulist
|-
| {{bug|890883}} || Review || Andreea || Daniela || Test failure due to timeout when trying to find the Find Bar in testFindInPage
|-
|-
| {{bug|888853}} || Review || Henrik || Andrei || Enhance controller.restartApllication() to handle custom restart flags
| {{bug|888853}} || Review || Henrik || Andrei || Enhance controller.restartApllication() to handle custom restart flags
Line 105: Line 107:
|-
|-
| {{bug|885723}} || Needinfo || Mano || Andrei || Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
| {{bug|885723}} || Needinfo || Mano || Andrei || Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
|-
| {{bug|887315}} || Review || Henrik || Andrei || Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
|}
|}


== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* TBD


= Personal Status =
= Personal Status =
Line 120: Line 124:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}} Henrik - Start a thread on the public list to collect ideas for the show and tell
* {{prev|}} Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
* {{prev|}} Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports

Latest revision as of 16:02, 15 July 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andrei
  • Notes: Mario

Last Weeks Action Items

  • [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
  • [CARRY OVER] Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
  • [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports

Highlights

  • [%name%] %highlight%
  • New blockers, any updates?
    • %new blockers%
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [henrik] Do we want to make use of github releases instead of uploading versions to pypi directly?
  • [Andrei] Any news regarding the proposed workweek from end July/early August?
    • We need to set our PTO's periods it would be great to know if the date for the workweek has been set.
  • [Andrei] Any news regarding Windows8 Touch Tablets?
    • They would greatly help on bug 880426 and bug 880417

Goals Overview

Project Updates

Gaia UI (Dave)

  • [rwood] Expanded endurance test suite (added two more tests)
  • [rwood] Added code to flag if b2g process memory use increases more than 5% during any endurance test

WebRTC (Henrik)

  • Goals progress:
  • Have to backport the framework for datachannel tests to Aurora and Beta

Games Benchmarking (Rob, Joel, BC)

  • [rwood] Helped get speedtests running on an initial android device on the game dev team's benchmarking machine
  • [rwood] Next goal: Get one speedtest running on a Firefox OS device

Softvision Updates

Desktop Automation

  • Goals progress: Mozmill 2.0 releases
  • Fixed:
    • bug 860669 - addon.getNode().getAttribute("active") returns undefined in "lib/addons.js"
    • bug 827276 - Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js due to missing WPAD support in SCL3
    • bug 890487 - Test failure "getProperty: Unknown property - identity.encrypted" in testSecurity/testDVCertificate.js
  • Working on:
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • bug 890883 - Test failure due to timeout when trying to find the Find Bar in testFindInPage
    • bug 853005 - [2.0] Update automation script should exit with a non-zero exit code if unable to get update channel
    • bug 880417 - Create user interface shared module for metro
    • bug 886811 - Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
    • bug 885723 - Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
    • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 861521 - Test failure "Timeout exceeded for waitForElement ID: errorTitleText" in testSecurity/testSSLDisabledErrorPage.js
    • bug 874393 - Failures in '/testSearch' functional tests due to the fact that the search bar cannot be found
    • bug 874394 - Test failure in '/testAwesomeBar/testPasteLocationBar.js' due to the urlbar-container not being found
    • bug 874395 - Test failure in /testPopups/testPopupsBlocked.js due to the tab browser element not found
    • bug 880426 - Enhance Mozelement with touch events
    • bug 764640 - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
    • bug 888196 - Memory increase in endurance testsruns on Win 8 (since June the 16th) -- running endurance tests on a SCL Win8 machine
    • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog


Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
bug 800872 Review Henrik Andreea Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 786306 Review Henrik Mario Restart tests logic
bug 889314 Review Dave Mario Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
bug 835383 Feedback Andreea Mario Add test that installs an addon without EULA directly from addons.mozilla.org
bug 880135 Need info Henrik/Dave Daniela Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
bug 887258 Review Henrik Daniela Disable new tab preloading preference in mozmill 1.5
bug 799149 Review Henrik Daniela Add mozmill test to ensure that there are no conflicts in context menu access keys.
bug 791634 Review Henrik Daniela Make waitFor() method available in the assertions module (also for soft assertions)
bug 871441 Feedback Henrik Daniela Focus inside the select method is not set properly on the menulist
bug 890883 Review Andreea Daniela Test failure due to timeout when trying to find the Find Bar in testFindInPage
bug 888853 Review Henrik Andrei Enhance controller.restartApllication() to handle custom restart flags
bug 886811 Review Henrik Andrei Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
bug 885723 Needinfo Mano Andrei Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
bug 887315 Review Henrik Andrei Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
bug 838192 [Pull Request] Review Henrik/Dave Andrei Add screenshot functionality to assertion module

Mobile (Robocop)

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
  • [CARRY OVER] Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
  • [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports