Auto-tools/Automation Development/Meetings/130325: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(18 intermediate revisions by 7 users not shown)
Line 9: Line 9:
= General =
= General =
* Attendees:  
* Attendees:  
** TBD
** Daniela, Otilia, Mario, Andreea, Adrian, Andrei, Rob, Dave, Henrik
* Chair: Andrei
* Chair: Andrei
* Notes: Andreea
* Notes: Andreea


= Last Weeks Action Items =
= Last Weeks Action Items =
* {{done|}}%name%: %task%
* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?


= Highlights =
= Highlights =
Line 23: Line 23:


= Roundtable =
= Roundtable =
* TBD
* Easter holidays?
* Tesruns status: https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndEY5cmlFMzRlcnB2aDZWVFJMMk5UdWc#gid=0


= Goals Overview =
= Goals Overview =
* https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects
* https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects
* Goals for 13/Q2: https://ateam.etherpad.mozilla.org/autodev-goals13Q2


= Project Updates =
= Project Updates =
Line 32: Line 35:
== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
** [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK]
* [rwood] Developing long-running GaiaUI tests ({{bug|843083}}). Provided about_memory DMD debug logs for {{bug|850803}}, wrote script to help debug {{bug|850893}}. Now working on integrating DMD about_memory logs and datazilla. For a detailed list please see the [https://ateam.etherpad.mozilla.org/GaiaUIStress GaiaUI Stress Test etherpad].


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* Goals progress:
* Two tests remain under review/development for Screen Orientation WebAPI, challenging due to timing issues (thanks for your help Dave)
* TBD


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
Line 44: Line 47:
= Softvision Updates =
= Softvision Updates =
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress: 7 of 5 done:  
* TBD
** [https://github.com/mozilla/gaia-ui-tests/issues/409 Issue 409] - [[https://github.com/mozilla/gaia-ui-tests/pull/424 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/446 Issue 446] - [[https://github.com/mozilla/gaia-ui-tests/pull/461 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/410 Issue 410] - [[https://github.com/mozilla/gaia-ui-tests/pull/464 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/463 Issue 463] - [[https://github.com/mozilla/gaia-ui-tests/pull/526 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/528 Issue 528] - [[https://github.com/mozilla/gaia-ui-tests/pull/529 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/486 Issue 486] - [[https://github.com/mozilla/gaia-ui-tests/pull/485 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/435 Issue 435] - [[https://github.com/mozilla/gaia-ui-tests/pull/523 fix]]
 
* Fixed:
** {{bug|840022}} - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
** [https://github.com/mozilla/gaia-ui-tests/issues/528 Issue 528] - [[https://github.com/mozilla/gaia-ui-tests/pull/529 fix]]
** [https://github.com/mozilla/gaia-ui-tests/issues/435 Issue 435] - [[https://github.com/mozilla/gaia-ui-tests/pull/523 fix]]
 
* Blocked bugs:
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by {{bug|804952}} - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
** {{bug|763159}} - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
 
* Working on:
** {{bug|732353}} - Disable all Discovery Pane tests due to unpredictable web dependencies
** {{bug|839996}} - Add event to wait for before importing the default bookmarks through importFromURL function
** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog
** {{bug|803489}} - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox
** {{bug|758187}} - Write a new mozmill test for checking location sharing
** {{bug|834163}} - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
** {{bug|708270}} - Flash endurance tests expose potential performance degradation regression
** {{bug|853005}} - Update automation script should exit with a non-zero exit code if unable to get update channel
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>People</b>  || <b>Bug Subject</b>
|-
| {{bug|489474}} || Review || Henrik || Write automated tests for user generated video controls
|-
| {{bug|800872}} || Review || Henrik/Dave || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
|-
| {{bug|758187}} || Review || Henrik/Dave || Write a new mozmill test for checking location sharing
|-
| {{bug|786306}} || Review || Henrik/Dave || Add more logic to the restart tests to skip following test files if a test is failing
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Add screenshot functionality to assertion module
|-
| {{bug|599290}} || Review || Andreea || Remove node.hasAttributes() code from "lib/localization.js"
|-
| {{bug|799149}} || Feedback || Henrik/Dave || Add mozmill test to ensure that there are no conflicts in context menu access keys
|-
| {{bug|839996}} || Feedback || Marco || Add event to wait for before importing the default bookmarks through importFromURL function
|-
| {{bug|599290}} || Feedback || Henrik/Dave || Update SoftwareUpdateAPI to support complete relocation to the about dialog
|}
 
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
** Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
** Bugs with work in progress:
*** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
*** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
*** {{Bug|846340}} - Robocop: Add test for 'Clear Site Settings'
*** {{Bug|838596}} - Robocop: Add test for 'Master Password' feature
*** {{Bug|846296}} - Robocop: Add test for 'Add Search Engine' feature
*** {{Bug|833832}} - Robocop: Add test for Import from Android feature
** Bugs with patches awaiting review:
*** {{Bug|820276}} - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
** New Issues logged on Robocop:
*** {{Bug|854328}} - Robocop: Add support for WebApp testing using Robocop
**Notes/Issues/Questions:
*** As discussed on IRC with Joel after we have completed the existing function Robocop tests we will focus on debugging the intermittent fails. We are still awaiting a list of bugs to we should look over.


= Personal Status =
= Personal Status =
For the personal status please check the weekly status updates:
For the personal status please check the weekly status updates:
* [https://ateam.etherpad.mozilla.org/mozauto-130107 130107 - 130113]
* [https://ateam.etherpad.mozilla.org/mozauto-130325 130325 - 130331]


= Meeting Notes =
= Meeting Notes =
The meeting notes for this meeting can be read in the following etherpad:  
The meeting notes for this meeting can be read in the following etherpad:  
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20130107
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20130325


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}} Dave: Email the mailing list about goal status: Gaia UI tests, update testing, new automation rig in MV and documentation
* {{new|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?

Latest revision as of 16:25, 25 March 2013

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

  • Attendees:
    • Daniela, Otilia, Mario, Andreea, Adrian, Andrei, Rob, Dave, Henrik
  • Chair: Andrei
  • Notes: Andreea

Last Weeks Action Items

  • [CARRY OVER] Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?

Highlights

  • [%name%] %highlight%
  • New blockers, any updates?
    • %new blockers%
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Goals Overview

Project Updates

Gaia UI (Dave)

  • Goals progress:
    • [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK]
  • [rwood] Developing long-running GaiaUI tests (bug 843083). Provided about_memory DMD debug logs for bug 850803, wrote script to help debug bug 850893. Now working on integrating DMD about_memory logs and datazilla. For a detailed list please see the GaiaUI Stress Test etherpad.

WebAPI (Rob)

  • Two tests remain under review/development for Screen Orientation WebAPI, challenging due to timing issues (thanks for your help Dave)

WebRTC (Henrik)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Blocked bugs:
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
  • Working on:
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
    • bug 839996 - Add event to wait for before importing the default bookmarks through importFromURL function
    • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
    • bug 803489 - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox
    • bug 758187 - Write a new mozmill test for checking location sharing
    • bug 834163 - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
    • bug 708270 - Flash endurance tests expose potential performance degradation regression
    • bug 853005 - Update automation script should exit with a non-zero exit code if unable to get update channel
Waiting for review/Feedback/Need info
Bug number Status People Bug Subject
bug 489474 Review Henrik Write automated tests for user generated video controls
bug 800872 Review Henrik/Dave Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 758187 Review Henrik/Dave Write a new mozmill test for checking location sharing
bug 786306 Review Henrik/Dave Add more logic to the restart tests to skip following test files if a test is failing
bug 838192 [Pull Request] Review Henrik/Dave Add screenshot functionality to assertion module
bug 599290 Review Andreea Remove node.hasAttributes() code from "lib/localization.js"
bug 799149 Feedback Henrik/Dave Add mozmill test to ensure that there are no conflicts in context menu access keys
bug 839996 Feedback Marco Add event to wait for before importing the default bookmarks through importFromURL function
bug 599290 Feedback Henrik/Dave Update SoftwareUpdateAPI to support complete relocation to the about dialog

Mobile (Robocop)

    • Progress on Robocop Automation
    • Bugs with work in progress:
      • bug 820859 - Robocop: Add test for 'Clear Private Data'
      • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
      • bug 846340 - Robocop: Add test for 'Clear Site Settings'
      • bug 838596 - Robocop: Add test for 'Master Password' feature
      • bug 846296 - Robocop: Add test for 'Add Search Engine' feature
      • bug 833832 - Robocop: Add test for Import from Android feature
    • Bugs with patches awaiting review:
      • bug 820276 - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
    • New Issues logged on Robocop:
      • bug 854328 - Robocop: Add support for WebApp testing using Robocop
    • Notes/Issues/Questions:
      • As discussed on IRC with Joel after we have completed the existing function Robocop tests we will focus on debugging the intermittent fails. We are still awaiting a list of bugs to we should look over.

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] Dave: Email the mailing list about goal status: Gaia UI tests, update testing, new automation rig in MV and documentation
  • [NEW] Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Automation_Development/Meetings/130325&oldid=641073"