Auto-tools/Automation Development/Meetings/130930: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(11 intermediate revisions by 6 users not shown)
Line 1: Line 1:
<small>[[Auto-tools/Automation_Development/Meetings/130923|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/131007|next meeting &raquo;]]</small>
<small>[[Auto-tools/Automation_Development/Meetings/130923|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/131014|next meeting &raquo;]]</small>


= Dial in =
= Dial in =
Line 5: Line 5:


= General =
= General =
* Attendees:  
* Attendees: Mario, Andreea, Cosmin, Henrik, Dave, Otilia, Adrian, Mihai, Andrei
** TBD
** TBD
* Chair: Dave Hunt
* Chair: Dave Hunt
Line 12: Line 12:
= Last Weeks Action Items =
= Last Weeks Action Items =
* {{new|}} Henrik: Update the wiki for quarter goals
* {{new|}} Henrik: Update the wiki for quarter goals
** Not done yet - will happen once we got all CI issues fixed
* {{done|}} Henrik: Release Mozmill 2.0
* {{done|}} Henrik: Release Mozmill 2.0
** http://www.hskupin.info/2013/09/25/mozmill-2-0-released/
** http://www.hskupin.info/2013/09/25/mozmill-2-0-released/
Line 22: Line 23:
* [dave] Released gaiatest [https://pypi.python.org/pypi/gaiatest/0.14 0.14] & [https://pypi.python.org/pypi/gaiatest/0.15 0.15]
* [dave] Released gaiatest [https://pypi.python.org/pypi/gaiatest/0.14 0.14] & [https://pypi.python.org/pypi/gaiatest/0.15 0.15]
* [dave] New blog post - [http://blargon7.com/2013/09/building-a-harness-for-eideticker-with-lego/ Building a harness for Eideticker... with LEGO]
* [dave] New blog post - [http://blargon7.com/2013/09/building-a-harness-for-eideticker-with-lego/ Building a harness for Eideticker... with LEGO]
* [henrik] Disabling Windows Defender on all Windows nodes stopped the critical performance issues (see bug 918676)
* [henrik] Windows Error Reporting has been disabled for all of our Windows nodes to stop hanging processes (see bug 920964)
* New blockers, any updates?
* New blockers, any updates?
** <strike>{{bug|915697}} - Flashing Unagi or Inari devices with latest master build fails and we end up with a black screen</strike>
** <strike>{{bug|915697}} - Flashing Unagi or Inari devices with latest master build fails and we end up with a black screen</strike>
Line 33: Line 36:
** We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
** We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
*** P1 - critical, constant failures
*** P1 - critical, constant failures
*** P2 - intermittent Failures, enhancements
*** P2 - new tests - the ones with [qa-needed] whiteboard entry are handled first
*** P3 - new tests - the ones with [qa-needed] whiteboard entry are handled first
*** P3 - intermittent Failures, enhancements
*** P4 - Rare failures (once a month)
*** P4 - Rare failures (once a month)
*** P5 - refactoring, small enhancements
*** P5 - refactoring, small enhancements
Line 52: Line 55:


= Project Updates =
= Project Updates =
== Mozmill (Henrik) ==
* Mozmill 2.0 and 1.5.23 have been released
* Working on a proposal for the future development


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
Line 57: Line 64:
** Working like crazy to get the perf tests running again, including a bunch of new scrolling tests and a new FPS metric.
** Working like crazy to get the perf tests running again, including a bunch of new scrolling tests and a new FPS metric.
** Also trying to get Eideticker into a presentable state for the Summit.
** Also trying to get Eideticker into a presentable state for the Summit.
* [rwood] Some updates for endurance tests for 1.3/master; pull request submitted
* [rwood] Some updates for endurance tests for 1.3/master; pull request submitted ({{bug|920180}})
* [rwood] Will be demonstrating the endurance tests at the Summit innovation fair in Brussels, if a table becomes available (currently on the waiting list)
* [rwood] Will be demonstrating the endurance tests at the Summit innovation fair in Brussels, if a table becomes available (currently on the waiting list)
== WebRTC (Henrik) ==
* Goals progress:
* TBD


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
Line 74: Line 77:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
* Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
* We have added a Top Bugs section to our weekly etherpad in Softvision team to keep track of the most important P1 bugs
* Resolved Fixed:
* Resolved Fixed:
** {{bug|888924}} - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
** {{bug|888924}} - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
Line 102: Line 107:


** Andrei
** Andrei
***
*** {{bug|917771}} - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage


{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"

Latest revision as of 14:06, 16 October 2013

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Mario, Andreea, Cosmin, Henrik, Dave, Otilia, Adrian, Mihai, Andrei
    • TBD
  • Chair: Dave Hunt
  • Notes: Mario

Last Weeks Action Items

Highlights

  • [henrik] Automation Development report – week 38 2013
  • [henrik] Due to constant crashes, we disabled Windows 8.1 tests until we get the final version of 8.1
  • [henrik] Mozmill 2.0 has been released
  • [dave] Released b2gperf 0.8
  • [dave] Released gaiatest 0.14 & 0.15
  • [dave] New blog post - Building a harness for Eideticker... with LEGO
  • [henrik] Disabling Windows Defender on all Windows nodes stopped the critical performance issues (see bug 918676)
  • [henrik] Windows Error Reporting has been disabled for all of our Windows nodes to stop hanging processes (see bug 920964)
  • New blockers, any updates?
    • bug 915697 - Flashing Unagi or Inari devices with latest master build fails and we end up with a black screen
    • bug 919618 - Create VMs for Windows 8.1 final (x86, x86-64) in qa.scl3.mozilla.com
    • bug 920944 - Two instances of the Homescreen app can be launched
    • bug 921194 - TypeError: stack is undefined from trusted_ui.js, line 303
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [Andreea] Bug Priorities - it appears that the new way we organized priorities is making us have way too many P1 bugs
    • We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
      • P1 - critical, constant failures
      • P2 - new tests - the ones with [qa-needed] whiteboard entry are handled first
      • P3 - intermittent Failures, enhancements
      • P4 - Rare failures (once a month)
      • P5 - refactoring, small enhancements
  • [SV] Metro proposal
    • We need to have the structure discussed on the work week inside the repository, so maybe would be good to have a first test: bug 879382
      • mozmill-tests
      • > firefox > libs, tests
      • > metro > libs, tests
    • UI lib will be ready in a couple of days
    • Firefox Nightly should be set as the default browser on Win 8 machines in order to open it in metro mode
    • We need to add the metro testrun to mozmill-automation
    • Have Jenkins configured for metro runs
    • Have the dashboard updated with a metro tab for results

Goals Overview

Project Updates

Mozmill (Henrik)

  • Mozmill 2.0 and 1.5.23 have been released
  • Working on a proposal for the future development

Gaia UI (Dave)

  • Goals progress:
    • Working like crazy to get the perf tests running again, including a bunch of new scrolling tests and a new FPS metric.
    • Also trying to get Eideticker into a presentable state for the Summit.
  • [rwood] Some updates for endurance tests for 1.3/master; pull request submitted (bug 920180)
  • [rwood] Will be demonstrating the endurance tests at the Summit innovation fair in Brussels, if a table becomes available (currently on the waiting list)

Games Benchmarking (Rob, Joel, BC)

  • Deploying a Google Nexus 4 with Firefox OS onto the speedtest framework (Toronto) this week

AWSY (Rob)

  • Continuing development on AWSY test driver
  • Next steps: Jenkins job and node setup when VMs become available; make output available for AWSY dashboard

Softvision Updates

Desktop Automation

  • Goals progress:
  • Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
  • We have added a Top Bugs section to our weekly etherpad in Softvision team to keep track of the most important P1 bugs
  • Resolved Fixed:
    • bug 888924 - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
    • bug 911101 - Test failure 'No item selected for element ID: historyMode' in testDisableCookies.js testEnableCookies.js testRemoveAllCookies.js testRemoveCookie.js
    • bug 912941 - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
    • bug 920416 - Update code to use controller.select() in testPreferences/testPreferredLanguage.js
    • bug 919932 - Clean up multiple instances of teardownModule found in the same test
    • bug 835383 - Add test that installs an addon without EULA directly from addons.mozilla.org
  • Working on:
    • Andreea
      • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
      • bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
      • bug 758187 - [landed on nightly, need backport] Write a new mozmill test for checking location sharing
      • bug 853005 - Update automation script should exit with a non-zero exit code if unable to get update channel
    • Cosmin
      • bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
      • bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
      • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
      • bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
    • Mario
      • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
      • bug 920497 - Update closeTab method in tabs.js to prevent wrong index values
      • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
      • bug 874344 - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
    • Andrei
      • bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 489474 Review Henrik Andreea Write automated tests for user generated video controls
Pull Request Review Henrik/Dave Andreea Update automation script should exit with a non-zero exit code if unable to get update channel
bug 786306 Review Henrik Mario Restart tests logic
bug 599290 Feedback Henrik Cosmin Update SoftwareUpdateAPI to support complete relocation to the about dialog

Mobile (Robocop)

  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 836341 - Robocop: Add test for "Clear download history"
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
    • bug 888277 - Robocop: Add test for Private Browsing
  • Bugs awaiting integration:
    • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
  • Bugs recently integrated:
    • bug 896574 - [fig] Fix and re-enable testAddSearchEngine
    • bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
    • bug 916107 - Tag the BrowserSearch ListView and the TopBookmarksView in order for UI tests to access them
    • bug 896566 - [fig] Fix and re-enable testClearPrivateData
    • bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
  • Issues
    • We are waiting for the new-new-about-home work to finalize before completing the bookmark tests and focusing on other tests.

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] %name%: %task%
Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Automation_Development/Meetings/130930&oldid=729779"