QA/Automation/Meetings/140106: Difference between revisions

< QA‎ | Automation‎ | Meetings
 
(20 intermediate revisions by 5 users not shown)
Line 15: Line 15:
** Wiki transition will happen by next year so we will have our last meeting this year in the old format
** Wiki transition will happen by next year so we will have our last meeting this year in the old format
* {{prev|}} [Henrik] Update the 'How to handle a meeting' wiki page for recording and publishing the video
* {{prev|}} [Henrik] Update the 'How to handle a meeting' wiki page for recording and publishing the video
* {{prev|}} [Henrik] Start recording the meeting
* {{done|}} [Henrik] Start recording the meeting


= Highlights =
= Highlights =
* [%name%] %highlight%
* [Henrik] Automation Development report – week 49/50 2013: http://www.hskupin.info/2013/12/17/automation-development-report-week-4950-2013/
* [Henrik] Mozmill 2.0.3 (Bug 950831), mozmill-automation 2.0.3 released, and new environments available
* [Henrik] Our new staging instance of Mozmill CI is up at http://mm-ci-staging.qa.scl3.mozilla.com:8080
* [henrik] Merged mozmill-ci staging code into production which gives us a lot of new features: https://github.com/mozilla/mozmill-ci/compare/77e01fed58e3...bf27de9419c5
* New blockers, any updates?
* New blockers, any updates?
** %new blockers%
** Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358
** Jenkins is still crashing way too often due to OOM: https://github.com/mozilla/mozmill-ci/issues/314
** Bug 947108 - Request for a staging server instance of Mozmill-CI in qa.scl3.mozilla.com via ESX (and 3 Mac mini)
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


= Roundtable =
= Roundtable =
* TBD
* [henrik] Updates for Wiki pages
** Where should our pages live? We are part of the [https://wiki.mozilla.org/QA|QA team]. But also under [https://wiki.mozilla.org/QA/Desktop_Firefox|Desktop Firefox], or better our own group, which does not only handle Firefox desktop? I would like so given that our name is 'Firefox Automation'.


= Goals Overview =
= Goals Overview =
Line 32: Line 38:


== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* Goals progress:
* Mozmill 2.0.3 has been released
* TBD
* CI staging has been upgraded before Christmas and didn't show any major failure
* Ci production has been upgraded to 2.0.3 last Thursday
* Sadly an issue with JSbridge (see {{bug|956315}}) came up which mainly affects our OS X machines. As it looks like it could be a regression in NSPR for Aurora and Nightly.


== Eideticker CI (Dave) ==
== Eideticker CI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
* Hardware is in London office now at 10.246.24.39. We just need to sort out the networking so that we can publish results and administer it remotely.


== AWSY - Are We Slim Yet (Rob) ==
== AWSY - Are We Slim Yet (Rob) ==
Line 46: Line 54:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
* Restructure done


* Resolved Fixed:
* Resolved Fixed:
** {{bug|?}} - ADD DESCRIPTION HERE
** cleaned up bug-log. closed as WFM the following bugs: 755179, 881184, 819255, 821716, 911908, 856547, 913477, 914096, 914215, 892428, 915030, 914997, 921357, 921362, 922087
 
** {{bug|952125}} - Master Dialog Modal is hanging in /restartTests\testPreferences_masterPassword\test2.js
** {{bug|952420}} - Add pref extensions.defaultProviders.enabled to FirefoxMetroProfile to enable extensions
** {{bug|942077}} - Test failure "Element.waitForElement(): Element 'Selector: *[label='Test Bookmark 1']' has been found" in /testBookmarks_OpenAndClose/test1.js
** {{bug|951715}} - Mozmill fails to properly initialize metro mode
** {{bug|944337}} - Test failure "Modal dialog has been found and processed" in /testAddons/testInstallAddonWithEULA.js
* Working on:
* Working on:
** Andreea
** Andreea
***
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|800872}} - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
** Andrei
** Andrei
***
*** {{bug|917771}} - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
*** {{bug|835739}} - Move element specifications for find bar into lib/toolbars.js
*** {{bug|856084}} - Test failure "The cookie has been removed - got 'false'" in /testPreferences/testRemoveCookie.js
*** {{bug|950003}} - Test failure 'Notification popup visibility state has been changed' in /restartTests/testAddons_installMultipleExtensions/test1.js
*** {{bug|944717}} - Test failure "Successfully restarted in 32bit mode after requesting it - 'x86_64-gcc3' should equal 'x86-gcc3'" in /restartTests/testRestartChangeArchitecture/test3.js
*** {{bug|908649}} - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
*** check Mozmill Automation how Mercurial returns the exit code for all platforms in case 'hg pull' fails (see github mozmill-ci issue under blockers)
*** check what we need in mozmill-dashboard for metro support -- we probably need https://github.com/mozilla/mozmill-dashboard/issues/47)
** Cosmin
** Cosmin
***
*** {{bug|952125}} - Master Dialog Modal is hanging in /restartTests\testPreferences_masterPassword\test2.js
*** {{bug|915563}} - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
*** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog
*** {{bug|684801}} - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
** Mario
** Mario
***
*** {{bug|895996}} - [ku] testAddMozSearchProvider.js fails with "Disconnect Error:  Application unexpectedly closed" because the print dialog gets opened
*** {{bug|909227}} - [lg] Test failure "The text on the page has been highlighted - '' should equal 'community'" in /testFindInPage/testFindInPage.js
*** {{bug|851502}} - Create an Endurance test to measure html5 video memory use


== Mobile (Robocop) ==
== Mobile (Robocop) ==
Line 69: Line 93:
* [https://ateam.etherpad.mozilla.org/mozauto-131223 131223 - 140127]
* [https://ateam.etherpad.mozilla.org/mozauto-131223 131223 - 140127]
* [https://ateam.etherpad.mozilla.org/mozauto-131230 131230 - 140103]
* [https://ateam.etherpad.mozilla.org/mozauto-131230 131230 - 140103]
* [https://ateam.etherpad.mozilla.org/mozauto-140106 140106 - 140110]


= Meeting Notes =
= Meeting Notes =
The meeting notes for this meeting can be read in the following etherpad:  
The meeting notes for this meeting can be read in the following etherpad:  
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20140106
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20140106
Or you can watch the meeting in our [https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=mfrkjyGcVfSkhuE VidyoReplay archive].


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}} [Henrik] - Update the automation tools goals on the Wikipage
* {{new|}} [Henrik] - Get Puppet back to help updating the machines
* {{new|}} [Henrik] - Update Pulse to rotate locales on a daily basis in order to cover more in our testing without an increase in resources drain.
* {{new|}} [SV Team] - Ask the Robocop team if they are still interested in joining this meeting and if not update the template
* {{prev|}} [Henrik] Update the 'How to handle a meeting' wiki page for recording and publishing the video
* {{prev|}} [Henrik] Update meeting page for new format
** Removing AWSY from the template
* {{prev|}} [Andrei] Check Mozmill Automation how Mercurial returns the exit code    for all platforms in case 'hg pull' fails (see github mozmill-ci  issue  under blockers)

Latest revision as of 20:51, 13 January 2014

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andrei
  • Notes: Mario

Last Weeks Action Items

  • [CARRY OVER] [Andrei] Check Mozmill Automation how Mercurial returns the exit code for all platforms in case 'hg pull' fails (see github mozmill-ci issue under blockers)
  • [CARRY OVER] [Henrik] Update meeting page for new format
    • Wiki transition will happen by next year so we will have our last meeting this year in the old format
  • [CARRY OVER] [Henrik] Update the 'How to handle a meeting' wiki page for recording and publishing the video
  • [DONE] [Henrik] Start recording the meeting

Highlights

Roundtable

  • [henrik] Updates for Wiki pages
    • Where should our pages live? We are part of the team. But also under Firefox, or better our own group, which does not only handle Firefox desktop? I would like so given that our name is 'Firefox Automation'.

Goals Overview

Project Updates

Mozmill (Henrik)

  • Mozmill 2.0.3 has been released
  • CI staging has been upgraded before Christmas and didn't show any major failure
  • Ci production has been upgraded to 2.0.3 last Thursday
  • Sadly an issue with JSbridge (see bug 956315) came up which mainly affects our OS X machines. As it looks like it could be a regression in NSPR for Aurora and Nightly.

Eideticker CI (Dave)

  • Goals progress:
  • Hardware is in London office now at 10.246.24.39. We just need to sort out the networking so that we can publish results and administer it remotely.

AWSY - Are We Slim Yet (Rob)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Goals progress:
  • Resolved Fixed:
    • cleaned up bug-log. closed as WFM the following bugs: 755179, 881184, 819255, 821716, 911908, 856547, 913477, 914096, 914215, 892428, 915030, 914997, 921357, 921362, 922087
    • bug 952125 - Master Dialog Modal is hanging in /restartTests\testPreferences_masterPassword\test2.js
    • bug 952420 - Add pref extensions.defaultProviders.enabled to FirefoxMetroProfile to enable extensions
    • bug 942077 - Test failure "Element.waitForElement(): Element 'Selector: *[label='Test Bookmark 1']' has been found" in /testBookmarks_OpenAndClose/test1.js
    • bug 951715 - Mozmill fails to properly initialize metro mode
    • bug 944337 - Test failure "Modal dialog has been found and processed" in /testAddons/testInstallAddonWithEULA.js
  • Working on:
    • Andreea
      • bug 880417 - Create user interface shared module for metro
      • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
    • Andrei
      • bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
      • bug 835739 - Move element specifications for find bar into lib/toolbars.js
      • bug 856084 - Test failure "The cookie has been removed - got 'false'" in /testPreferences/testRemoveCookie.js
      • bug 950003 - Test failure 'Notification popup visibility state has been changed' in /restartTests/testAddons_installMultipleExtensions/test1.js
      • bug 944717 - Test failure "Successfully restarted in 32bit mode after requesting it - 'x86_64-gcc3' should equal 'x86-gcc3'" in /restartTests/testRestartChangeArchitecture/test3.js
      • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
      • check Mozmill Automation how Mercurial returns the exit code for all platforms in case 'hg pull' fails (see github mozmill-ci issue under blockers)
      • check what we need in mozmill-dashboard for metro support -- we probably need https://github.com/mozilla/mozmill-dashboard/issues/47)
    • Cosmin
      • bug 952125 - Master Dialog Modal is hanging in /restartTests\testPreferences_masterPassword\test2.js
      • bug 915563 - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
      • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
      • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
    • Mario
      • bug 895996 - [ku] testAddMozSearchProvider.js fails with "Disconnect Error: Application unexpectedly closed" because the print dialog gets opened
      • bug 909227 - [lg] Test failure "The text on the page has been highlighted - should equal 'community'" in /testFindInPage/testFindInPage.js
      • bug 851502 - Create an Endurance test to measure html5 video memory use

Mobile (Robocop)

  • Goals progress:
  • TBD

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Or you can watch the meeting in our VidyoReplay archive.

Action items

  • [NEW] [Henrik] - Update the automation tools goals on the Wikipage
  • [NEW] [Henrik] - Get Puppet back to help updating the machines
  • [NEW] [Henrik] - Update Pulse to rotate locales on a daily basis in order to cover more in our testing without an increase in resources drain.
  • [NEW] [SV Team] - Ask the Robocop team if they are still interested in joining this meeting and if not update the template
  • [CARRY OVER] [Henrik] Update the 'How to handle a meeting' wiki page for recording and publishing the video
  • [CARRY OVER] [Henrik] Update meeting page for new format
    • Removing AWSY from the template
  • [CARRY OVER] [Andrei] Check Mozmill Automation how Mercurial returns the exit code for all platforms in case 'hg pull' fails (see github mozmill-ci issue under blockers)