QA/Automation/Meetings/121022: Difference between revisions

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
 
(8 intermediate revisions by 5 users not shown)
Line 7: Line 7:
= General =
= General =
* Attendees:  
* Attendees:  
** TBD
** Andreea, Mihaela, Alex, Rob, Henrik, Vlad, Anthony, Dave
* This meeting:
* This meeting:
** Chair: Andreea Matei
** Chair: Andreea Matei
Line 14: Line 14:
* {{new|}} Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
* {{new|}} Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
* {{new|}} Clint: Follow-up with Neil on the geolocation notification
* {{new|}} Clint: Follow-up with Neil on the geolocation notification
* {{new|}} Henrik: Update project list/goals  
* {{done|}} Henrik: Update project list/goals  
** http://publish.smartsheet.com/4be71722fafd4cddacce9b9ca12a8482
* {{new|}} Henrik: Set up meeting page for updated Q4 goals
* {{new|}} Henrik: Set up meeting page for updated Q4 goals
* {{done|}} Henrik: Close blocker {{bug|797835}} as WONTFIX
* {{done|}} Henrik: Close blocker {{bug|797835}} as WONTFIX
* {{new|}} Dave: Drop {{bug|702605}} from the list of issues - we don't need to track this every week
* {{done|}} Dave: Drop {{bug|702605}} from the list of issues - we don't need to track this every week
* {{new|}} Mihaela: Put comments in bug {{bug|773632}} with status of her investigation
* {{new|}} Mihaela: Put comments in bug {{bug|773632}} with status of her investigation
* {{new|}} Henrik: Add option to mozdownload to retry the download of the build
* {{ok|}} Henrik: Add option to mozdownload to retry the download of the build
* {{done|}} Alex: Talk to Otilia to get back to us with the schedule of the week for Softvision
* {{done|}} Alex: Talk to Otilia to get back to us with the schedule of the week for Softvision
* {{done|}} Alex: File a bug for restart logic in mozmill - mentored by Henrik
* {{done|}} Alex: File a bug for restart logic in mozmill - mentored by Henrik
Line 39: Line 40:
= Issues =
= Issues =
* {{bug|774892}} - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
* {{bug|774892}} - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
* {{bug|702605}} - Allow interaction events to be injected into the Event Queue
* {{bug|773632}} - High results on mozmill endurance test on Mac 10.7.4_x64 since Jul 5
* {{bug|773632}} - High results on mozmill endurance test on Mac 10.7.4_x64 since Jul 5
* {{bug|745975}} - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
* {{bug|745975}} - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
Line 57: Line 57:
** {{done|}} {{bug|782918}} - Get rid of controller.assert() calls in favor of expect.* and assert.* methods
** {{done|}} {{bug|782918}} - Get rid of controller.assert() calls in favor of expect.* and assert.* methods
** {{bug|797389}} - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
** {{bug|797389}} - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
*** tinderbox was not helpful, still 114 changesets remained. switched to building firefox
** {{bug|772360}} - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created"
*** tried to continue investigation using Dave;s simple tests but they are not reliable, as they both fail intermittently
*** moving on with investigation. I still think we do not click the element because we are not retrieving it correctly just need to demonstrate that somehow


* Sprint 3 - 15-26 Oct: http://scrumbu.gs/t/Auto_Dev/121015/
* Sprint 3 - 15-26 Oct: http://scrumbu.gs/t/Auto_Dev/121015/
Line 62: Line 66:
** {{bug|784305}} - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
** {{bug|784305}} - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
*** investigating, but it's blocked by {{bug|785014}} - Build restartless.xpi as a plain bootstrapped extension
*** investigating, but it's blocked by {{bug|785014}} - Build restartless.xpi as a plain bootstrapped extension
** {{bug|783197}} - Ensure restoreDefaultEngines() completely resets the installed engines
*** I have a working patch but as discussed on irc it will be r- at this point because for some reason I cannot use XPCNativeWrapper and the workaround is not approved


= Roundtable =
= Roundtable =
Line 94: Line 100:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{ok|}} Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
* {{ok|}} Henrik: Add option to mozdownload to retry the download of the build
* {{new|}} Vlad: follow up with bug 772360 with details re the simple test failures
* {{new|}} Andreea: Find regression range for restartless addon bug
* {{new|}} Mihaela: Put comments in bug {{bug|773632}} with status of her investigation

Latest revision as of 10:48, 13 January 2014

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

  • Attendees:
    • Andreea, Mihaela, Alex, Rob, Henrik, Vlad, Anthony, Dave
  • This meeting:
    • Chair: Andreea Matei

Last Weeks Action Items

  • [NEW] Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
  • [NEW] Clint: Follow-up with Neil on the geolocation notification
  • [DONE] Henrik: Update project list/goals
  • [NEW] Henrik: Set up meeting page for updated Q4 goals
  • [DONE] Henrik: Close blocker bug 797835 as WONTFIX
  • [DONE] Dave: Drop bug 702605 from the list of issues - we don't need to track this every week
  • [NEW] Mihaela: Put comments in bug bug 773632 with status of her investigation
  • [ON TRACK] Henrik: Add option to mozdownload to retry the download of the build
  • [DONE] Alex: Talk to Otilia to get back to us with the schedule of the week for Softvision
  • [DONE] Alex: File a bug for restart logic in mozmill - mentored by Henrik
    • bug 804158 - make mozmill-restart skip test in a folder after one has failed

Highlights

  • [%name%] %highlight%

Goals Overview

Blockers

  • Android emulator does not work for screen orientation - given that this API is a central piece of Firefox OS we have to get this fixed
  • bug 799433 - Removal of PageThumbsCache causes Firefox to keep loading 'about:newtab' forever after removing of page history (:Felipe Gomes is investigating)
  • bug 781129 - Notifications for outdated builds are getting send via Pulse
  • bug 773116 - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4
  • bug 777354 - Regression in shutdown time of httpd.js (~6s) when multiple local pages have been opened (feedback from waldo)

Issues

  • bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
  • bug 773632 - High results on mozmill endurance test on Mac 10.7.4_x64 since Jul 5
  • bug 745975 - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
  • bug 757122 - Pulse: Notifications for finished builds should not be send out before the builds are available for download

Softvision Updates

  • Finishing Sprint 2 - 08-19 Oct: http://scrumbu.gs/t/Auto_Dev/121008/
    • bug 792394 - Replace expect with waitFor to ensure the page title matches the underlined text in /testAwesomeBar tests - blocked
      • found the cause of the failures, lazy DB to get history items
      • replaced default bookmarked pages with simple ones in dependecy bug 803046 and that seems to work
      • testSwitchToTab.js needed an update in bug 779127 - backport on aurora tomorrow
    • bug 789987 - Create Mozmill test for Private Browsing cache handling - waiting review
    • [DONE] bug 782918 - Get rid of controller.assert() calls in favor of expect.* and assert.* methods
    • bug 797389 - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
      • tinderbox was not helpful, still 114 changesets remained. switched to building firefox
    • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created"
      • tried to continue investigation using Dave;s simple tests but they are not reliable, as they both fail intermittently
      • moving on with investigation. I still think we do not click the element because we are not retrieving it correctly just need to demonstrate that somehow
  • Sprint 3 - 15-26 Oct: http://scrumbu.gs/t/Auto_Dev/121015/
    • bug 708491 - testSecurityNotification.js fails due to timeout on cert_domain_link - waiting review
    • bug 784305 - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
      • investigating, but it's blocked by bug 785014 - Build restartless.xpi as a plain bootstrapped extension
    • bug 783197 - Ensure restoreDefaultEngines() completely resets the installed engines
      • I have a working patch but as discussed on irc it will be r- at this point because for some reason I cannot use XPCNativeWrapper and the workaround is not approved

Roundtable

  • [henrik] Total fallout of Mozmill CI before a beta release (Github issue)
    • Why Softvision hasn't noticed that and reported it to us?
    • How can we safely avoid that in the future?
  • [henrik] bug 803493 - Move WebRTC Mochitests from dom/tests/mochitests/media to /dom/media/tests
    • Ensure that we have a consistent test location across the different modules
    • Which way do we want? What can we do at all? Or what should we do or not?
  • [henrik] WebAPI tests
    • Review process
      • The person who creates the test, uploads the patch to Bugzilla and ask for feedback from the developer of the feature. This process is cycling until you get a f+.
      • Now it's time to ask for review from a testing guy. Candidates should be jgriffin, rwood, davehunt, or whimboo. Once you get r+ the patch is ready to land.
      • Land the patch, and if you don't have permissions set the checkin-needed keyword.
    • Test Plans
      • Can we have co-work with QA feature owners so we can re-use the QA testplan page for automated testcases? A good example is the one for screen orientation

Presentation / Demo

  • [%name%] %topic%

Triage

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [ON TRACK] Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
  • [ON TRACK] Henrik: Add option to mozdownload to retry the download of the build
  • [NEW] Vlad: follow up with bug 772360 with details re the simple test failures
  • [NEW] Andreea: Find regression range for restartless addon bug
  • [NEW] Mihaela: Put comments in bug bug 773632 with status of her investigation
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Automation/Meetings/121022&oldid=887895"