QA/Automation/Meetings/140407: Difference between revisions

 
(22 intermediate revisions by 6 users not shown)
Line 5: Line 5:


= General =
= General =
* Attendees:
* Attendees: Andrei, Andreea, Mihaela, Daniel, Henrik, Cosmin, Nils, Otilia
* Chair: Daniel
* Chair: Daniel
* Notes: Andreea
* Notes: Andreea


= Last Weeks Action Items =
= Last Weeks Action Items =
* {{new|}} [Henrik] Update the goal list and send and email update
* {{done|}} [Henrik] Update the goal list and send and email update
* {{new|}} [Nils] Check if links to WebRTC bugs made it into the Wiki from last week
* {{done|}} [Nils] Check if links to WebRTC bugs made it into the Wiki from last week
* {{new|}} [Daniel] file an issue against mozmill-dashboard to implement a testrun status report
* {{done|}} [Daniel] file an issue against mozmill-dashboard to implement a testrun status report
** https://github.com/mozilla/mozmill-dashboard/issues/93
* {{prev|}} [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
* {{prev|}} [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
** https://etherpad.mozilla.org/tests-to-automate
** once final list will be over, needed bugs will be filed and the email thread will be created
* {{prev|}} [Softvision] Metro
* {{prev|}} [Softvision] Metro
** finish mozmill tests for metro  
** finish mozmill tests for metro
*** {{bug|883860}} - Create metro mozmill test for Pop-up blocker
***  Only this test left to be completed;
** {{bug|968079}} - Update tabs.js metro library to use UI elements only
*** final review provided and it's almost finished


= Highlights =
= Highlights =
* [henrik] Mozmill Automation 2.0.6.1 released: https://groups.google.com/forum/#!topic/mozilla.dev.automation/ubnyQviFwao
* [henrik] Mozmill Automation 2.0.6.1 released: https://groups.google.com/forum/#!topic/mozilla.dev.automation/ubnyQviFwao
* New blockers, any updates?
* New blockers, any updates?
** {{bug|992154}} - Cronjob for testcase-data on mozqa1.qa.scl3 no longer updates HTTP root
** <strike>{{bug|992154}} - Cronjob for testcase-data on mozqa1.qa.scl3 no longer updates HTTP root</strike>
** {{bug|992753}} - Update SSL certificate for ssl-md5.mozqa.com
** {{bug|992753}} - Update SSL certificate for ssl-md5.mozqa.com
* Github blockers
* Github blockers
Line 27: Line 34:


= Roundtable =
= Roundtable =
* New goals for Q2: https://wiki.mozilla.org/QA/Goals/2014q2


= Goals Overview =
= Goals Overview =
Line 34: Line 42:


== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
*
* Mozmill Automation 2.0.6.1 released: https://groups.google.com/forum/#!topic/mozilla.dev.automation/ubnyQviFwao
* With Mozmill-CI we will be able to handle RC->Beta updates soon. We need a way to test this
* Henrik detected an issue with mozmill-env. It misses installed setuptools. An upgrade of virtualenv will fix this, so we have to recreate the environments (https://github.com/mozilla/mozmill-environment/issues/75) before we can upgrade to Python 2.7.5 on the remaining boxes
 
== TPS (Henrik) ==
== TPS (Henrik) ==
*
* All remaining backports have been landed on mozilla-aurora
* Bug 986190 - [tps] Synced data on the server is not always wiped at the end of a test
* Bug 990797 - TPS CI errors out when trying to e-mail results
* Bug 989045 - [tps] Registering of observer topics happens too late so  'weave:engine:start-tracking' can be missed during startup
* Bug 989249 - test_addon_reconsiling.js broken due to missing sync
* Work happens on bug 992198, where we want to allow wiping the remote server on first sync
 
== WebRTC (Nils) ==
== WebRTC (Nils) ==
*
* Solved the highest WebRTC orange regarding missing canplaythrough event on B2G last week https://bugzilla.mozilla.org/show_bug.cgi?id=989047
* WebRTC tiger team started to setup an ideal WebRTC calling environment with dedicated machines and network connection
* WebRTC tiger team solved the problem of errors in IPC tests are not propagating properly up to mochitest
* Found 2 issues with RTCPeerConnection.close(), one of them is solved already (https://bugzilla.mozilla.org/show_bug.cgi?id=991368) the other still being discussed (https://bugzilla.mozilla.org/show_bug.cgi?id=989936)


= Softvision Updates =
= Softvision Updates =
Line 44: Line 64:
* Goals progress:
* Goals progress:
**
**
* Updates: A week full of regressions and crashes, mostly on endurance and security tests and crashes related to Flash.
* Resolved Fixed:
* Resolved Fixed:
**'''[Mozmill automation]''' Added --override-update-settings parameter for update testruns (#132) [[#133 https://github.com/mozilla/mozmill-automation/pull/133]]
**'''[Mozmill automation]''' Added --override-update-settings parameter for update testruns (#132) [[#133 https://github.com/mozilla/mozmill-automation/pull/133]]
Line 54: Line 76:
*** {{bug|990557}} - Test failure "[object Object] - got 'false' " in testSecurity/testMD5HashSignature.js
*** {{bug|990557}} - Test failure "[object Object] - got 'false' " in testSecurity/testMD5HashSignature.js
** Andrei
** Andrei
***
***{{bug|891288}} - Create subdomains of mozqa with self-signed SSL certificates for all supported versions versions (SSL3 - TLS 1.1)
***{{bug|989922}} - Test failure "Element.waitForElement(): Element 'ID: errorTitleText' has been found" in testSecurity/testSSLDisabledErrorPage.js
***{{bug|972912}} - Mozmill fails to ran all expected tests
***{{bug|990509}} - TPS test failure "[phase3] Exception caught: ASSERTION FAILED! error locating tab" in test_tabs.js
** Cosmin
** Cosmin
***'''[Mozmill CI]'''  - Added --override-update-settings parameter for ondemand_update job (#428) [[#429 https://github.com/mozilla/mozmill-ci/pull/429]]
***'''[Mozmill CI]'''  - Added --override-update-settings parameter for ondemand_update job (#428) [[#429 https://github.com/mozilla/mozmill-ci/pull/429]]
Line 64: Line 89:
*** {{bug|992139}} - '''[mozversion]''' Enhance mozversion to return "application_name" if "application_code_name" doesn't exists
*** {{bug|992139}} - '''[mozversion]''' Enhance mozversion to return "application_name" if "application_code_name" doesn't exists
** Daniel
** Daniel
***
*** {{bug|987098}} - Failure 'Argument 1 of Window.getComputedStyle is not an object' in testPopups\testPopupsBlocked.js
*** {{bug|969428}} - Create form data backend library for handling form related actions
*** {{bug|936478}} - Test failure "controller.waitForPageLoad(): Timeout waiting for page loaded" in /testSecurity/testSafeBrowsingWarningPages.js
*** {{bug|883860}} - Create metro mozmill test for Pop-up blocker
*** {{bug|968079}} - Update tabs.js metro library to use UI elements only
*** {{bug|816084}} - Update toolbars.js shared module to move elements from security tests in locationBar.getElement()
*** {{bug|863139}} - Add ui module for in-content security pages & security dialogs
*** {{bug|991066}} - Test failure "Video data is available" in endurance/testVideo_OGVBuffering/test1.js
** Mihaela
*** {{bug|974914}} - Add test for the functionality of Panel Menu buttons in Australis
**** failures investigations and new fixes
**** partial patch green in tbpl
*** {{bug|973641}} - Add test for the functionality of addon button in Australis
**** failures investigation - blocked by {{bug|985332}}
*** Moztrap need_automation tests - triage and check for existing coverage
*** work at a list of tests needed to automate for in-testsuite/in-qa-testsuite bugs


= Personal Status =
= Personal Status =
Line 77: Line 117:


==Action items==
==Action items==
* {{prev|}} [Mihaela, Daniel] Get a list of the tests needed to automate - create  an email thread on the automation list to get them prioritized  (in-qa-testsuite? flag)
* {{prev|}} [Softvision] Metro
** finish mozmill tests for metro
*** bug 883860 - Create metro mozmill test for Pop-up blocker
*** bug 968079 - Update tabs.js metro library to use UI elements only
* {{new|}} [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
* {{new|}} [Henrik] Talk to Marc about the goals for Nils
Confirmed users
571

edits