Auto-tools/Automation Development/Meetings/130429: Difference between revisions

← Older edit

Auto-tools/Automation Development/Meetings/130429 (view source)

Revision as of 16:33, 29 April 2013

2,962 bytes added , 29 April 2013

→‎Action items

Dpetrovici

Confirmed users

90

edits

@@ Line 19: / Line 19: @@
 * [henrik] Nightly Tester Tools 3.5 released
 * [dave] Reminder: I will be on PTO from Thursday 2nd May to Monday 20th May
+* [rwood] I will also be on PTO Friday May 3rd to Monday May 20th, inclusive
 * New blockers, any updates?
 ** [henrik] We are now skipping update tests for build notifications without a previous build id. Those are related to broken previous builds and RelEng can't fix it as of now
@@ Line 25: / Line 26: @@
 = Roundtable =
+* [henrik] Why was the old ci-master offline through the whole weekend?
+** I requested to shutdown the old ESX cluster but forgot that our old ci-master is running on a Linux VM inside it. Thanks to Daniela who spotted this today
+** For now the master is reachable via http://release1.qa.mtv1.mozilla.com:8080/
+** I have seen that the minis can connect to the new ci-master. Seems like the network routes have been setup that way. I will create a patch to get the minis into the new master
+** Once IT has finished preparing our new mac minis we will replace them all
 * [henrik] Mozillians.org
 ** How do we want to name our group: automation development vs. automation?
@@ Line 46: / Line 52: @@
 * We are now able to recover from a failure in B2G desktop client tests on Travis, and at last count have 24 failures (and 36 passes). See the results [https://travis-ci.org/mozilla/gaia-ui-tests/builds/6666112 here].
 * Made progress on cleaning up the databases and profile between device tests.
+* [rwood] Finished bluetooth discoverable test
+* [rwood] Gaia-ui endurance tests:
+** Code updates after review by Dave
+** Setting up Jenkins now, will have more test results data for DataZilla soon
 == WebAPI (Rob) ==
-* Goals progress:
+* [rwood] Fix for WebTelephony test_outgoing_answer_hangup_oncallschanged test ({{bug|849714}})
-* TBD
+* [rwood] Fix WebTelephony intermittent failure test fallout by having all telephony tests delete any existing emulator calls at start-up ({{bug|811167}})
 == WebRTC (Henrik) ==
-* Goals progress:
+* New data channel framework up for first feedback round on {{bug|796894}}
-* TBD
+* Ted is working on the integration of faked devices
 = Softvision Updates =
@@ Line 64: / Line 74: @@
 ** {{bug|834163}} - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
 ** {{bug|865211}} - Test failure "aController.window.PlacesStarButton is undefined" in /testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/test1.js
+** {{bug|671476}} - Mozmill Endurance test for loading a SWF video via URL
 * Blocked bugs:
 ** {{bug|763159}} - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
 ** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
-*** needs CA certificate
+*** needs CA certificate, Brandon answered to Henrik that it will be ready in a few days
 * Working on:
@@ Line 76: / Line 87: @@
 ** {{bug|732353}} - Disable all Discovery Pane tests due to unpredictable web dependencies
 ** {{bug|857551}} - Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
-** {{bug|671476}} - Mozmill Endurance test for loading a SWF video via URL
 ** {{bug|671479}} - Mozmill Endurance test for loading a SWF video via iframe
 ** {{bug|763461}} - Mozmill tests for cut-off elements should not report failure for scrollable direction
@@ Line 82: / Line 92: @@
 ** {{bug|764640}} - Mozmill returns PASS/SKIP/FAIL == 0 for test_assertions.js
 ** {{bug|860670}} - mozmill.utils.getWindowByType fails for type: Addons:Blocklist - Fails with "Window has been found."
-** {{bug|860662}} - controller.select() fails to select the option by value
 ** {{bug|864268}} - Lookup class does no longer expose the `expression` property
+** [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] - Update automation script to re-raise exceptions in order to have a non-zero exit code
 {| border="1" cellpadding="2" align="center"
 |+<b> Waiting for review/Feedback/Need info</b>
@@ Line 106: / Line 115: @@
 |-
 | {{bug|827276}} || Needinfo || Alex Keybl || Andrei || Test failure 'Check for updates has been completed' in /restartTests/testSoftwareUpdateAutoProxy/test2.js
-|-
-| [https://github.com/whimboo/mozmill-automation/pull/32/ Non-zero exit status 2.0] || Review || Henrik/Dave || Andreea || Update automation script to re-raise exceptions in order to have a non-zero exit code
 |-
 | {{bug|864375}} || Feedback || Henrik || Andreea || mozelement/elementslib should not invoke elements at declaration time
@@ Line 114: / Line 121: @@
 |-
 | {{bug|865627}} || Review || Henrik/Dave || Daniela || Change exists method for handling Lookup expression that does not exist
-|-
-| {{bug|671476}} || Review || Andreea || Daniela || Mozmill Endurance test for loading a SWF video via URL
 |-
 | {{bug|671479}} || Review || Andreea || Daniela || Mozmill Endurance test for loading a SWF video via iframe
 |-
 | {{bug|857551}} || Review || Andreea || Daniela || Create HTML page containing all the elements necessary for L10N testing of the context menu access keys
+|-
+| {{bug|860662}} || Review || Dave/Henrik || Andrei || controller.select() fails to select the option by value
 |}
 == Mobile (Robocop) ==
-* Goals progress:
+* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
-* TBD
+* Bugs with work in progress:
+** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
+** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
+** {{Bug|846340}} - Robocop: Add test for 'Clear Site Settings'
+** {{Bug|836341}} - Robocop: Add test for "Clear download history"
+** {{Bug|838596}} - Robocop: Add test for 'Master Password' feature
+** {{Bug|846296}} - Robocop: Add test for 'Add Search Engine' feature
+** {{Bug|833832}} - Robocop: Add test for Import from Android feature
+** {{Bug|855978}} - Robocop: upgrade to robotium-solo-4.0.jar
+* Bugs recently integrated:
+**{{Bug|864280}} - Robocop: Cleanup of BaseTest.java.in
+* Intermittent fails we investigated:
+** {{Bug|836818}} - Intermittent testOverscroll | Checking gecko didn't draw unnecessarily - got true, expected false
+** {{Bug|851861}} - Intermittent testOverscroll, testPanCorrectness, testAxisLocking, testLoad, testFlingCorrectness | Pixel at 100, 0 - Color rgba(0,0,0,255) not close enough to expected rgb(32,100,0)
+** {{Bug|854043}} - Intermittent testWebContentContextMenu | Verify that the download started - The download started
+*Notes/Issues/Questions:
+** We have a few patches that pass on try but we are still seeing {{Bug|663657}}. We have to wait until the issue is fixed before looking to integrate the patches
 = Personal Status =
@@ Line 135: / Line 158: @@
 ==Action items==
-* {{new|}} %name%: %task%
+* {{new|}} Henrik: Send an email to the automation list about the name of the group being called automation
+* {{new|}} Henrik: File a bug to make public information visible (Mozillians)
+* {{new|}} Henrik: Push the mozmill 2.0 release after the meeting
+* {{new|}} Andrei: Send an email to Neil regarding bug 803492
+* {{prev|}} Henrik: Update the goals page
+* {{prev|}} Anthony: Ensure any Metro tests are suitably tagged with in-testsuite?