MozillaWiki

Auto-tools/Automation Development/Meetings/130715: Difference between revisions

Page Discussion

Auto-tools/Automation Development/Meetings/130715 (view source)

Revision as of 16:32, 15 July 2013

3,732 bytes added ,  15 July 2013
→‎Action items
 
(26 intermediate revisions by 9 users not shown)
Line 5: Line 5:


= General =
= General =
* Attendees:  
* Attendees:
** TBD
** Dave, Andrei, Daniela, Andreea, Rob, Adrian, Henrik, Cosmin, Otilia
* Chair: TBD
* Chair: Henrik
* Notes: TBD
* Notes: Andreea


= Last Weeks Action Items =
= Last Weeks Action Items =
Line 17: Line 17:


= Highlights =
= Highlights =
* [%name%] %highlight%
* [henrik] Due to the constant failures in submitting Mozmill test results to iriscouch we have been moved to a new server. Big thanks goes to Jason Smith from IrisCouch for his ultra-fast response and action!
* [henrik] About to fix a major bug in jsbridge which leds to dataloss when sending too much data. See bug 764640.
* [dave] [https://travis-ci.org/mozilla/gaia-ui-tests/builds/8776316 First passing Travis-CI build] for Gaia UI tests on desktop build!
* [dave] HTML report for Gaia UI tests [http://qa-selenium.mv.mozilla.com:8080/view/B2G%20Unagi/job/b2g.unagi.mozril.gaia.master.ui/101/HTML_Report/? finally available]!
* [dave] Gaia UI tests are now running (and passing!) [https://tbpl.mozilla.org/?tree=Cedar in TBPL against the Cedar branch]
* [dave] b2gpopulate 0.8 released with support for call history and MMS messages
* [dave] b2gperf 0.5 released
* New blockers, any updates?
* New blockers, any updates?
** %new blockers%
** {{bug|892928}} - b2gperf is failing to gather FPS measurements on mozilla-central builds
** {{bug|893693}} - TypeError: IccHelper.removeEventListener is not a function
* You can find all blockers here: http://bit.ly/Tph0NY
* You can find all blockers here: http://bit.ly/Tph0NY


Line 27: Line 34:
** P2 - mozmill 2.0 blocker (if release is approaching, this can take higher priority in order to finish in time)
** P2 - mozmill 2.0 blocker (if release is approaching, this can take higher priority in order to finish in time)
** P3 - not that often failures, medium enhancements
** P3 - not that often failures, medium enhancements
** P4 - new tests - QA needed have priority
** P4 - new tests - the ones needed by the QA team have higher priority
** P5 - refactoring, small enhancements
** P5 - refactoring, small enhancements
** Dependecies take the blocking bug's priority
** Dependecies take the blocking bug's priority
*** Our prioritized backlog: https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndGw5TWNuWWw1VFFzelZHektWRTNaSnc#gid=10
*** Our prioritized backlog: https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndGw5TWNuWWw1VFFzelZHektWRTNaSnc#gid=10
* [Mario] UI objects for content pages
** Do we want to create UI objects in the libraries for content pages?
*** Related to Bug 835383 : https://bugzilla.mozilla.org/show_bug.cgi?id=835383
* [henrik] Do we want to make use of github releases instead of uploading versions to pypi directly?
** See https://github.com/blog/1547-release-your-software
** That would simplify the release process drastically for our projects
** Downside would be when github is not reachable, you wont be able to install applications


= Goals Overview =
= Goals Overview =
Line 39: Line 55:
== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
* See highlights


== WebAPI (Rob) ==
== WebAPI (Rob) ==
* Goals progress:
* Submitted patch to fix two WebTelephony WebAPI failures
* TBD


== WebRTC (Henrik) ==
== WebRTC (Henrik) ==
* Goals progress:
* In process to get the datachannel framework backported - currently blocked by try outage
* TBD
* Most likely working on two or three other enhancements
 
== Games Benchmarking (Rob, Joel, BC) ==
* [rwood] Working on getting speedtests running on Firefox OS


= Softvision Updates =
= Softvision Updates =
Line 61: Line 79:
** {{bug|891842}} - Test failure 'Expression "{"anonid":"findbar-textbox"}" returned null. Anonymous == true' in testFindInPage.js  
** {{bug|891842}} - Test failure 'Expression "{"anonid":"findbar-textbox"}" returned null. Anonymous == true' in testFindInPage.js  
** {{bug|892946}} - Test failure in testFindInPage due to the fact that the find bar was moved to the top
** {{bug|892946}} - Test failure in testFindInPage due to the fact that the find bar was moved to the top
** {{bug|892388}} - Create a clone of restartless.xpi for uploading to AMO with an end user license agreement
** {{bug|763461}} - Mozmill tests for cut-off elements should not report failure for scrollable direction


* Working on:
* Working on:
Line 66: Line 86:
*** {{bug|885221}} - controller.waitForPageLoad() failures with mozmill 2.0 due to closeAllTabs method opening about:newtab instead of about:blank
*** {{bug|885221}} - controller.waitForPageLoad() failures with mozmill 2.0 due to closeAllTabs method opening about:newtab instead of about:blank
*** {{bug|880135}} - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
*** {{bug|880135}} - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
*** {{bug|684801}} - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
** Andreea
** Andreea
*** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|853005}} - Update automation script should exit with a non-zero exit code if unable to get update channel
*** {{bug|853005}} - Update automation script should exit with a non-zero exit code if unable to get update channel
** Mario
*** {{bug|874394}} - [Australis] Test failure in '/testAwesomeBar/testPasteLocationBar.js' due to the urlbar-container not being found
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org
*** {{bug|835383}} - Add test that installs an addon without EULA directly from addons.mozilla.org
*** {{bug|835132}} - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
** Andrei
*** {{bug|888196}} - Memory increase in endurance testsruns on Win 8 (since June the 16th) - running more endurance tests on SCL


{| border="1" cellpadding="2" align="center"
{| border="1" cellpadding="2" align="center"
Line 80: Line 108:
|-
|-
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
| {{bug|786306}} || Review || Henrik || Mario || Restart tests logic
|-
| {{bug|889314 }} || Review || Dave || Mario || Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
|-
| {{bug|835383}} || Feedback || Andreea || Mario || Add test that installs an addon without EULA directly from addons.mozilla.org
|-
| {{bug|880135}} || Need info || Henrik || Daniela || Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
|-
|-
| {{bug|732353}} || Feedback || Henrik || Daniela ||  Disable all Discovery Pane tests due to unpredictable web dependencies
| {{bug|732353}} || Feedback || Henrik || Daniela ||  Disable all Discovery Pane tests due to unpredictable web dependencies
Line 94: Line 116:
|-
|-
| {{bug|871441}} || Feedback || Henrik || Daniela || Focus inside the select method is not set properly on the menulist
| {{bug|871441}} || Feedback || Henrik || Daniela || Focus inside the select method is not set properly on the menulist
|-
| {{bug|888853}} || Review || Henrik || Andrei || Enhance controller.restartApllication() to handle custom restart flags
|-
|-
| {{bug|886811}} || Review || Henrik || Andrei || Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
| {{bug|886811}} || Review || Henrik || Andrei || Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0
|-
| {{bug|885723}} || Needinfo || Mano || Andrei || Test failure "Autocomplete popup has been opened" in testSwitchToTab.js
|-
| {{bug|887315}} || Review || Henrik || Andrei || Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
|-
|-
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Andrei || Add screenshot functionality to assertion module
|-
|-
| {{bug|599290}} || Feedback || Henrik || Cosmin || Update SoftwareUpdateAPI to support complete relocation to the about dialog
| {{bug|599290}} || Feedback || Henrik || Cosmin || Update SoftwareUpdateAPI to support complete relocation to the about dialog
|-
| {{bug|874393}} || Feedback || Henrik/Dave || Mario || [Australis] Update SoftwareUpdateAPI to support complete relocation to the about dialog
|}
|}


== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|869277}} - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
** {{Bug|854043}} - Intermittent testWebContentContextMenu | Verify that the download started - The download started
* Bugs awaiting integration:
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* Bugs recently integrated:
** {{Bug|886299}} - Intermittent testShareLink | Exception caught - junit.framework.AssertionFailedError: The text: Share is not found!
* '''Issues'''
** Because of {{Bug|891889}} - ''Only running 2 of 3 chunks for Android 4.0 robocop'' - we can't integrate any new tests since they are not run on the tryserver
** I was unable to build the armv6 version in order to debug {{Bug|869277}} - the testAddSearchEngine intermittent fail - logged a new issue: {{Bug|893759}} - Unable to build armv6 on linux x86_64 from the latest m-c sources
** The implementation of the new multipage about:home on mobile will most likely cause a need to rewrite most of the tests


= Personal Status =
= Personal Status =
Line 121: Line 152:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{prev|}} Henrik - Start a thread on the public list to collect ideas for the show and tell
* {{prev|}} Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports
* {{new|}} Henrik - talk to Clint about next quarter goals
* {{new|}} Andreea - start a mail thread about the bug priorities
AndreeaMatei
Confirmed users
571

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/676136...676308"