Confirmed users
571
edits
Auto-tools/Automation Development/Meetings/130225: Difference between revisions
Auto-tools/Automation Development/Meetings/130225 (view source)
Revision as of 18:10, 3 March 2013
, 3 March 2013→New action items
AndreeaMatei (talk | contribs) |
|||
| (17 intermediate revisions by 8 users not shown) | |||
| Line 1: | Line 1: | ||
<small>[[Auto-tools/Automation_Development/Meetings/130211|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/ | <small>[[Auto-tools/Automation_Development/Meetings/130211|previous meeting]] | [[Auto-tools/Automation_Development/Meetings|Meetings]] | [[Auto-tools/Automation_Development/Meetings/130304|next meeting »]]</small> | ||
= Dial in = | = Dial in = | ||
| Line 9: | Line 9: | ||
= General = | = General = | ||
* Attendees: | * Attendees: | ||
** | ** Andreea, Daniela, Mario,Otilia, Andrei, Rob, Dave, Henrik, Joel, Adrian, Clint, Anthony, Mihaela | ||
* Chair: Andreea Matei | * Chair: Andreea Matei | ||
** Welcome! :-) http://tinyurl.com/btcdndm | ** Welcome! :-) http://tinyurl.com/btcdndm | ||
| Line 16: | Line 16: | ||
= Last Weeks Action Items = | = Last Weeks Action Items = | ||
* {{done|}} [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2] | * {{done|}} [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2] | ||
* {{new|}} Tony and | * {{new|}} Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important | ||
* {{new|}} Adrian will get access to the tryserver - Joel will need to log a bug for that | |||
* {{done|}} [davehunt] - Fix the exception that occurs in mozdownload | * {{done|}} [davehunt] - Fix the exception that occurs in mozdownload | ||
** https://github.com/mozilla/mozdownload/pull/52 | ** https://github.com/mozilla/mozdownload/pull/52 | ||
| Line 28: | Line 29: | ||
* Nightly Tester Tools 3.4 has been released | * Nightly Tester Tools 3.4 has been released | ||
* mozdownload 1.6 has been released (now with automatic retries) | * mozdownload 1.6 has been released (now with automatic retries) | ||
* gaiatest 0. | * gaiatest 0.8 has been released | ||
* b2gpopulate 0. | * b2gpopulate 0.5 has been released | ||
* Gaia UI tests much more stable now that we're restarting b2g between tests (down to three tests failing on master) | * Gaia UI tests much more stable now that we're restarting b2g between tests (down to three tests failing on master) | ||
* b2gperf 0.1.3 has been released | * b2gperf 0.1.3 has been released | ||
| Line 48: | Line 49: | ||
** We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart). | ** We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart). | ||
* [henrik] Should we add support for different applications in the current Mozmill Dashboard or wait for the new one? We would need this for the [https://github.com/mozilla/mozmill-dashboard/issues/48 Firefox Metro mode] | * [henrik] Should we add support for different applications in the current Mozmill Dashboard or wait for the new one? We would need this for the [https://github.com/mozilla/mozmill-dashboard/issues/48 Firefox Metro mode] | ||
* [henrik] We need new test candidates for Mozmill. Please get back to the QA team and look at moztrap. | |||
= Goals Overview = | = Goals Overview = | ||
| Line 58: | Line 60: | ||
** [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK] | ** [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK] | ||
* [rwood] Developing long-running GaiaUI tests ({{bug|843083}}). Current tests under development are for airplane mode, SMS, and music playback. For a complete list please see the [https://ateam.etherpad.mozilla.org/GaiaUIStress GaiaUI Stress Test etherpad]. | * [rwood] Developing long-running GaiaUI tests ({{bug|843083}}). Current tests under development are for airplane mode, SMS, and music playback. For a complete list please see the [https://ateam.etherpad.mozilla.org/GaiaUIStress GaiaUI Stress Test etherpad]. | ||
* [davehunt] UI tests got a green build last week! Now focus is on v1-train and close to green there too | |||
== WebAPI (Rob) == | == WebAPI (Rob) == | ||
* Goals progress: | * Goals progress: | ||
** [rwood] This goal was completed last quarter except for two tests | ** [rwood] This goal was completed last quarter except for two tests still under review/need minor updates | ||
* [rwood] Minor changes required for two Screen Orientation tests, once submitted and they receive an r+ this section can be removed from the meeting agenda. | * [rwood] Minor changes required for two Screen Orientation tests, once submitted and they receive an r+ this section can be removed from the meeting agenda. | ||
== WebRTC (Henrik) == | == WebRTC (Henrik) == | ||
* Goals progress: | * Goals progress: | ||
* | ** No movement so far | ||
* Waiting for todays meeting to figure out how the refactor for the test framework will happen. Will continue now with data channel tests. | |||
= Softvision Updates = | = Softvision Updates = | ||
== Desktop Automation == | == Desktop Automation == | ||
* Goals progress: Getting started, Andreea | * Goals progress: Getting started, Andreea will work on a test this sprint: test_clock_switch_clock_type.py or test_clock_turn_on_off_alarm.py, as Dave suggested. | ||
* Fixed: | * Fixed: | ||
| Line 79: | Line 83: | ||
** {{bug|841355}} - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state | ** {{bug|841355}} - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state | ||
** {{bug|800708}} - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js | ** {{bug|800708}} - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js | ||
** {{bug|780957}} - Failure in /testAddons_pluginDisabledAfterRestart/test2.js | Shockwave Flash is enabled - 'false' should equal 'true' | |||
** {{bug|611455}} - 'Application disconnected' failure in restartTests/TestMasterPassword/test.2 | |||
* Blocked bugs: | * Blocked bugs: | ||
| Line 86: | Line 92: | ||
* Waiting for review / feedback / Checkin needed | * Waiting for review / feedback / Checkin needed | ||
** {{bug|831406}} - Land Flash private browsing tests in testcase-data repository | ** {{bug|831406}} - Land Flash private browsing tests in testcase-data repository | ||
** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing | ** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing | ||
** {{bug| | ** {{bug|823064}} - Refactor testDownloadManagerClosed.js for the new PB per-window mode | ||
** {{bug|826251}} - Make testPreferences/testPreferredLanguage.js language independend | |||
* Working on: | * Working on: | ||
| Line 100: | Line 105: | ||
** {{bug|809124}} - restartTests/testAddons started failing with "Modal dialog has been found and processed" | ** {{bug|809124}} - restartTests/testAddons started failing with "Modal dialog has been found and processed" | ||
** {{bug|840022}} - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js | ** {{bug|840022}} - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js | ||
** {{bug| | ** {{bug|842571}} - Update the process start directory (XCurProcD) in software-update.js library | ||
** {{bug|838192}} - Add screenshot functionality to assertion module | |||
** {{bug|820346}} - Test failure "TabView is not open." in endurance/testTabView_OpenTabViewWithTabs/test1.js | |||
** {{bug|707663}} - Timeout failure in /testTabbedBrowsing_PinAndUnpinAppTab/test1.js | Tab has scrolled into view | |||
== Mobile (Robocop) == | == Mobile (Robocop) == | ||
* | *'''Automation testing status''' | ||
* | * Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation] | ||
* Bugs with work in progress: | |||
** {{Bug|820276}} - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests | |||
** {{Bug|822259}} - Robocop: Add test for Find in Page feature - blocked by [https://bugzilla.mozilla.org/show_bug.cgi?id=828481 bug 828481] | |||
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data' | |||
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature | |||
** {{Bug|833832}} - Robocop: Add test for Import from Android feature | |||
* Bugs recently integrated | |||
** {{Bug|841377}} - Robocop: Extend the testShareLink test to cover opening the share popup from context menus | |||
* '''Issues/Questions''' | |||
** Progress was slow last week on automation and will continue to be this week because of manual testing tasks - Firefox Mobile 19 RC, Firefox Mobile 20 beta 1 and 2, Aurora 21 sign-off | |||
** The team has also been looking into BFTs features to automate (extend web context menu test to cover images, add search engines and search works on unvisited bookmarks - bugs will be logged later this week) | |||
= Personal Status = | = Personal Status = | ||
| Line 115: | Line 134: | ||
== New action items == | == New action items == | ||
* {{new|}} | * {{prev|}} Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important (email dialog started) | ||
* {{prev|}} Adrian will get access to the tryserver - Jeol will need to log a bug for that (bug 844892 filed) | |||
* {{new|}} [Henrik] - Disable flash on OSX 10.6 | |||
* {{new|}}[Henrik] - Start a thread in the mailing list for additional 'Ask an Expert' session | |||
* {{new|}}[Andrei] - amed our style guide to include a section about Bug Fixes vs Style changes | |||
* {{new|}}[Andreea] - File a bug against Automation bot to add the functionality | |||
* {{new|}}[Andreea] - Look into VPN issues (unable to recieve email while connected) | |||
* {{new|}}[Henrik] - Extra item to the issue for mozmill-dashboard. adding support for Metro tests | |||