Confirmed users
571
edits
Auto-tools/Automation Development/Meetings/130318: Difference between revisions
Auto-tools/Automation Development/Meetings/130318 (view source)
Revision as of 16:33, 18 March 2013
, 18 March 2013→Desktop Automation
AndreeaMatei (talk | contribs) |
AndreeaMatei (talk | contribs) |
||
| (16 intermediate revisions by 7 users not shown) | |||
| Line 15: | Line 15: | ||
= Last Weeks Action Items = | = Last Weeks Action Items = | ||
* {{new|}} Anthony - Ensure any Metro tests are suitably tagged with in-testsuite? | * {{new|}} Anthony - Ensure any Metro tests are suitably tagged with in-testsuite? | ||
* {{ | * {{done|}} [Andrei] - amend our style guide to include a section about Bug Fixes vs Style changes: https://developer.mozilla.org/en-US/docs/Mozmill_Tests/Mozmill_Style_Guide#Bug_fixes_vs_Style_changes | ||
* {{done|}} Henrik: Get back to IT and make sure to get some traction on moving mozqa.com in-house before going to PTO | * {{done|}} Henrik: Get back to IT and make sure to get some traction on moving mozqa.com in-house before going to PTO | ||
= Highlights = | = Highlights = | ||
* We have enabled two new locales for | * [Henrik] We have enabled two new locales for testing in Mozmill-CI: de, it | ||
* [Dave] We're now tracking FPS (frames-per-second) when scrolling in Firefox OS. See the 'fps' test at https://datazilla.mozilla.org/b2g | |||
* New blockers, any updates? | * New blockers, any updates? | ||
** %new blockers% | ** %new blockers% | ||
| Line 25: | Line 26: | ||
= Roundtable = | = Roundtable = | ||
* | * Anthony Hughes | ||
** What is the current status of the new Mozmill Metro-mode test type ({{bug|845079}})? Should this get added to the Project items in Q2? | |||
= Goals Overview = | = Goals Overview = | ||
| Line 34: | Line 36: | ||
== Gaia UI (Dave) == | == Gaia UI (Dave) == | ||
* Goals progress: | * Goals progress: | ||
* | ** [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK] | ||
* No notable updates this week | |||
* [rwood] Developing long-running GaiaUI tests ({{bug|843083}}). Last week added post-processing of checkpoint data, investigated and filed {{bug|850803}} regarding device slow-down, improved stability of the airplane mode and camera tests, setup b2g unagi build on my native Ubuntu test PC. For a detailed list please see the [https://ateam.etherpad.mozilla.org/GaiaUIStress GaiaUI Stress Test etherpad]. | |||
== WebAPI (Rob) == | == WebAPI (Rob) == | ||
* | * Two Screen Orientation tests have been reviewed, I will create new post-review patches early this week so these tests can be finished and submitted ASAP | ||
== WebRTC (Henrik) == | == WebRTC (Henrik) == | ||
| Line 46: | Line 49: | ||
= Softvision Updates = | = Softvision Updates = | ||
== Desktop Automation == | == Desktop Automation == | ||
* Goals progress: | * Goals progress: 4 of 5 done: | ||
** [https://github.com/mozilla/gaia-ui-tests/issues/409 Issue 409] - [[https://github.com/mozilla/gaia-ui-tests/pull/424 fix]] | ** [https://github.com/mozilla/gaia-ui-tests/issues/409 Issue 409] - [[https://github.com/mozilla/gaia-ui-tests/pull/424 fix]] | ||
** [https://github.com/mozilla/gaia-ui-tests/issues/446 Issue 446] - [[https://github.com/mozilla/gaia-ui-tests/pull/461 fix]] | ** [https://github.com/mozilla/gaia-ui-tests/issues/446 Issue 446] - [[https://github.com/mozilla/gaia-ui-tests/pull/461 fix]] | ||
** [https://github.com/mozilla/gaia-ui-tests/issues/410 Issue 410] - [[https://github.com/mozilla/gaia-ui-tests/pull/464 fix]] | ** [https://github.com/mozilla/gaia-ui-tests/issues/410 Issue 410] - [[https://github.com/mozilla/gaia-ui-tests/pull/464 fix]] | ||
** [https://github.com/mozilla/gaia-ui-tests/issues/463 Issue 463] - [[https://github.com/mozilla/gaia-ui-tests/pull/526 fix]] | |||
* Fixed: | * Fixed: | ||
** {{bug|849780}} - Test failure "Addons have been found - got 'false'" in remote/testAddons/testSearchAddons.js | ** {{bug|849780}} - Test failure "Addons have been found - got 'false'" in remote/testAddons/testSearchAddons.js | ||
** {{bug|707663}} - Timeout failure in /testTabbedBrowsing_PinAndUnpinAppTab/test1.js | Tab has scrolled into view | ** {{bug|707663}} - Timeout failure in /testTabbedBrowsing_PinAndUnpinAppTab/test1.js | Tab has scrolled into view | ||
** {{bug|823064}} - Refactor testDownloadManagerClosed.js for the new PB per-window mode | |||
** [https://github.com/mozilla/gaia-ui-tests/issues/463 Issue 463] - [[https://github.com/mozilla/gaia-ui-tests/pull/526 fix]] | |||
* Blocked bugs: | * Blocked bugs: | ||
| Line 66: | Line 72: | ||
** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog | ** {{bug|599290}} - Update SoftwareUpdateAPI to support complete relocation to the about dialog | ||
** {{bug|803489}} - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox | ** {{bug|803489}} - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox | ||
** [https://github.com/mozilla/gaia-ui-tests/issues/ | ** [https://github.com/mozilla/gaia-ui-tests/issues/528 Issue 528] - Test failure in test_delete_contact.py | ||
** {{bug|758187}} - Write a new mozmill test for checking location sharing | |||
** {{bug|834163}} - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed" | |||
** {{bug|823064}} - Refactor testDownloadManagerClosed.js for the new PB per-window mode | ** {{bug|823064}} - Refactor testDownloadManagerClosed.js for the new PB per-window mode | ||
** {{bug|826251}} - Make testPreferences/testPreferredLanguage.js language independend | ** {{bug|826251}} - Make testPreferences/testPreferredLanguage.js language independend | ||
** {{bug|838192}} - Add screenshot functionality to assertion module | ** {{bug|838192}} - Add screenshot functionality to assertion module | ||
** {{bug|783484}} - Test failure 'Shutdown expected but none detected before end of test ' in /restartTests/testAddons_uninstallExtension/test4.js | |||
{| border="1" cellpadding="2" align="center" | {| border="1" cellpadding="2" align="center" | ||
| Line 75: | Line 84: | ||
| <b>Bug number</b> || <b>Status</b> || <b>People</b> || <b>Bug Subject</b> | | <b>Bug number</b> || <b>Status</b> || <b>People</b> || <b>Bug Subject</b> | ||
|- | |- | ||
| {{bug|489474}} || Review || Henrik | | {{bug|489474}} || Review || Henrik || Write automated tests for user generated video controls | ||
|- | |- | ||
| {{bug|800872}} || Review || Henrik || Test failure "Window number '1' has been opened" in endurance | | {{bug|800872}} || Review || Henrik/Dave || Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js | ||
|- | |- | ||
| {{bug|786306}} || Review || Henrik/Dave || Add more logic to the restart tests to skip following test files if a test is failing | | {{bug|786306}} || Review || Henrik/Dave || Add more logic to the restart tests to skip following test files if a test is failing | ||
|- | |- | ||
| {{bug| | | {{bug|838192}} || Review || Andreea || Add screenshot functionality to assertion module | ||
|- | |||
| {{bug|826251}} || Review || Andreea || Make testPreferences/testPreferredLanguage.js language independent | |||
|- | |||
| {{bug|838192}} [[https://github.com/mozilla/mozmill-dashboard/pull/50 Pull Request]] || Review || Henrik/Dave || Add screenshot functionality to assertion module | |||
|} | |} | ||
== Mobile (Robocop) == | == Mobile (Robocop) == | ||
* | *'''Automation testing status''' | ||
* | * Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation] | ||
* Made a first look estimation of how many Moztrap tests can be covered using Robocop - please see the [https://docs.google.com/spreadsheet/ccc?key=0Ak8KPfUd1-5udC1FRXBHMlA2MkJLOEp0NFkxTnBtS1E#gid=1 Google spreadsheet] | |||
* Added documentation on Robocop documentation on MDN. Awaiting review. Created [https://developer.mozilla.org/en-US/docs/Basic_Code_Styling_Guidelines_for_Robocop_tests Basic Code Styling Guidelines for Robocop tests] and [https://developer.mozilla.org/en-US/docs/Firefox_for_Android_Automation_using_Robocop Firefox for Android Automation using Robocop] | |||
* Bugs with work in progress: | |||
** {{Bug|820276}} - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests | |||
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data' | |||
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature | |||
** {{Bug|846340}} - Robocop: Add test for 'Clear Site Settings' | |||
** {{Bug|838596}} - Robocop: Add test for 'Master Password' feature | |||
** {{Bug|846296}} - Robocop: Add test for 'Add Search Engine' feature | |||
* Bugs integrated in mozilla-central: | |||
** {{Bug|846257}} - Robocop: Extend 'Web Content Context Menu' test to cover the context menu options for images | |||
** {{Bug|822259}} - Robocop: Add test for Find in Page feature | |||
* Bugs with patches awaiting review: | |||
** {{Bug|833832}} - Robocop: Add test for Import from Android feature | |||
* '''Issues/Questions/Notes''' | |||
= Personal Status = | = Personal Status = | ||
| Line 97: | Line 125: | ||
==Action items== | ==Action items== | ||
* {{ | * {{prev|}} Anthony - Ensure any Metro tests are suitably tagged with in-testsuite? | ||