Auto-tools/Automation Development/Meetings/130318

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
  • TBD
• Chair: Andreea
• Notes: Daniela

Last Weeks Action Items

• [NEW] Anthony - Ensure any Metro tests are suitably tagged with in-testsuite?
• [DONE] [Andrei] - amend our style guide to include a section about Bug Fixes vs Style changes: https://developer.mozilla.org/en-US/docs/Mozmill_Tests/Mozmill_Style_Guide#Bug_fixes_vs_Style_changes
• [DONE] Henrik: Get back to IT and make sure to get some traction on moving mozqa.com in-house before going to PTO

Highlights

• [Henrik] We have enabled two new locales for testing in Mozmill-CI: de, it
• [Dave] We're now tracking FPS (frames-per-second) when scrolling in Firefox OS. See the 'fps' test at https://datazilla.mozilla.org/b2g
• New blockers, any updates?
  • %new blockers%
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• Anthony Hughes
  • What is the current status of the new Mozmill Metro-mode test type (bug 845079)? Should this get added to the Project items in Q2?

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Gaia UI (Dave)

• Goals progress:
  • [rwood] Goal: Write stability/long running/endurance tests and graph their performance over time [ON TRACK]
• No notable updates this week
• [rwood] Developing long-running GaiaUI tests (bug 843083). Last week added post-processing of checkpoint data, investigated and filed bug 850803 regarding device slow-down, improved stability of the airplane mode and camera tests, setup b2g unagi build on my native Ubuntu test PC. For a detailed list please see the GaiaUI Stress Test etherpad.

WebAPI (Rob)

• Two Screen Orientation tests have been reviewed, I will create new post-review patches early this week so these tests can be finished and submitted ASAP

WebRTC (Henrik)

• Goals progress:
• TBD

Softvision Updates

Desktop Automation

• Goals progress: 4 of 5 done:
  • Issue 409 - [fix]
  • Issue 446 - [fix]
  • Issue 410 - [fix]
  • Issue 463 - [fix]

• Fixed:
  • bug 849780 - Test failure "Addons have been found - got 'false'" in remote/testAddons/testSearchAddons.js
  • bug 707663 - Timeout failure in /testTabbedBrowsing_PinAndUnpinAppTab/test1.js | Tab has scrolled into view
  • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
  • Issue 463 - [fix]

• Blocked bugs:
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
  • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js

• Working on:
  • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
  • bug 840022 - Test failure "The forward button has been made visible for the 1 page" in testToolbars/testBackForwardButtons.js
  • bug 839996 - Add event to wait for before importing the default bookmarks through importFromURL function
  • bug 758187 - Write a new mozmill test for checking location sharing
  • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
  • bug 803489 - Software update tests on Windows 8 fail sometimes due to still running copies of Firefox
  • Issue 528 - Test failure in test_delete_contact.py
  • bug 758187 - Write a new mozmill test for checking location sharing
  • bug 834163 - Teardown code for /testSearch tests should not exercise ui path which can cause failures like: "Modal dialog has been found and processed"
  • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
  • bug 826251 - Make testPreferences/testPreferredLanguage.js language independend
  • bug 838192 - Add screenshot functionality to assertion module
  • bug 783484 - Test failure 'Shutdown expected but none detected before end of test ' in /restartTests/testAddons_uninstallExtension/test4.js

Waiting for review/Feedback/Need info

Bug number	Status	People	Bug Subject
bug 489474	Review	Henrik	Write automated tests for user generated video controls
bug 800872	Review	Henrik/Dave	Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js
bug 786306	Review	Henrik/Dave	Add more logic to the restart tests to skip following test files if a test is failing
bug 838192	Review	Andreea	Add screenshot functionality to assertion module
bug 826251	Review	Andreea	Make testPreferences/testPreferredLanguage.js language independent
bug 838192 [Pull Request]	Review	Henrik/Dave	Add screenshot functionality to assertion module

Mobile (Robocop)

• Automation testing status
• Progress on Robocop Automation
• Made a first look estimation of how many Moztrap tests can be covered using Robocop - please see the Google spreadsheet
• Added documentation on Robocop documentation on MDN. Awaiting review. Created Basic Code Styling Guidelines for Robocop tests and Firefox for Android Automation using Robocop
• Bugs with work in progress:
  • bug 820276 - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 846340 - Robocop: Add test for 'Clear Site Settings'
  • bug 838596 - Robocop: Add test for 'Master Password' feature
  • bug 846296 - Robocop: Add test for 'Add Search Engine' feature
• Bugs integrated in mozilla-central:
  • bug 846257 - Robocop: Extend 'Web Content Context Menu' test to cover the context menu options for images
  • bug 822259 - Robocop: Add test for Find in Page feature
• Bugs with patches awaiting review:
  • bug 833832 - Robocop: Add test for Import from Android feature
• Issues/Questions/Notes

Personal Status

For the personal status please check the weekly status updates:

• 130318 - 130324

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130318

Action items

• [CARRY OVER] Anthony - Ensure any Metro tests are suitably tagged with in-testsuite?