QA/Test Automation/2011-05-18: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "<small>previous meeting | Meetings | next meeting »</small> =Dial in= # 650-90...")
 
 
(18 intermediate revisions by 4 users not shown)
Line 7: Line 7:


=Attendees=
=Attendees=
* Matt, Anthony, Aaron, Henrik, Geo, Al, Owen


= Last action items =
= Last action items =
Line 20: Line 21:


==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] (Geo/Henrik) ==
==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] (Geo/Henrik) ==
* Henrik has been landed the handler for modal dialogs ({{bug|639870}})
* Owen will be joining us to help port tests
* Exploring moving to Pivotal Tracker


==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On-demand update tests] (Geo/Henrik)==
==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On-demand update tests] (Geo/Henrik)==
* Shaking out last few bugs to use with the 5.0b2 release


==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Endurance_Tests Endurance Tests] (Dave/Anthony)==
==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Endurance_Tests Endurance Tests] (Dave/Anthony)==
Line 27: Line 32:
==Others==
==Others==
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Crowd_Testing Mozmill Crowd]===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Crowd_Testing Mozmill Crowd]===
* We have setup PivotalTracker for [https://www.pivotaltracker.com/projects/285911# tracking the project]
* The extension has now an icon. See the [https://github.com/whimboo/mozmill-crowd/blob/master/extension/chrome/skin/icon_64x64.png check-in]
* Working on further launch points (add-on bar, Firefox button)
* Working on the website and the version checker for test environments


===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard]===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard]===
* Owen has been started to work on the pilot application which will become [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard/Roadmap/0.4 version 0.4]
* Further enhancements for endurance tests (see Endurance section)


=== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Provisioning On Demand Provisioning] (Cloud Automation) (Al/Henrik) ===
=== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Provisioning On Demand Provisioning] (Cloud Automation) (Al/Henrik) ===
* Machine is being finished today, according to Phong.
* We need a list of initial use cases for what people need from the machine in short term.
** Cameron's TCM work is only current case.


===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules]===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules]===
; General (Henrik)
; General (Henrik)
* [http://hg.mozilla.org/qa/mozmill-tests/pushloghtml?startdate=2011-04-20&enddate=2011-05-18 Check-ins] since the last meeting
* [http://hg.mozilla.org/qa/mozmill-tests/pushloghtml?startdate=2011-04-20&enddate=2011-05-18 Check-ins] since the last meeting
* Reorganization of the named branches because of new channels
* Vlad and Alex from Softvision have been started to work on tests! Woohoo!!
* Split-up of last remaining test modules with multiple tests inside
* Updated EV tests to use minimal page on AMO (we will not have our own EV cert)


;[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Fixing_Broken_Tests Broken Tests]
;[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Fixing_Broken_Tests Broken Tests]
* 5.0 branch has some broken tests on qa-horus only. Henrik is playing with the memory on that box to figure out possible reasons for those failures. Could also apply to the waitForPageLoad issues with local test data.
* Safe Browsing tests failing due to {{bug|468313}} -- reaching out devs to find solution (ashughes)
* Endurance test for Tab Switching in Panorama failing due to {{bug|646021}} -- will be fixed this week (ashughes)
; Softvision (Anthony)
* Focusing on splitting test modules covering multiple Litmus tests into single-test modules (ie. 1 Litmus test per Mozmill test) -- see {{bug|627975}} (will be done this week)
* Focusing on AOM Discovery Pane tests once above is complete -- being tracked using [http://bit.ly/mcskhW aom-discovery] whiteboard tag -- Krupa is working on creating us more tests in Litmus (5 to date)


== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shadow_Web_Server Shadow web server] (Al/Henrik)==
== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shadow_Web_Server Shadow web server] (Al/Henrik)==
* Transfer of mozqa.com should be going through today.
** This unblocks creation of SSL certs by IT with Geotrust.
** When new certs are available, they will be deployed to mozqa.com.


===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Automated_Testruns Automation Scripts] / Infrastructure (Henrik)===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Automated_Testruns Automation Scripts] / Infrastructure (Henrik)===
* Download script for daily builds has not been finished yet


= Personal Status =
= Personal Status =
Line 49: Line 78:
=Roundtable=
=Roundtable=
;General
;General
* Should we create a new test-run for remote content related tests (AOM Discovery pane)?
** Discussion on [http://groups.google.com/group/mozmill-dev/browse_thread/thread/508ffdaec067c4e8 mozmill-dev]


= Meeting Notes =
= Meeting Notes =
* Goals
* General
** Any project lead has to update the project status. If he can't attend the 2nd lead has to do it
* On-demand update tests
** Feature is under final testing - finishing up by today (May 18th)!
* API refactor
** Owen will join to help porting tests - first contributor outside of the core team


==Action items==
==Action items==
* Henrik: Talk to David for a meeting about handling patch reviews with Softvision (include Web Automation)
* {{done|}} Henrik: Create automation scripts for handing new test-run called "remote" (May 19th)
* Anthony: Get in contact with Vlad by end of today to kick of Discovery Pane tests (May 18th)
* Dave: Please reference last meeting notes from endurance meeting if you can't attend
* Al: Collect possible use cases and goals on-demand provisioning
* Al: Create remaining invalid certificates (May 20th)

Latest revision as of 14:04, 30 May 2011

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

  • Matt, Anthony, Aaron, Henrik, Geo, Al, Owen

Last action items

  • Geo: Work with Al and Anthony to get the on-demand update testing running on qa-set (around April 27th)
  • Geo: communicate proposal for faster patch handling to the group
  • [DONE] Henrik: Update wording for the goal to port existing tests

Goals Overview

Risky Goals

Project Status

Redesign Shared Modules (Geo/Henrik)

  • Henrik has been landed the handler for modal dialogs (bug 639870)
  • Owen will be joining us to help port tests
  • Exploring moving to Pivotal Tracker

On-demand update tests (Geo/Henrik)

  • Shaking out last few bugs to use with the 5.0b2 release

Endurance Tests (Dave/Anthony)

Others

Mozmill Crowd

  • We have setup PivotalTracker for tracking the project
  • The extension has now an icon. See the check-in
  • Working on further launch points (add-on bar, Firefox button)
  • Working on the website and the version checker for test environments

Dashboard

  • Owen has been started to work on the pilot application which will become version 0.4
  • Further enhancements for endurance tests (see Endurance section)

On Demand Provisioning (Cloud Automation) (Al/Henrik)

  • Machine is being finished today, according to Phong.
  • We need a list of initial use cases for what people need from the machine in short term.
    • Cameron's TCM work is only current case.

Tests / Shared Modules

General (Henrik)
  • Check-ins since the last meeting
  • Reorganization of the named branches because of new channels
  • Vlad and Alex from Softvision have been started to work on tests! Woohoo!!
  • Split-up of last remaining test modules with multiple tests inside
  • Updated EV tests to use minimal page on AMO (we will not have our own EV cert)
Broken Tests
  • 5.0 branch has some broken tests on qa-horus only. Henrik is playing with the memory on that box to figure out possible reasons for those failures. Could also apply to the waitForPageLoad issues with local test data.
  • Safe Browsing tests failing due to bug 468313 -- reaching out devs to find solution (ashughes)
  • Endurance test for Tab Switching in Panorama failing due to bug 646021 -- will be fixed this week (ashughes)
Softvision (Anthony)
  • Focusing on splitting test modules covering multiple Litmus tests into single-test modules (ie. 1 Litmus test per Mozmill test) -- see bug 627975 (will be done this week)
  • Focusing on AOM Discovery Pane tests once above is complete -- being tracked using aom-discovery whiteboard tag -- Krupa is working on creating us more tests in Litmus (5 to date)

Shadow web server (Al/Henrik)

  • Transfer of mozqa.com should be going through today.
    • This unblocks creation of SSL certs by IT with Geotrust.
    • When new certs are available, they will be deployed to mozqa.com.

Automation Scripts / Infrastructure (Henrik)

  • Download script for daily builds has not been finished yet

Personal Status

For the personal status please check the weekly status updates:

Roundtable

General
  • Should we create a new test-run for remote content related tests (AOM Discovery pane)?

Meeting Notes

  • General
    • Any project lead has to update the project status. If he can't attend the 2nd lead has to do it
  • On-demand update tests
    • Feature is under final testing - finishing up by today (May 18th)!
  • API refactor
    • Owen will join to help porting tests - first contributor outside of the core team

Action items

  • Henrik: Talk to David for a meeting about handling patch reviews with Softvision (include Web Automation)
  • [DONE] Henrik: Create automation scripts for handing new test-run called "remote" (May 19th)
  • Anthony: Get in contact with Vlad by end of today to kick of Discovery Pane tests (May 18th)
  • Dave: Please reference last meeting notes from endurance meeting if you can't attend
  • Al: Collect possible use cases and goals on-demand provisioning
  • Al: Create remaining invalid certificates (May 20th)
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Test_Automation/2011-05-18&oldid=313779"