QA/Test Automation/2010-09-22: Difference between revisions

← Older edit

QA/Test Automation/2010-09-22 (view source)

Revision as of 16:22, 27 September 2010

2,533 bytes added , 27 September 2010

→‎Action Items

Whimboo

canmove, Confirmed users, Bureaucrats and Sysops emeriti

4,714

edits

@@ Line 7: / Line 7: @@
 =Attendees=
+* Adrian, Henrik, Anthony, Geo, Matt, Al, Aaron
 = Last weeks action Items =
-* Geo: Send out list of broken tests w/ Fx4 and MM1.5
+* Geo: {{miss|}} Send out list of broken tests w/ Fx4 and MM1.5
-* Matt: Check what limits test harnesses on buildbot to use other local webservers (connect with John O'Duin)
+* Matt: {{done|}} Check what limits test harnesses on buildbot to use other local webservers (connect with John O'Duin)
-* Matt: Action items from release tasks meeting? Need to notify release leads that they're responsible for coordinating resources.
+* Matt: {{miss|}} Action items from release tasks meeting? Need to notify release leads that they're responsible for coordinating resources.
-* Geo: For Auto-tools meeting next wk, how to incorporate train model going forward
+* Geo: {{done|}} For Auto-tools meeting next wk, how to incorporate train model going forward
-* Henrik & Matt: How to streamline patch checkin process
+* Henrik & Matt: {{miss|}} How to streamline patch checkin process
-* Geo: Generate wiki page to sum up tab candy objective
+* Geo: {{miss|}} Generate wiki page to sum up tab candy objective
 =Goals Overview=
@@ Line 26: / Line 27: @@
 ** Adrian: DOM walker and set of l10n tests
 * Planning for Q4 (proposals)
+** [https://intranet.mozilla.org/2010Q4Goals#QA QA Q4 goals]
 ** Henrik: First public version of the Mozmill Crowd extension
 ** Henrik: Dashboard for software updates and addons tests
@@ Line 42: / Line 44: @@
 ** Creation of a PoC for Panorama tests during the QA workweek + Demo
 * DOM Walker + L10n API (Adrian)
+** see my personal notes
 * Redesign Shared Modules (Geo)
 ** Got first "refactored" test working
 ;Local Test Data (Anthony)
-* Likely to slip
 * 4 r?, 11 checkin-needed, 10 need patches
-* Won't have time to resolve all open issues and work on Panorama at the same time
 ;Broken Tests
@@ Line 95: / Line 96: @@
 ** {{done|}} Patch checkins to 0
 * Next two weeks
-** Review new patches to 0
+** Review new patches to 0 (3 remain)
-** Commit new check-ins to 0
+** Commit new check-ins to 0 (11 remain)
-** Contribute 1 Panorama test
+** Ensure 10 remaining local-data tests complete
+** <strike>Contribute 1 Panorama test</strike>
 ** {{risk|}} QA results dashboard (if/when ready)
 ** {{risk|}} QA crowd extension (if/when ready)
-** {{risk|}} Contribute 10 remaining local-data tests
 ;Al
@@ Line 139: / Line 140: @@
 * Last two weeks:
 ** {{done|}} (mostly) finish Documentation + UML Diagrams for CommonA11yL10nAPI (renamed to: DOMUtilitiesAPI) and L10nAPI
-** {{done|}} (mostly) implementation of the CommonA11yL10nAPI (renamed to: DOMUtilitiesAPI) and L10nAPI: WIP patch attached to Bug 562084 - including two tests for the preferences window
+** {{done|}} (mostly) implementation of the CommonA11yL10nAPI (renamed to: DOMUtilitiesAPI) and L10nAPI: WIP patch attached to {{bug|562084}} - including two tests for the preferences window
 * Next two weeks:
 ** implement the L10n tests for the update window
@@ Line 157: / Line 158: @@
 ** Requested 32GB for both machines ({{bug|598305}}) - Matt has to approve
-=Action Items=
+=Meeting Notes=
-* {{prev|}} Geo: Send out list of broken tests w/ Fx4 and MM1.5
+* Last action items
+** Limits of the test harness on buildbot to use other local webservers
+*** Pretty strict handling for accessing other servers
+*** It would be possible to have tests running on a Talos server; Therefore a test environment has to be setup
+* Goals Q3
+** We drop the Mozmill crowd extension from our list
+** Dashboard will be ready for general test results by end of this week
+** Anthony and Aaron will finish the first part of the local test data project
+** Henrik updates the AddonsAPI and the existing tests until end of next week (Aaron will help out once the local data project is done)
+** Geo will have a solid plan for the refactoring work by end of this month
+** Adrian will work on the DOMWalker to have it ready by end of this month
+* Goals Q4 (Finalized by next week)
+** {{prev| Develop and deploy a Mozmill crowd-sourcing extension that will allow community users to execute and report results of Firefox 4 mozmill automated tests across the available platforms and configurations used by the  Mozilla  testing community. }}
+** {{new|Integrate local data-based Firefox 4 mozmill tests under Buildbot execution control and reporting}}
+** {{new|Collaborate with development team to expand Mozmill Panorama support to include an automated test suite for functional and performance testing of the Firefox 4 Panorama feature.}}
+** {{new|}} Implement Mozmill Dashboard views for software update and addon tests
+** {{new|}} Refactoring the shared module system based on the specification from Q3
+* Others
+** Geo: More often conversations about goals and blockers except our 1-1's and the bi-monthly meeting
+*** We will setup our own IRC #mozmill channel and have an internal mailing list (qa-auto)
+** On demand test execution improvements
+*** Geo: Shouldn't be a team goal regarding time constraints
+*** Henrik: We can have at least the download script integration
+==Action Items==
+* Geo: {{prev|}} Send out list of broken tests w/ Fx4 and MM1.5
+* Geo: schedule in-IRC meeting to do patch-handling proposal
+* Geo: {{prev|}} Generate wiki page to sum up tab candy objective
+* Henrik: Talk with John O'Duin about specifics of the test environment
+* Henrik: {{done|}} Setup IRC channel #mozmill + Mailing list (qa-auto) [{{bug|598883}}]
+* Henrik: {{done|}} Send out goals proposals for final rework
+* Matt: {{prev|}} Action items from release tasks meeting? Need to notify release leads that they're responsible for coordinating resources.