QA/Test Automation/2010-08-11: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(24 intermediate revisions by 6 users not shown)
Line 2: Line 2:


=Attendees=
=Attendees=
* Matt, Anthony, Geo, Henrik, Aaron, Al, Adrian


=Last weeks action Items=
=Last weeks action Items=
* {{done|}} Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week
* {{done|}} Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week
* {{done|}} Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258)
* {{done|}} Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258)
* Henrik: Update index page of the couchapp to make sure no lags exist
* {{done|}}Henrik: Update index page of the couchapp to make sure no lags exist
* {{done|}} Henrik: Make sure that the Bugzilla component gets created
* {{done|}} Henrik: Make sure that the Bugzilla component gets created
* Geo, Al: Feedback for Django vs. CouchApp
* {{done|}} Geo, Al: Feedback for Django vs. CouchApp
* Geo, Al: Feedback for database separation (release vs. crowd)
* {{done|}} Geo, Al: Feedback for database separation (release vs. crowd + archive)


=Projects=
=Projects=
;Mozmill (Henrik)
;Mozmill (Henrik)
* Mozmill 1.4.2 Beta3 released last Friday
* One more week of testing - file any bug you see!
* WaitForPageLoad works with error pages now.
* [http://quality.mozilla.org/events/2010/08/11/testday-mozmill-firefox-sync-and-tab-candy-friday-august-13th/ Testday]] on Friday 13th


;Test creation / shared modules (Henrik)
;Test creation / shared modules (Henrik)
* L10n support for Mozmill tests for older branches will land later this week
* L10n support for Mozmill tests for older branches will land later this week
 
* Start to collect possible tests for Add-ons Manager subgroup
;Broken Tests
* Firefox 4.0 (Geo)
* Firefox 3.5/3.6 (Anthony)
** No update


;Local Test Data (Anthony)
;Local Test Data (Anthony)
Line 26: Line 27:
** login form, web form, popup, 8 mozilla.org clones
** login form, web form, popup, 8 mozilla.org clones
* Test conversion has begun
* Test conversion has begun
** 31 on file (in progress - targeting complete by next meeting)
** [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=litmus-data&component=Mozmill%20Tests&product=Testing 31 on file]: 26 NEW, 4 ASSIGNED, 1 FIXED
** 7 complex (to be worked on later)
** 7 complex (to be worked on later)
** 15 remain remote (due to Mozmill limitations)
** 15 remain remote (due to Mozmill limitations)
;Broken Tests
* Firefox 4.0 (Geo)
** No update since last meeting.  Will be fixing three known issues and scraping test results for more across next two weeks.
* Firefox 3.5/3.6 (Anthony)
** No update


;Update Tests (Henrik)
;Update Tests (Henrik)
* Working with Rob Strong to get updates working on trunk and 1.9.2


;MozMill Crowd extension (Henrik)
;MozMill Crowd extension (Henrik)
Line 38: Line 46:
* no update
* no update


;(Release) Testing (Henrik)
;Automation (Henrik)
* no update
* Automation scripts have to be updated to be executable with Mozmill 1.4.2
* Updating scripts and test-runs to send the necessary data to brasstacks


;Result / Dashboard (Henrik)
;Result / Dashboard (Henrik)
* Hope to have a first draft by end of this week for discussion


=Risky Goals=
=Risky Goals=
Line 48: Line 58:
;Henrik
;Henrik
* Last two weeks
* Last two weeks
** Updating automation scripts to allow a different repository for tests
** A couple of complex patches for Mozmill
** Update the SoftwareAPI to support backports from Trunk
** Started on updating the automation scripts to make those compatible with Mozmill 1.4.2
** Create specs for the web dashboard
** Started to compile a list of possible Mozmill tests for the add-ons manager
** Getting list of necessary Mozmill tests for the new Add-ons Manager
**
* Next two weeks
* Next two weeks
** 1 week vacation
** Create shared module for add-ons manager and finalize list of tests
** Update all automation scripts to be compatible with Mozmill 1.4.2
** Update the software update script to send full reports to brasstacks
** Finalize specs for Web dashboard
** Continue work on the crowd extension


;Anthony
;Anthony
* Last two weeks
* Last two weeks
** Create local test pages for mozmill-tests {{done|}}
** {{done|}} Create local test pages for mozmill-tests
** Get commit access {{done|}}
** {{done|}} Get commit access
* Next two weeks
* Next two weeks
** Complete conversion of 31 tests to use local-data
** Complete conversion of 31 tests to use local-data
Line 63: Line 79:
;Al
;Al
* Last two weeks
* Last two weeks
** Looked at script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553618 Bug 553618] briefly and did some thinking on script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553617 bug 553617].
** Moved the plugin tests and geolocation pages into the Litmus repo (which may be useful for later scripts).
* Next two weeks
* Next two weeks
** Get script for [https://bugzilla.mozilla.org/show_bug.cgi?id=553618 Bug 553618] re-fixed and submitted.
** Figure out what we can do with microsummary restrictions.


;Geo
;Geo
* Last two weeks:
* Last two weeks:
** Verifying 1.4.2 beta fixes
** Getting [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Shared API Refactor] project off the ground
* Next two weeks:
* Next two weeks:
** Continuing with Shared API Refactor project
** Fixes for {{bug|573582}}, {{bug|573584}}, {{bug|575250}}
** Reviewing test results for any additional breakage
** Help with 1.4.2 beta release as needed


;Aaron
;Aaron
* Last two weeks:
* Last two weeks:
** Verifying and working with Henrik on test related 1.4.2 beta bugs
** Verifying and working with Henrik on test related 1.4.2 beta bugs
** Working with Anthony taking tests offline
** Working with Anthony in efforts to convert tests to use local-data
** Continuing efforts on broken test fails
** Continuing efforts on resolving broken test fails
** 1.4.2 Bespin IDE testing
* Next two weeks:
* Next two weeks:
** Help with the 1.4.2 release
** Continue conversion of tests to use local-data
** Continue investigating Linux VM failures (qa-mozmill/horus)


;Adrian
;Adrian
* Last two weeks:
* Last two weeks:
** L10n support in existing tests backported to 1.9.2 (review pending)
** started a repository for the work on the L10nAPI ( http://bitbucket.org/adrianer/mozmill-tests/ )
* Next two weeks:
* Next two weeks:
** L10n support in existing tests backport to 1.9.1
** work on L10nAPI


=Contributor Status=
=Contributor Status=
Line 85: Line 119:
=Roundtable=
=Roundtable=
;General
;General
* When updating qa lab machines (Mozmill 1.4.2)
** Updates will happen 1-2 weeks after the release of Mozmill 1.4.2
* First QA Automation team video (creation during the work week)
** Workweek: Introductory + team members
** 1st level: Global overview (for recruiting community members)
** 2nd level: Howto for major automation goals by team members


;Issues
;Issues
* Mozmill: Updating the event API to see if events have been processed not approved for Mozmill 1.4.2 ({{bug|583604}})


=Action Items=
=Action Items=
* {{done|}} Henrik: Send testday invitation to mozmill-dev and planet
* Henrik: We need a bug for Mozmill 2.0 to allow usage of different web servers
* Henrik: Create outline proposal for team video
* Matt: Check what limits test harnesses on buildbot to use other local webservers
* Matt: Discuss with Marcia the length of each video for teams
* Geo: We need feedback from Clint about the scope and feature set for Mozmill 2.0
* All: Check the proposed docs for the shared module refactoring from Geo

Latest revision as of 22:22, 11 August 2010

previous meeting | Meetings | next meeting »

Attendees

  • Matt, Anthony, Geo, Henrik, Aaron, Al, Adrian

Last weeks action Items

  • [DONE] Henrik: Ask Clint, if there are plans for another beta release => Yes, by end of this week
  • [DONE] Henrik: Make sure that we differentiate between builds <3.6.9 and >=3.6.9 (Tracking on bug 567258)
  • [DONE] Henrik: Update index page of the couchapp to make sure no lags exist
  • [DONE] Henrik: Make sure that the Bugzilla component gets created
  • [DONE] Geo, Al: Feedback for Django vs. CouchApp
  • [DONE] Geo, Al: Feedback for database separation (release vs. crowd + archive)

Projects

Mozmill (Henrik)
  • Mozmill 1.4.2 Beta3 released last Friday
  • One more week of testing - file any bug you see!
  • WaitForPageLoad works with error pages now.
  • Testday] on Friday 13th
Test creation / shared modules (Henrik)
  • L10n support for Mozmill tests for older branches will land later this week
  • Start to collect possible tests for Add-ons Manager subgroup
Local Test Data (Anthony)
  • Simplest test pages landed: 11 pages
    • login form, web form, popup, 8 mozilla.org clones
  • Test conversion has begun
    • 31 on file: 26 NEW, 4 ASSIGNED, 1 FIXED
    • 7 complex (to be worked on later)
    • 15 remain remote (due to Mozmill limitations)
Broken Tests
  • Firefox 4.0 (Geo)
    • No update since last meeting. Will be fixing three known issues and scraping test results for more across next two weeks.
  • Firefox 3.5/3.6 (Anthony)
    • No update
Update Tests (Henrik)
  • Working with Rob Strong to get updates working on trunk and 1.9.2
MozMill Crowd extension (Henrik)
  • no update
Add-ons Testing (Henrik)
  • no update
Automation (Henrik)
  • Automation scripts have to be updated to be executable with Mozmill 1.4.2
  • Updating scripts and test-runs to send the necessary data to brasstacks
Result / Dashboard (Henrik)
  • Hope to have a first draft by end of this week for discussion

Risky Goals

Personal

Henrik
  • Last two weeks
    • A couple of complex patches for Mozmill
    • Started on updating the automation scripts to make those compatible with Mozmill 1.4.2
    • Started to compile a list of possible Mozmill tests for the add-ons manager
  • Next two weeks
    • 1 week vacation
    • Create shared module for add-ons manager and finalize list of tests
    • Update all automation scripts to be compatible with Mozmill 1.4.2
    • Update the software update script to send full reports to brasstacks
    • Finalize specs for Web dashboard
    • Continue work on the crowd extension
Anthony
  • Last two weeks
    • [DONE] Create local test pages for mozmill-tests
    • [DONE] Get commit access
  • Next two weeks
    • Complete conversion of 31 tests to use local-data
Al
  • Last two weeks
    • Looked at script for Bug 553618 briefly and did some thinking on script for bug 553617.
    • Moved the plugin tests and geolocation pages into the Litmus repo (which may be useful for later scripts).
  • Next two weeks
    • Get script for Bug 553618 re-fixed and submitted.
    • Figure out what we can do with microsummary restrictions.
Geo
  • Last two weeks:
  • Next two weeks:
    • Continuing with Shared API Refactor project
    • Fixes for bug 573582, bug 573584, bug 575250
    • Reviewing test results for any additional breakage
    • Help with 1.4.2 beta release as needed
Aaron
  • Last two weeks:
    • Verifying and working with Henrik on test related 1.4.2 beta bugs
    • Working with Anthony in efforts to convert tests to use local-data
    • Continuing efforts on resolving broken test fails
    • 1.4.2 Bespin IDE testing
  • Next two weeks:
    • Help with the 1.4.2 release
    • Continue conversion of tests to use local-data
    • Continue investigating Linux VM failures (qa-mozmill/horus)
Adrian
  • Last two weeks:
  • Next two weeks:
    • L10n support in existing tests backport to 1.9.1
    • work on L10nAPI

Contributor Status

  • Name

Roundtable

General
  • When updating qa lab machines (Mozmill 1.4.2)
    • Updates will happen 1-2 weeks after the release of Mozmill 1.4.2
  • First QA Automation team video (creation during the work week)
    • Workweek: Introductory + team members
    • 1st level: Global overview (for recruiting community members)
    • 2nd level: Howto for major automation goals by team members
Issues
  • Mozmill: Updating the event API to see if events have been processed not approved for Mozmill 1.4.2 (bug 583604)

Action Items

  • [DONE] Henrik: Send testday invitation to mozmill-dev and planet
  • Henrik: We need a bug for Mozmill 2.0 to allow usage of different web servers
  • Henrik: Create outline proposal for team video
  • Matt: Check what limits test harnesses on buildbot to use other local webservers
  • Matt: Discuss with Marcia the length of each video for teams
  • Geo: We need feedback from Clint about the scope and feature set for Mozmill 2.0
  • All: Check the proposed docs for the shared module refactoring from Geo
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Test_Automation/2010-08-11&oldid=244785"