canmove, Confirmed users, Bureaucrats and Sysops emeriti
4,714
edits
QA/Automation/Meetings/110713: Difference between revisions
m
Whimboo moved page Auto-tools/Automation Development/Meetings/110713 to QA/Automation/Meetings/110713
m (Whimboo moved page Auto-tools/Automation Development/Meetings/110713 to QA/Automation/Meetings/110713) |
|||
| (24 intermediate revisions by 8 users not shown) | |||
| Line 1: | Line 1: | ||
<small>[[QA/Test_Automation/2011-06-29|previous meeting]] | [[QA/Test_Automation|Meetings]] | [[QA/Automation_Services/ | <small>[[QA/Test_Automation/2011-06-29|previous meeting]] | [[QA/Test_Automation|Meetings]] | [[QA/Automation_Services/Meetings/110810|next meeting »]]</small> | ||
=Dial in= | =Dial in= | ||
| Line 7: | Line 7: | ||
=Attendees= | =Attendees= | ||
* | * Cameron, Anthony, Aaron, Henrik, Dave, Stephen, Al, Geo, Matt, Marlena, DavidC, DavidB | ||
= Last | = Last week's action Items = | ||
* Geo: Deliver summary for API refactoring and test porting project by latest end of this week | * Geo: Deliver summary for API refactoring and test porting project by latest end of this week | ||
** {{miss|}} Still owe this. Will send to Henrik for review first, then forward to team. | ** {{miss|}} Still owe this. Will send to Henrik for review first, then forward to team. | ||
* Anthony: Deliver summary for Discover Pane project by latest end of this week | * Anthony: Deliver summary for Discover Pane project by latest end of this week | ||
* Henrik: Work with Softvision to ensure that DiscoPane tests will be checked in latest by Friday | * {{done|}} Henrik: Work with Softvision to ensure that DiscoPane tests will be checked in latest by Friday | ||
* All: Reply to the discussion email about auto-skipping DiscoPane tests | * All: Reply to the discussion email about auto-skipping DiscoPane tests | ||
* Matt: update QA overall goals | * Matt: update QA overall goals | ||
* Henrik/David: Finalize Q3 goals and get team feedback | * {{done|}} Henrik/David: Finalize Q3 goals and get team feedback | ||
* Henrik/David: Work out preliminary wiki pages for QA Automation Services team (incl. meeting page) | * {{done|}} Henrik/David: Work out preliminary wiki pages for QA Automation Services team (incl. meeting page) | ||
* Henrik/David: Come up with the first draft of the team structure and tasks | * Henrik/David: Come up with the first draft of the team structure and tasks | ||
=Roundtable= | =Roundtable= | ||
* Henrik | * Work Week | ||
** Have all flight details been set? [Henrik] | |||
* Definition of project leads (1st and 2nd) [Henrik] | |||
** Automated Testing for WebApps: Henrik / DavidC | ** Automated Testing for WebApps: Henrik / DavidC | ||
** Team Presence (Documentation): | ** Team Presence (Documentation): DavidB / ? | ||
** Infrastructure Investigation: ? / ? | ** Infrastructure Investigation: ? / ? | ||
** Cross-Framework Test Creation: ? / ? | ** <strike>Cross-Framework Test Creation: ? / ?</strike> | ||
** Selenium Grid 2: ? / | ** Selenium Grid 2: ? / DavidB | ||
** Endurance Tests: Dave / Anthony | ** Endurance Tests: Dave / Anthony | ||
| Line 45: | Line 47: | ||
== Cross-Framework Test Creation == | == Cross-Framework Test Creation == | ||
* Will be dropped from the Q3 goals | |||
* '''First idea is to be active on that project during an automation testday to show collaborated efforts across frameworks.''' | * '''First idea is to be active on that project during an automation testday to show collaborated efforts across frameworks.''' | ||
== Selenium Grid 2 == | == Selenium Grid 2 == | ||
* | * We have upgraded to Selenium 2.0.0 but discovered a [http://code.google.com/p/selenium/issues/detail?id=2037 bug with session handling]. We can't replicate it locally, but are working with François Renaud (main contributor for Selenium Grid) and hope to have a fix soon. | ||
== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Endurance_Tests Endurance Tests] == | == [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Endurance_Tests Endurance Tests] == | ||
* | * Micro-iterations have landed -- This allows tests to accumulate within an iteration. For example, the open new tabs tests can now open several tabs within an iteration instead of just one. | ||
* Working on a single ad-hoc test based on [http://random.pavlov.net/membuster/index.html Mem Buster] to give an indication of Firefox performance. {{bug|669613}} | |||
* First community created endurance test is in review and should land tonight! {{bug|670721}} | |||
= Project Updates = | = Project Updates = | ||
''Please mark topics which need to be discussed in the meeting as bold'' | ''Please mark topics which need to be discussed in the meeting as bold'' | ||
== Infrastructure == | == Infrastructure == | ||
* Shadow test server | * Shadow test server | ||
** Waiting for IP addresses from rackspace that IT requested. | |||
* Cloud Automation | * Cloud Automation | ||
** No updates right now. | |||
* Others | * Others | ||
** Talking to Zandr in IT about rackable server buildout to replace Mac Pros for day to day automation support. | |||
*** Will be sending proposal/question e-mail to QA Automation team for comments. | |||
** '''What's the place on the wiki for infrastructure projects documentation?''' | ** '''What's the place on the wiki for infrastructure projects documentation?''' | ||
| Line 71: | Line 80: | ||
== Mozmill == | == Mozmill == | ||
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On-demand Test Execution] | * [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On-demand Test Execution] | ||
** Patch with final set of agreed-upon changes and deployment on qa-* boxes this week. | |||
** Should be usable for releases next week. | |||
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] | * [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] | ||
** Patch with final set of window handler changes in progress, should be in shortly after this meeting. | |||
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Crowd_Testing Mozmill Crowd] | * [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Crowd_Testing Mozmill Crowd] | ||
** [https://www.hskupin.info/2011/07/08/mozmill-crowd-0-1-3-released/ Mozmill Crowd 0.1.3] has been released | ** [https://www.hskupin.info/2011/07/08/mozmill-crowd-0-1-3-released/ Mozmill Crowd 0.1.3] has been released | ||
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard] | * [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard] | ||
** Working on user stories as outlined http://etherpad.mozilla.com:9000/mozmill-dashboard-elasticsearch | |||
** Working on implementing per user features (logging in, commenting, triage) | |||
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules] | * [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules] | ||
** Discovery Pane - 3 tests checked in across all branches, 2 tests checked in on release and beta, 3 tests in review | ** Discovery Pane - 3 tests checked in across all branches, 2 tests checked in on release and beta, 3 tests in review | ||
| Line 87: | Line 101: | ||
* Grid | * Grid | ||
* Mobile | * Mobile | ||
* Browser | |||
** Selenium works with OSX 10.7 | |||
** '''https://bugzilla.mozilla.org/show_bug.cgi?id=650858 is a blocker for Fx6 support for Selenium 2 API''' | |||
** Prepping for Se 2.1 release tomorrow or Friday | |||
** '''https://bugzilla.mozilla.org/show_bug.cgi?id=670674 - Selenium WebDriver integration for Firefox ''' | |||
== Other == | == Other == | ||
* Cross-weave / Funkload automated nightly testing | |||
** Creating a CRON job that runs smoke tests against the latest builds of the sync server | |||
** Basic reporting to an HTTP site for members of the sync team | |||
*E.g. JMeter | *E.g. JMeter | ||
| Line 97: | Line 119: | ||
= Meeting Notes = | = Meeting Notes = | ||
* | * Last weeks Action Items | ||
** geo and anthony last weeks items are follow up to missed q2 goals | |||
***<b>AI: put text in Q2 goals</b> | |||
* Roundtable | |||
** Workweek | |||
*** need to add travel info into the sync pad: | |||
**** coordinate travel arrangements | |||
**** cottage is booked through till the 30th | |||
*** <b>AI: Need to add leads and seconds to list in agenda notes (everyone)</b> | |||
** cross framework test creation | |||
*** this isn't a team goal, but a good personal one | |||
*** <b> AI: include combined frameworks test creation into a automation testday (?)</b> | |||
* open web apps discussion | |||
** need to define this as a major project focus group | |||
** <b>AI: need to setup a project meeting for open web apps (matt)</b> | |||
*** Henrik, David C, Marlena & Geo preliminarily assigned as the webapps team | |||
*** POC (Mozmill) | |||
*** #openwebapps IRC channel | |||
*** Webapps Engineering meeting occurs on Tues @ 10a | |||
**** <b>AI: David Clarke to attend next Webapps meeting (David C)</b> | |||
* QA Automation Services Goals | |||
** <b>AI: remove the cross framework test development goal as a toplevel team goals (Henrik S)</b> | |||
** <b>AI: everyone to review goals (everyone)</b> | |||
* Wiki Pages | |||
** will there be redirects for old pages? | |||
** QA infrastructure | |||
*** <b>AI: make this it's own sub-tree in the wiki pages (Al)</b> | |||
* Mozmill broken tests | |||
** do we have a list of failures? | |||
** broken tests can be found in dashboard | |||
** what about skipped tests? | |||
** whiteboard entry in bugs assigned for broken tests | |||
** henrik to add query to meeting notes | |||
** <b>AI: Geo to take point for gathering data and plan for delegation (Geo)</b> | |||
==Action items== | ==Action items== | ||
* | * see bold lines above | ||