QA/StaffMeetings/QA-Staff-06-09-2010: Difference between revisions
< QA | StaffMeetings
Jump to navigation
Jump to search
m (→Project Status) |
m (→Round Table) |
||
(32 intermediate revisions by 8 users not shown) | |||
Line 5: | Line 5: | ||
= QA Staff Meeting Notes June 09, 2010 = | = QA Staff Meeting Notes June 09, 2010 = | ||
= Project Status = | = Project Status = | ||
* Overview (2 min brief update) | <span style="display: none;" id="1276116160494S"> </span> | ||
** Desktop Firefox (Juan) | |||
*** 3.7a5 testing (marcia in charge) | *Overview (2 min brief update) | ||
**** We might ship it this week, Friday. | **'''Desktop Firefox''' (Juan) | ||
**** https://wiki.mozilla.org/Releases/Firefox_3.7a5/Test_Plan | ***3.7a5 testing (marcia in charge) | ||
*** [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan Firefox 4 Features Testing] (mevans driving, all) | ****We might ship it this week, Friday. | ||
**** Get in touch with your developer and [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Feature_Test_Plan_Template FILL OUT] template | ****''Need some volunteers to help with spot checks and testing'' | ||
**** This is really important for Beta 1 | ****https://wiki.mozilla.org/Releases/Firefox_3.7a5/Test_Plan | ||
** Maintenance and Security (Al) | ***[https://wiki.mozilla.org/QA/Firefox_4/Test_Plan Firefox 4 Features Testing] (mevans driving, all) | ||
*** Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update | ****Get in touch with your developer and [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Feature_Test_Plan_Template FILL OUT] template | ||
*** Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues. | *****'''Discussion''' - Please review the template and give mevans any feedback on it.<span style="display: none;" id="1276116158877S"> </span> | ||
*** Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug. | *****<span style="display: none;" id="1276116154303S"> </span>example: [https://wiki.mozilla.org/QA/Firefox_3.next/Test_Plan:AddonsManagerRedesign AddonsManagerRedesign] | ||
*** Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon. | *****example: [https://wiki.mozilla.org/User:Mevans/Html5ParserTestplan Html 5 Parser Testplan<span style="display: none;" id="1276116154538E"> </span>]<span style="display: none;" id="1276116160436E"> </span><span style="display: none;" id="1276116158473E"> </span> | ||
** Browser Technologies (Tony) | ****This is really important for Beta 1 | ||
*** Fennec 1.1 RC shipping | *****'''Update''' - Have a first draft of your Fx4b1 testplan by Tuesday, June 15th | ||
*** Firefox Sync 1.3.1 shipped and patched a significant migration bug | **'''Maintenance and Security''' (Al) | ||
**** | ***Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update today (6/9). | ||
**** 30K total, 22.5K active users in 10 days. | ***Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues. | ||
**** Plan to roll out full migration later this week | ****Still investigating the [https://bugzilla.mozilla.org/show_bug.cgi?id=569104 Cnet bug] and [https://bugzilla.mozilla.org/show_bug.cgi?id=562198 bug 562198] but these don't seem to block right now. | ||
*** Test Pilot 1.0b5 deployed in AMO | ***Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug. | ||
**** Will be added to Fx4b1 through the [https://intranet.mozilla.org/Labs/TestPilot_Planning/FX_Beta feedback] tools | ***Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon. | ||
*** Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week | **** '''Discussion''' - not much testing left, except testing the new flash plugin | ||
** | **'''Browser Technologies''' (Tony) | ||
*** Scrubbed [https://bugzilla.mozilla.org/show_bug.cgi?id=570656 SUMO 2.1/1.5.5 release] | ***Fennec 1.1 RC shipping any day now | ||
*** Pushing AMO [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&bug_status=VERIFIED&product=addons.mozilla.org&target_milestone=5.11.1 5.11.1] today | ****Fennec 2.0a1 targeting end of June | ||
** QA Services (Marcia) | ***Firefox Sync 1.3.1 shipped and patched a significant migration bug | ||
*** Accessibility (Marco) | ****91,045 add-on downloads in the last week. (Up from ~40k/week prior to 1.3) | ||
**** Blocker {{bug|566103}} which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5. | ****30K total, 22.5K active users in 10 days. | ||
**** Also, {{bug|570532}} has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too. | ****Plan to roll out full migration later this week | ||
**** We have one more perf bug, {{bug|541618}} currently in review process which should also make a lot of things faster. | ****Firefox Sync Postmortem, thurs at 3:30pm | ||
**** Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period. | ***Test Pilot 1.0b5 deployed in AMO | ||
** Test Automation(Henrik) | ****Will be added to Fx4b1 through the [https://intranet.mozilla.org/Labs/TestPilot_Planning/FX_Beta feedback] tools | ||
***Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week | |||
**'''WebQA''' (Stephen) | |||
***Scrubbed [https://bugzilla.mozilla.org/show_bug.cgi?id=570656 SUMO 2.1/1.5.5 release] - hoping for a successful push later this week (tomorrow?) | |||
**** '''Update''' - issues around IT and miscommunication caused the delay | |||
***Pushing AMO [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&bug_status=VERIFIED&product=addons.mozilla.org&target_milestone=5.11.1 5.11.1 - Firefox Cup] today | |||
***Pushing [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Other&query_format=advanced&component=getpersonas.com&product=Websites&target_milestone=2.7 GetPersonas.com 2.7] tomorrow | |||
**** '''Update''' - uTest found a lot of dupes, many are IT issues, but as a whole went off in the weeds and did good, fast, responsive testing. about 20 testers on hand. | |||
**'''QA Services''' (Marcia) | |||
***QA Videos | |||
****An international version of the QA Promo video will be shot at the Mozilla Summit. This will be the next video featured on the site. | |||
****Please continue working on your team videos. Remember that there is a possibility for remote team members to schedule time with Rainer when you are here in Sept. for the work week. | |||
****Marcia will be shooting a QA Services video at the Summit. Please see her if you are interested in helping with this effort. | |||
***Mozilla Summit | |||
****http://summit.mozilla.org/ is up if you want to follow all the action | |||
****We now have the list of QA individuals who have RSVP'd yes | |||
****Deadline for Breakout Sessions, Science Fair, and Lightning Talks is '''June 15'''. See dria's email for more information. | |||
****Marcia working on putting together a QA mixer that will occur sometime early in the week. | |||
***Conferences/Meetups | |||
****Tomcat at [http://www.linuxtag.org/2010/ Linuxtag]. We have a booth there. | |||
****Tony is working on a meetup Topic for July. Need to get it announced soon. | |||
****Tomcat and Marcia to attend the Community Leadership Summit at OSCON. Clint Talbert will also attend. | |||
****Marcia will likely present at BlogHer conference in August. Mozilla will have a booth there as well. | |||
***Accessibility (Marco) | |||
****Blocker {{bug|566103}} which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5. | |||
****Also, {{bug|570532}} has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too. | |||
****We have one more perf bug, {{bug|541618}} currently in review process which should also make a lot of things faster. | |||
****Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period. | |||
**'''Test Automation''' (Henrik) | |||
***[https://wiki.mozilla.org/QA/Test_Automation/2010-06-02 Last Test Automation Meeting notes] for more details | |||
***New team members: Geo Mealer | |||
***QALab got two Mac Pro machines for Mozmill (Daily test-runs, release testing) | |||
***Usage of more [http://hg.mozilla.org/qa/litmus-data/ local Litmus data] in Mozmill tests (Preparation for Mozmill test-runs on Buildbot) | |||
***[http://www.hskupin.info/2010/06/09/jsbridge-3-5-6-and-mozrunner-2-4-3-available/ Maintenance fixes for Jsbridge and Mozrunner] | |||
***[http://quality.mozilla.org/qmo-news/2010/results-for-mozmill-add-on-testscripting-testday/ Results] for [http://www.hskupin.info/2010/05/26/testday-for-creating-mozmill-tests-for-add-ons/ Mozmill Add-on Testscripting Testday] | |||
***Summit | |||
****Presentation (Mozmill testing + demo cloud-testing extension) | |||
****Science Fair (proposals) | |||
****International version of the promo video | |||
= Discussion Items = | = Discussion Items = | ||
Line 45: | Line 83: | ||
** Corporate Goals meeting Jun 22/23 | ** Corporate Goals meeting Jun 22/23 | ||
** where are we for [https://intranet.mozilla.org/QA/Q22010_QAgoals#QA_Team_Top_Level_Goals Q2 Goals]? | ** where are we for [https://intranet.mozilla.org/QA/Q22010_QAgoals#QA_Team_Top_Level_Goals Q2 Goals]? | ||
*** '''Discussion''' Team leads, please update your status tag next to these goals | |||
** what are the priorities for setting Q3 goals? | ** what are the priorities for setting Q3 goals? | ||
*** '''Update''' will shift focus to Fx4 across the board, and trim a lot of the infrastructure work we did in Q2 | |||
* Summit Presentations (matt) | * Summit Presentations (matt) | ||
** Engineering Keynote (QA Overview) | ** Engineering Keynote (QA Overview) | ||
*** '''Update''' Matt will do an overview, and point to the team leads to do a lightning talk on the projects | |||
*** List your QA sessions/breakouts [https://intranet.mozilla.org/QA/Summit_2010 here] | |||
*** Will need to submit your proposals via dria's spreadsheet form | |||
** (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco | ** (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco | ||
** Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco | ** Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco | ||
Line 54: | Line 97: | ||
= Round Table = | = Round Table = | ||
* Bug {{bug|570794}} - Let's elaborate the text for "How Can I Help?" | * QMO 2 updates | ||
** Bug {{bug|570794}} - Let's elaborate the text for "How Can I Help?" | |||
** QMO Team pages need to have links to wiki team pages | |||
** '''Discussion''' QMO 2.5 and 3.0 brainstorm session on Thursday, June 10th, 10am PDT. See [https://bugzilla.mozilla.org/buglist.cgi?bug_severity=enhancement&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&product=quality.mozilla.org link] for idea query | |||
* Reporting tool for Bugzilla | |||
** https://wiki.mozilla.org/QA/Data_harvesting | |||
** Phase I completion tentatively set to 06/23 | |||
*** '''Discussion''' Looking for features and tools that you use for bugzilla reporting, and submit it to the wiki | |||
* Testday Scheduling Changes | |||
** '''Discussion''' Fx4 is coming up, we can discuss ways to get more testday coverage on specific features that land quick and fast | |||
** With QMO wordpress, teams are encouraged to create their own testdays directly within QMO now (just check if there's a conflict with other pre-scheduled testdays | |||
** Tips: encourage prizes, send out communication through various channels even if its beyond the normal channels | |||
* '''Discussion''' Ask your feature developer questions on testing | |||
** Use the form that juanb constructed, and be sure to ask testing questions directly to developers in an email or in person | |||
** This helps both parties really understand and look at the feature and what's needed or missing | |||
** See HTML5 parser testplan for example | |||
* BFT rework - When do we need manual (Mozmill) tests? (Henrik) | |||
= Takeaways and Action Items = | = Takeaways and Action Items = |
Latest revision as of 21:36, 9 June 2010
« previous mtg | QA Staff Home | next mtg »
QA Staff Meeting Notes June 09, 2010
Project Status
- Overview (2 min brief update)
- Desktop Firefox (Juan)
- 3.7a5 testing (marcia in charge)
- We might ship it this week, Friday.
- Need some volunteers to help with spot checks and testing
- https://wiki.mozilla.org/Releases/Firefox_3.7a5/Test_Plan
- Firefox 4 Features Testing (mevans driving, all)
- Get in touch with your developer and FILL OUT template
- Discussion - Please review the template and give mevans any feedback on it.
- AddonsManagerRedesign example:
- example: Html 5 Parser Testplan
- This is really important for Beta 1
- Update - Have a first draft of your Fx4b1 testplan by Tuesday, June 15th
- Get in touch with your developer and FILL OUT template
- 3.7a5 testing (marcia in charge)
- Maintenance and Security (Al)
- Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update today (6/9).
- Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues.
- Still investigating the Cnet bug and bug 562198 but these don't seem to block right now.
- Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug.
- Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon.
- Discussion - not much testing left, except testing the new flash plugin
- Browser Technologies (Tony)
- Fennec 1.1 RC shipping any day now
- Fennec 2.0a1 targeting end of June
- Firefox Sync 1.3.1 shipped and patched a significant migration bug
- 91,045 add-on downloads in the last week. (Up from ~40k/week prior to 1.3)
- 30K total, 22.5K active users in 10 days.
- Plan to roll out full migration later this week
- Firefox Sync Postmortem, thurs at 3:30pm
- Test Pilot 1.0b5 deployed in AMO
- Will be added to Fx4b1 through the feedback tools
- Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week
- Fennec 1.1 RC shipping any day now
- WebQA (Stephen)
- Scrubbed SUMO 2.1/1.5.5 release - hoping for a successful push later this week (tomorrow?)
- Update - issues around IT and miscommunication caused the delay
- Pushing AMO 5.11.1 - Firefox Cup today
- Pushing GetPersonas.com 2.7 tomorrow
- Update - uTest found a lot of dupes, many are IT issues, but as a whole went off in the weeds and did good, fast, responsive testing. about 20 testers on hand.
- Scrubbed SUMO 2.1/1.5.5 release - hoping for a successful push later this week (tomorrow?)
- QA Services (Marcia)
- QA Videos
- An international version of the QA Promo video will be shot at the Mozilla Summit. This will be the next video featured on the site.
- Please continue working on your team videos. Remember that there is a possibility for remote team members to schedule time with Rainer when you are here in Sept. for the work week.
- Marcia will be shooting a QA Services video at the Summit. Please see her if you are interested in helping with this effort.
- Mozilla Summit
- http://summit.mozilla.org/ is up if you want to follow all the action
- We now have the list of QA individuals who have RSVP'd yes
- Deadline for Breakout Sessions, Science Fair, and Lightning Talks is June 15. See dria's email for more information.
- Marcia working on putting together a QA mixer that will occur sometime early in the week.
- Conferences/Meetups
- Tomcat at Linuxtag. We have a booth there.
- Tony is working on a meetup Topic for July. Need to get it announced soon.
- Tomcat and Marcia to attend the Community Leadership Summit at OSCON. Clint Talbert will also attend.
- Marcia will likely present at BlogHer conference in August. Mozilla will have a booth there as well.
- Accessibility (Marco)
- Blocker bug 566103 which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5.
- Also, bug 570532 has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too.
- We have one more perf bug, bug 541618 currently in review process which should also make a lot of things faster.
- Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period.
- QA Videos
- Test Automation (Henrik)
- Last Test Automation Meeting notes for more details
- New team members: Geo Mealer
- QALab got two Mac Pro machines for Mozmill (Daily test-runs, release testing)
- Usage of more local Litmus data in Mozmill tests (Preparation for Mozmill test-runs on Buildbot)
- Maintenance fixes for Jsbridge and Mozrunner
- Results for Mozmill Add-on Testscripting Testday
- Summit
- Presentation (Mozmill testing + demo cloud-testing extension)
- Science Fair (proposals)
- International version of the promo video
- Desktop Firefox (Juan)
Discussion Items
- Goals (matt)
- Corporate Goals meeting Jun 22/23
- where are we for Q2 Goals?
- Discussion Team leads, please update your status tag next to these goals
- what are the priorities for setting Q3 goals?
- Update will shift focus to Fx4 across the board, and trim a lot of the infrastructure work we did in Q2
- Summit Presentations (matt)
- Engineering Keynote (QA Overview)
- Update Matt will do an overview, and point to the team leads to do a lightning talk on the projects
- List your QA sessions/breakouts here
- Will need to submit your proposals via dria's spreadsheet form
- (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco
- Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco
- Engineering Keynote (QA Overview)
Round Table
- QMO 2 updates
- Bug bug 570794 - Let's elaborate the text for "How Can I Help?"
- QMO Team pages need to have links to wiki team pages
- Discussion QMO 2.5 and 3.0 brainstorm session on Thursday, June 10th, 10am PDT. See link for idea query
- Reporting tool for Bugzilla
- https://wiki.mozilla.org/QA/Data_harvesting
- Phase I completion tentatively set to 06/23
- Discussion Looking for features and tools that you use for bugzilla reporting, and submit it to the wiki
- Testday Scheduling Changes
- Discussion Fx4 is coming up, we can discuss ways to get more testday coverage on specific features that land quick and fast
- With QMO wordpress, teams are encouraged to create their own testdays directly within QMO now (just check if there's a conflict with other pre-scheduled testdays
- Tips: encourage prizes, send out communication through various channels even if its beyond the normal channels
- Discussion Ask your feature developer questions on testing
- Use the form that juanb constructed, and be sure to ask testing questions directly to developers in an email or in person
- This helps both parties really understand and look at the feature and what's needed or missing
- See HTML5 parser testplan for example
- BFT rework - When do we need manual (Mozmill) tests? (Henrik)
Takeaways and Action Items
Item | Owner | Due | Done? |