QA/StaffMeetings/QA-Staff-06-09-2010: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(32 intermediate revisions by 8 users not shown)
Line 5: Line 5:
= QA Staff Meeting Notes  June 09, 2010 =  
= QA Staff Meeting Notes  June 09, 2010 =  


= Project Status =  
= Project Status =


* Overview (2 min brief update)
<span style="display: none;" id="1276116160494S">&nbsp;</span>
** Desktop Firefox (Juan)
 
*** 3.7a5 testing (marcia in charge)
*Overview (2 min brief update)  
**** We might ship it this week, Friday.
**'''Desktop Firefox''' (Juan)  
**** https://wiki.mozilla.org/Releases/Firefox_3.7a5/Test_Plan
***3.7a5 testing (marcia in charge)  
*** [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan Firefox 4 Features Testing] (mevans driving, all)
****We might ship it this week, Friday.  
**** Get in touch with your developer and [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Feature_Test_Plan_Template FILL OUT] template
****''Need some volunteers to help with spot checks and testing''
**** This is really important for Beta 1
****https://wiki.mozilla.org/Releases/Firefox_3.7a5/Test_Plan
** Maintenance and Security (Al)
***[https://wiki.mozilla.org/QA/Firefox_4/Test_Plan Firefox 4 Features Testing] (mevans driving, all)  
*** Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update on 6/9.
****Get in touch with your developer and [https://wiki.mozilla.org/QA/Firefox_4/Test_Plan/Feature_Test_Plan_Template FILL OUT] template  
*** Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues.
*****'''Discussion''' - Please review the template and give mevans any feedback on it.<span style="display: none;" id="1276116158877S">&nbsp;</span>
*** Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug.
*****<span style="display: none;" id="1276116154303S">&nbsp;</span>example: [https://wiki.mozilla.org/QA/Firefox_3.next/Test_Plan:AddonsManagerRedesign AddonsManagerRedesign]
*** Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon.
*****example: [https://wiki.mozilla.org/User:Mevans/Html5ParserTestplan Html 5 Parser Testplan<span style="display: none;" id="1276116154538E">&nbsp;</span>]<span style="display: none;" id="1276116160436E">&nbsp;</span><span style="display: none;" id="1276116158473E">&nbsp;</span>
** Browser Technologies (Tony)  
****This is really important for Beta 1  
*** Fennec 1.1 RC shipping today. <add notes>
*****'''Update''' - Have a first draft of your Fx4b1 testplan by Tuesday, June 15th
*** Firefox Sync 1.3.1 shipped and patched a significant migration bug
**'''Maintenance and Security''' (Al)  
**** 91,045 add-on downloads in the last week. (Up from ~40k/week prior to 1.3)
***Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update today (6/9).  
**** 30K total, 22.5K active users in 10 days.  
***Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues.
**** Plan to roll out full migration later this week
****Still investigating the [https://bugzilla.mozilla.org/show_bug.cgi?id=569104 Cnet bug] and [https://bugzilla.mozilla.org/show_bug.cgi?id=562198 bug 562198] but these don't seem to block right now.
*** Test Pilot 1.0b5 deployed in AMO
***Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug.  
**** Will be added to Fx4b1 through the [https://intranet.mozilla.org/Labs/TestPilot_Planning/FX_Beta feedback] tools
***Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon.
*** Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week
**** '''Discussion''' - not much testing left, except testing the new flash plugin
** WeQA (Stephen)
**'''Browser Technologies''' (Tony)  
*** Scrubbed [https://bugzilla.mozilla.org/show_bug.cgi?id=570656 SUMO 2.1/1.5.5 release]
***Fennec 1.1 RC shipping any day now
*** Pushing AMO [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&bug_status=VERIFIED&product=addons.mozilla.org&target_milestone=5.11.1 5.11.1] today
****Fennec 2.0a1 targeting end of June
** QA Services (Marcia)
***Firefox Sync 1.3.1 shipped and patched a significant migration bug  
*** Accessibility (Marco)
****91,045 add-on downloads in the last week. (Up from ~40k/week prior to 1.3)  
**** Blocker {{bug|566103}} which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5.
****30K total, 22.5K active users in 10 days.  
**** Also, {{bug|570532}} has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too.
****Plan to roll out full migration later this week
**** We have one more perf bug, {{bug|541618}} currently in review process which should also make a lot of things faster.
****Firefox Sync Postmortem, thurs at 3:30pm
**** Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period.
***Test Pilot 1.0b5 deployed in AMO  
** Test Automation(Henrik)
****Will be added to Fx4b1 through the [https://intranet.mozilla.org/Labs/TestPilot_Planning/FX_Beta feedback] tools
***Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week
**'''WebQA''' (Stephen)  
***Scrubbed [https://bugzilla.mozilla.org/show_bug.cgi?id=570656 SUMO 2.1/1.5.5 release] - hoping for a successful push later this week (tomorrow?)
**** '''Update''' - issues around IT and miscommunication caused the delay
***Pushing AMO [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&bug_status=VERIFIED&product=addons.mozilla.org&target_milestone=5.11.1 5.11.1 - Firefox Cup] today  
***Pushing [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Other&query_format=advanced&component=getpersonas.com&product=Websites&target_milestone=2.7 GetPersonas.com 2.7] tomorrow
**** '''Update''' - uTest found a lot of dupes, many are IT issues, but as a whole went off in the weeds and did good, fast, responsive testing.  about 20 testers on hand.
**'''QA Services''' (Marcia)  
***QA Videos
****An international version of the QA Promo video will be shot at the Mozilla Summit. This will be the next video featured on the site.
****Please continue working on your team videos. Remember that there is a possibility for remote team members to schedule time with Rainer when you are here in Sept. for the work week.
****Marcia will be shooting a QA Services video at the Summit. Please see her if you are interested in helping with this effort.
***Mozilla Summit
****http://summit.mozilla.org/ is up if you want to follow all the action
****We now have the list of QA individuals who have RSVP'd yes
****Deadline for Breakout Sessions, Science Fair, and Lightning Talks is '''June 15'''. See dria's email for more information.
****Marcia working on putting together a QA mixer that will occur sometime early in the week.
***Conferences/Meetups
****Tomcat at [http://www.linuxtag.org/2010/ Linuxtag]. We have a booth there.
****Tony is working on a meetup Topic for July. Need to get it announced soon.
****Tomcat and Marcia to attend the Community Leadership Summit at OSCON. Clint Talbert will also attend.
****Marcia will likely present at BlogHer conference in August. Mozilla will have a booth there as well.
***Accessibility (Marco)  
****Blocker {{bug|566103}} which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5.  
****Also, {{bug|570532}} has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too.  
****We have one more perf bug, {{bug|541618}} currently in review process which should also make a lot of things faster.  
****Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period.
**'''Test Automation''' (Henrik)  
***[https://wiki.mozilla.org/QA/Test_Automation/2010-06-02 Last Test Automation Meeting notes] for more details
***New team members: Geo Mealer
***QALab got two Mac Pro machines for Mozmill (Daily test-runs, release testing)
***Usage of more [http://hg.mozilla.org/qa/litmus-data/ local Litmus data] in Mozmill tests (Preparation for Mozmill test-runs on Buildbot)
***[http://www.hskupin.info/2010/06/09/jsbridge-3-5-6-and-mozrunner-2-4-3-available/ Maintenance fixes for Jsbridge and Mozrunner]
***[http://quality.mozilla.org/qmo-news/2010/results-for-mozmill-add-on-testscripting-testday/ Results] for [http://www.hskupin.info/2010/05/26/testday-for-creating-mozmill-tests-for-add-ons/ Mozmill Add-on Testscripting Testday]
***Summit
****Presentation (Mozmill testing + demo cloud-testing extension)
****Science Fair (proposals)
****International version of the promo video


= Discussion Items =  
= Discussion Items =  
Line 45: Line 83:
** Corporate Goals meeting Jun 22/23
** Corporate Goals meeting Jun 22/23
** where are we for [https://intranet.mozilla.org/QA/Q22010_QAgoals#QA_Team_Top_Level_Goals Q2 Goals]?
** where are we for [https://intranet.mozilla.org/QA/Q22010_QAgoals#QA_Team_Top_Level_Goals Q2 Goals]?
*** '''Discussion''' Team leads, please update your status tag next to these goals
** what are the priorities for setting Q3 goals?
** what are the priorities for setting Q3 goals?
*** '''Update''' will shift focus to Fx4 across the board, and trim a lot of the infrastructure work we did in Q2


* Summit Presentations (matt)
* Summit Presentations (matt)
** Engineering Keynote (QA Overview)
** Engineering Keynote (QA Overview)
*** '''Update''' Matt will do an overview, and point to the team leads to do a lightning talk on the projects
*** List your QA sessions/breakouts [https://intranet.mozilla.org/QA/Summit_2010 here]
*** Will need to submit your proposals via dria's spreadsheet form
** (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco
** (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco
** Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco
** Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco
Line 54: Line 97:
= Round Table =
= Round Table =


* Bug {{bug|570794}}  - Let's elaborate the text for "How Can I Help?"
* QMO 2 updates
** Bug {{bug|570794}}  - Let's elaborate the text for "How Can I Help?"
** QMO Team pages need to have links to wiki team pages
** '''Discussion''' QMO 2.5 and 3.0 brainstorm session on Thursday, June 10th, 10am PDT.  See [https://bugzilla.mozilla.org/buglist.cgi?bug_severity=enhancement&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&product=quality.mozilla.org  link] for idea query
* Reporting tool for Bugzilla
** https://wiki.mozilla.org/QA/Data_harvesting
** Phase I completion tentatively set to 06/23
*** '''Discussion''' Looking for features and tools that you use for bugzilla reporting, and submit it to the wiki
* Testday Scheduling Changes
** '''Discussion''' Fx4 is coming up, we can discuss ways to get more testday coverage on specific features that land quick and fast
** With QMO wordpress, teams are encouraged to create their own testdays directly within QMO now (just check if there's a conflict with other pre-scheduled testdays
** Tips: encourage prizes, send out communication through various channels even if its beyond the normal channels
* '''Discussion''' Ask your feature developer questions on testing
** Use the form that juanb constructed, and be sure to ask testing questions directly to developers in an email or in person
** This helps both parties really understand and look at the feature and what's needed or missing
** See HTML5 parser testplan for example
* BFT rework - When do we need manual (Mozmill) tests? (Henrik)


= Takeaways and Action Items =
= Takeaways and Action Items =

Latest revision as of 21:36, 9 June 2010

« previous mtg | QA Staff Home | next mtg »

QA Staff Meeting Notes June 09, 2010

Project Status

  • Overview (2 min brief update)
    • Desktop Firefox (Juan)
    • Maintenance and Security (Al)
      • Firefox 3.6.4 build 6 users on release channel being moved to beta channel with update today (6/9).
      • Still waiting to hear if 3.6.4 build 6 will be final release build or if build 7 will be required by existing issues.
      • Firefox 3.5.10 is still shipping with 3.6.4 barring a zero day bug.
      • Fixes are being actively taken for Firefox 3.6.6 and 3.5.11 (3.6.5 as a number has been taken by mobile team efforts). Verification of fixes must begin soon.
        • Discussion - not much testing left, except testing the new flash plugin
    • Browser Technologies (Tony)
      • Fennec 1.1 RC shipping any day now
        • Fennec 2.0a1 targeting end of June
      • Firefox Sync 1.3.1 shipped and patched a significant migration bug
        • 91,045 add-on downloads in the last week. (Up from ~40k/week prior to 1.3)
        • 30K total, 22.5K active users in 10 days.
        • Plan to roll out full migration later this week
        • Firefox Sync Postmortem, thurs at 3:30pm
      • Test Pilot 1.0b5 deployed in AMO
        • Will be added to Fx4b1 through the feedback tools
      • Jetpack 0.5 targeted end of month. Ayan working on automating the installation by end of week
    • WebQA (Stephen)
      • Scrubbed SUMO 2.1/1.5.5 release - hoping for a successful push later this week (tomorrow?)
        • Update - issues around IT and miscommunication caused the delay
      • Pushing AMO 5.11.1 - Firefox Cup today
      • Pushing GetPersonas.com 2.7 tomorrow
        • Update - uTest found a lot of dupes, many are IT issues, but as a whole went off in the weeds and did good, fast, responsive testing. about 20 testers on hand.
    • QA Services (Marcia)
      • QA Videos
        • An international version of the QA Promo video will be shot at the Mozilla Summit. This will be the next video featured on the site.
        • Please continue working on your team videos. Remember that there is a possibility for remote team members to schedule time with Rainer when you are here in Sept. for the work week.
        • Marcia will be shooting a QA Services video at the Summit. Please see her if you are interested in helping with this effort.
      • Mozilla Summit
        • http://summit.mozilla.org/ is up if you want to follow all the action
        • We now have the list of QA individuals who have RSVP'd yes
        • Deadline for Breakout Sessions, Science Fair, and Lightning Talks is June 15. See dria's email for more information.
        • Marcia working on putting together a QA mixer that will occur sometime early in the week.
      • Conferences/Meetups
        • Tomcat at Linuxtag. We have a booth there.
        • Tony is working on a meetup Topic for July. Need to get it announced soon.
        • Tomcat and Marcia to attend the Community Leadership Summit at OSCON. Clint Talbert will also attend.
        • Marcia will likely present at BlogHer conference in August. Mozilla will have a booth there as well.
      • Accessibility (Marco)
        • Blocker bug 566103 which fixes about 5 or 6 other long-standing issues, too, has landed for Wednesday's nightly, just in time for alpha 5.
        • Also, bug 570532 has landed for this nightly build, giving some of the Firefox 4 testcases an a11y perf boost. Hopefully testing on Shaver's Tablet PC will confirm this, too.
        • We have one more perf bug, bug 541618 currently in review process which should also make a lot of things faster.
        • Firefox 3.6.4 is in good shape a11y-wise. There were no specific fixes, but OOPP works fine as it does in the Firefox 4 nightlies, too. No blocking issues from my end during the whole period.
    • Test Automation (Henrik)

Discussion Items

  • Goals (matt)
    • Corporate Goals meeting Jun 22/23
    • where are we for Q2 Goals?
      • Discussion Team leads, please update your status tag next to these goals
    • what are the priorities for setting Q3 goals?
      • Update will shift focus to Fx4 across the board, and trim a lot of the infrastructure work we did in Q2
  • Summit Presentations (matt)
    • Engineering Keynote (QA Overview)
      • Update Matt will do an overview, and point to the team leads to do a lightning talk on the projects
      • List your QA sessions/breakouts here
      • Will need to submit your proposals via dria's spreadsheet form
    • (breakout) Breakout session: "What does the new Add-Ons Manager UI sound like??" - Marco
    • Science Fair participation: "Come by and have your favorite web site read out to you!" - Marco

Round Table

  • QMO 2 updates
    • Bug bug 570794 - Let's elaborate the text for "How Can I Help?"
    • QMO Team pages need to have links to wiki team pages
    • Discussion QMO 2.5 and 3.0 brainstorm session on Thursday, June 10th, 10am PDT. See link for idea query
  • Reporting tool for Bugzilla
  • Testday Scheduling Changes
    • Discussion Fx4 is coming up, we can discuss ways to get more testday coverage on specific features that land quick and fast
    • With QMO wordpress, teams are encouraged to create their own testdays directly within QMO now (just check if there's a conflict with other pre-scheduled testdays
    • Tips: encourage prizes, send out communication through various channels even if its beyond the normal channels
  • Discussion Ask your feature developer questions on testing
    • Use the form that juanb constructed, and be sure to ask testing questions directly to developers in an email or in person
    • This helps both parties really understand and look at the feature and what's needed or missing
    • See HTML5 parser testplan for example
  • BFT rework - When do we need manual (Mozmill) tests? (Henrik)

Takeaways and Action Items

Item Owner Due Done?