QA/SoftVision/Meetings/2012-08-28: Difference between revisions

From MozillaWiki
< QA‎ | SoftVision‎ | Meetings
Jump to navigation Jump to search
 
(11 intermediate revisions by 6 users not shown)
Line 18: Line 18:
** Simona Badau - PTO September 3-14
** Simona Badau - PTO September 3-14
** Paul Silaghi - PTO September 3-7
** Paul Silaghi - PTO September 3-7
** Juan Becerra - PTO returning Sept 4th


* Upcoming PTO (next month) - also available on [http://bit.ly/wTRDnV MozQA Vacation Calendar]
* Upcoming PTO (next month) - also available on [http://bit.ly/wTRDnV MozQA Vacation Calendar]
Line 35: Line 36:
** Firefox 15.0 and 10.0.7esr released Tuesday -- thank you!
** Firefox 15.0 and 10.0.7esr released Tuesday -- thank you!
** Firefox 16.0b1 candidates available for testing -- focus on manual testing, sign-off by Thursday
** Firefox 16.0b1 candidates available for testing -- focus on manual testing, sign-off by Thursday
*** ''Note: Juan is back and driving Firefox 16 with 16.0b2''
** Firefox 17.0a2 nightlies available for testing -- focus on manual testing, sign-off by Friday
** Firefox 17.0a2 nightlies available for testing -- focus on manual testing, sign-off by Friday
** Babylon Toolbar issues are being tracked for outreach and potential blocklisting
** Babylon Toolbar issues are being tracked for outreach and potential blocklisting
** [https://blog.mozilla.org/security/2012/08/28/protecting-users-against-java-security-vulnerability/ Java 0-day]: encourage people to disable it until we can come up with a mitigation strategy
** [https://blog.mozilla.org/security/2012/08/28/protecting-users-against-java-security-vulnerability/ Java 0-day]: encourage people to disable it until we can come up with a mitigation strategy
** Windows 8: official support in Firefox 16 -- make sure you are able to cover this going forward
** Windows 8: official support in Firefox 16 -- make sure you are able to cover this going forward
** OSX 10.5: official de-support in Firefox 17 -- make sure you can't run/update, download block to come later  
** OSX 10.5: official de-support in Firefox 17 -- make sure you can't run/update, download block to come later
* SoftVision (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
* SoftVision (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
**Firefox 15 Beta 6 [https://wiki.mozilla.org/Releases/Firefox_15/Test_Plan#Beta_6 Test Plan]
***Smoketests
***Regression tests
***Fixed bugs verification
***Endurance results monitoring
**Firefox 15 RC [https://wiki.mozilla.org/Releases/Firefox_15/Test_Plan#Release_Candidate Test Plan]
***Smoketests
***Regression tests
***Fixed bugs verification
**Firefox 10.0.7 ESR [https://wiki.mozilla.org/Releases/Firefox_10_ESR/Test_Plan#Firefox_10.0.7_ESR Test Plan]
***Regression tests
***Fixed bugs verification
**Firefox 16 Aurora [https://wiki.mozilla.org/Releases/Firefox_16/Test_Plan#Aurora_Merge Test Plan]
***Smoketests
***Pre-beta feature sign off
***Endurance results monitoring
**Firefox 17 Aurora [https://wiki.mozilla.org/Releases/Firefox_17/Test_Plan#Aurora_Merge Test Plan]
***Regression tests
***Endurance results monitoring
***Unconfirmed bug triage
**Firefox 16 beta 1 [https://wiki.mozilla.org/Releases/Firefox_16/Test_Plan#Beta_1 Test Plan]
***Smoketests
***Regression tests
***Fixed bugs verification
***Endurance results monitoring
**Test day involvement


== Automation Updates ==
== Automation Updates ==
Line 46: Line 74:
; Web QA (Selenium)
; Web QA (Selenium)
* SoftVision (Teodosia, Florin, Alin)
* SoftVision (Teodosia, Florin, Alin)
 
** Highlights
*** this week is the Web QA work week, we are attending morning meetings remotely [http://lanyrd.com/2012/web-qa-q3-work-week/ Work Week schedule]
*** due to Marketplace major changes in design, the Jenkins jobs for Marketplace were disabled, and work on the desktop version was dropped
*** we are currently focused on writing tests for the mobile version of Marketplace
** Ongoing tasks on all Web QA projects:
*** write new tests
*** code review
*** merges
*** refactor tests
*** investigate/fix failing tests
* Mozilla
* Mozilla


Line 53: Line 90:
* SoftVision (Alex, Vlad, Andreea)
* SoftVision (Alex, Vlad, Andreea)


* Mozilla
* Mozilla (ashughes)
** mozmill-ci and mozmill-ondemand automation now runs on an ESX cluster
** mozmill-ci and mozmill-ondemand automation now runs on ESX, working to move it to more reliable hardware
** working with Henrik on a plan to ramp up Feature automation (more to come this week)
** working with Henrik on a plan to ramp up Feature automation (more to come this week)
** merged the branches yesterday, please keep an eye out for regressions
** merged the branches yesterday, please keep an eye out for regressions
Line 61: Line 98:
<i> (eg. Status, top issues) </i>
<i> (eg. Status, top issues) </i>
* SoftVision (Cristi, Victor)  
* SoftVision (Cristi, Victor)  
**    AMO (desktop and mobile) on staging (FF14, Win XP and Win 7). Test run: https://litmus.mozilla.org/run_tests.cgi?test_run_id=370
**    Marketplace testing on staging (FF17, Win XP and Win 7). Test run: https://litmus.mozilla.org/run_tests.cgi?test_run_id=424
**    Sanity testing on AMO production on Win 7 and Firefox 14.
**    Sanity testing on Marketplace production on Win 7 and Firefox 17. Test run: https://litmus.mozilla.org/run_tests.cgi?test_run_id=446
**    Tested country stores- tested that changing the country and/or language works
**    Tested that changing the language in the browser, changes the language of the site.
**    Performed Exploratory testing on AMO-dev https://addons-dev.allizom.org/ and Marketplace-dev https://marketplace-dev.allizom.org/ in FF14 and FF17 (Win 7)
**    Tested new designs on Marketplace-dev in Responsive Design View - resolution 320x480 (FF17 and Chrome 21.0) (Win 7 and Android 4.0.4)
**    Bug verification 


* Mozilla
* Mozilla
Line 68: Line 115:
* Mozilla (test lead)
* Mozilla (test lead)
* SoftVision (Ioana, Andreea, Catalin, Adrian, Nicolae, Paul)
* SoftVision (Ioana, Andreea, Catalin, Adrian, Nicolae, Paul)
**run BFTs and daily smoke tests on following devices ( Galaxy Tab, HTC Desire Z, Google Nexus S, Motorola Droid Pro, Samsung Galaxy SII, Samsung Galaxy R, Samsung Galaxy Note) Archive [https://wiki.mozilla.org/QA/Fennec/Waverley/Archives/August/20th_24th here ] 
** [http://goo.gl/9YqhS Logged issues]
** watch assigned features - [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 spreadsheet]
** Transfer BFT test cases from Litmus to MozTrap - OS integration
** Qa-wanted bugs
** Regression window wanted
** Bug verification
** Bug triage
** 15 Beta 6 Results [https://wiki.mozilla.org/QA/Fennec/15/Beta/6 here]
** 15 Beta 7 Results [https://wiki.mozilla.org/QA/Fennec/15/Beta/7 here]
** 15 RC 1 Results [https://wiki.mozilla.org/QA/Fennec/15/Release/RC_1 here]
** Armv6 - Smoketest and performance  - Compatibility


*'''Important bugs:'''
*'''Important bugs:'''
** {{Bug|785385}} - Crash Report [@ __libc_android_abort | dlmalloc_trim | dlmalloc | malloc | _Znwj ]
** {{Bug|785390}} - Visual artifacts on pages after playing flash on Samsung Galaxy R
** {{Bug|785875}} - Unable to tap entirety of <input> to obtain focus
** {{Bug|786171}} - Doorhangers are in the language of Firefox XUL after migration to Native regardless of the system language
** {{Bug|784638}} - Downloaded files have the same names in Download Manager


*'''Issues/Questions/ Proposals'''
*'''Issues/Questions/ Proposals'''
** none


== BrowserID Updates ==  
== BrowserID Updates ==  
<i> (eg. Status, top issues) </i>
<i> (eg. Status, top issues) </i>
* SoftVision (Ioana, Catalin)
* SoftVision (Ioana, Catalin)
** Train #34 testing - smoke and basic functionality testing on different browsers. Testing done on a temporary stage environment.


* Mozilla (Tony)
* Mozilla (Tony)


== Take Aways This Week ==
== Take Aways This Week ==

Latest revision as of 14:52, 29 August 2012

« last meeting | notes | next meeting »

Meeting Notes for <08-28/2012>

Tuesdays, 8am PT / 4pm GMT
Backchannel: irc.mozilla.org #qa
Dial in: 800-707-2533
Password 369, conference #245

Welcome

(eg. headcount, updates with staffing, vacation/away time)

  • Welcome to Andreea Matei who joined the Mozmill team starting August 1st 2012.
  • PTO Reminder:
    • Vlad Maniac - PTO - August 27-31
    • Catalin Suciu - PTO September 3-14
    • Simona Badau - PTO September 3-14
    • Paul Silaghi - PTO September 3-7
    • Juan Becerra - PTO returning Sept 4th
  • Upcoming PTO (next month) - also available on MozQA Vacation Calendar
    • Virgil Dicu - PTO September 17-28
    • Ioana Budnar - PTO September 18-25
    • Adrian Tamas - PTO September 17-25

Take Ways From Last Week

(eg. Action items from last weeks's Take Aways)

Round Table

  • [ashughes] Did we want to add "community" as a topic of discussion in these meetings? ie. upcoming events, what Mozilla is working on to engage community, what Softvision is working on to engage community

Firefox Updates

(eg. Status, top issues)

  • Mozilla (juanb, ashughes)
    • Firefox 15.0 and 10.0.7esr released Tuesday -- thank you!
    • Firefox 16.0b1 candidates available for testing -- focus on manual testing, sign-off by Thursday
      • Note: Juan is back and driving Firefox 16 with 16.0b2
    • Firefox 17.0a2 nightlies available for testing -- focus on manual testing, sign-off by Friday
    • Babylon Toolbar issues are being tracked for outreach and potential blocklisting
    • Java 0-day: encourage people to disable it until we can come up with a mitigation strategy
    • Windows 8: official support in Firefox 16 -- make sure you are able to cover this going forward
    • OSX 10.5: official de-support in Firefox 17 -- make sure you can't run/update, download block to come later
  • SoftVision (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
    • Firefox 15 Beta 6 Test Plan
      • Smoketests
      • Regression tests
      • Fixed bugs verification
      • Endurance results monitoring
    • Firefox 15 RC Test Plan
      • Smoketests
      • Regression tests
      • Fixed bugs verification
    • Firefox 10.0.7 ESR Test Plan
      • Regression tests
      • Fixed bugs verification
    • Firefox 16 Aurora Test Plan
      • Smoketests
      • Pre-beta feature sign off
      • Endurance results monitoring
    • Firefox 17 Aurora Test Plan
      • Regression tests
      • Endurance results monitoring
      • Unconfirmed bug triage
    • Firefox 16 beta 1 Test Plan
      • Smoketests
      • Regression tests
      • Fixed bugs verification
      • Endurance results monitoring
    • Test day involvement

Automation Updates

(eg. Status, top issues)

Web QA (Selenium)
  • SoftVision (Teodosia, Florin, Alin)
    • Highlights
      • this week is the Web QA work week, we are attending morning meetings remotely Work Week schedule
      • due to Marketplace major changes in design, the Jenkins jobs for Marketplace were disabled, and work on the desktop version was dropped
      • we are currently focused on writing tests for the mobile version of Marketplace
    • Ongoing tasks on all Web QA projects:
      • write new tests
      • code review
      • merges
      • refactor tests
      • investigate/fix failing tests
  • Mozilla
Desktop (Mozmill)
  • SoftVision (Alex, Vlad, Andreea)
  • Mozilla (ashughes)
    • mozmill-ci and mozmill-ondemand automation now runs on ESX, working to move it to more reliable hardware
    • working with Henrik on a plan to ramp up Feature automation (more to come this week)
    • merged the branches yesterday, please keep an eye out for regressions

WebQA Manual Updates

(eg. Status, top issues)

  • SoftVision (Cristi, Victor)
  • Mozilla

Fennec Updates

(eg. Status, top issues)

  • Mozilla (test lead)
  • SoftVision (Ioana, Andreea, Catalin, Adrian, Nicolae, Paul)
    • run BFTs and daily smoke tests on following devices ( Galaxy Tab, HTC Desire Z, Google Nexus S, Motorola Droid Pro, Samsung Galaxy SII, Samsung Galaxy R, Samsung Galaxy Note) Archive here
    • Logged issues
    • watch assigned features - spreadsheet
    • Transfer BFT test cases from Litmus to MozTrap - OS integration
    • Qa-wanted bugs
    • Regression window wanted
    • Bug verification
    • Bug triage
    • 15 Beta 6 Results here
    • 15 Beta 7 Results here
    • 15 RC 1 Results here
    • Armv6 - Smoketest and performance - Compatibility
  • Important bugs:
    • bug 785385 - Crash Report [@ __libc_android_abort | dlmalloc_trim | dlmalloc | malloc | _Znwj ]
    • bug 785390 - Visual artifacts on pages after playing flash on Samsung Galaxy R
    • bug 785875 - Unable to tap entirety of <input> to obtain focus
    • bug 786171 - Doorhangers are in the language of Firefox XUL after migration to Native regardless of the system language
    • bug 784638 - Downloaded files have the same names in Download Manager
  • Issues/Questions/ Proposals
    • none

BrowserID Updates

(eg. Status, top issues)

  • SoftVision (Ioana, Catalin)
    • Train #34 testing - smoke and basic functionality testing on different browsers. Testing done on a temporary stage environment.
  • Mozilla (Tony)

Take Aways This Week