B2G/QA/Meetings/2014-10-01

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• • KK image is now public: https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame

2.1 Release Update

• 2.1 FC - Oct 10th (also a national holiday in Taiwan)

Notes

• 2.1 Health Dashboard - https://wiki.mozilla.org/B2G/QA/2.1
• Each team should identify QA call outs & any blockers on a per team basis
• Provide a FC health assessment against the following criteria:
  • Have all features gone through a functional test run?
  • Did any risky feature areas get exploratory testing?
  • Were smoketests around your area green for 5+ days?
  • Did each outstanding FC signoff blocker get fixed?

Features (Organized by Functional Team)

Remaining Tasks

• Exploratory testrun 2.1: bugs filed and passed nom’s - bluetooth issues, and graphical stuff
• L10n run 1: 2 new locales, Bosnian almost done, Portuguese
  • 1 blocker found: hard coded string
• this week going through dictionaries, and new strings
• 2nd set of new strings coming
• FC run 3: planning for monday

Communications

• Cost Control: YELLOW
  • Blocker: 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1064491
• Messages: YELLOW
  • No blockers but a performance issue https://bugzilla.mozilla.org/show_bug.cgi?id=1074783
• Contacts : GREEN
  • 2 graphical blockers (1 fixed) : https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1073561%2C1073686
• Dialer : YELLOW
  • 1 nasty blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1070066
    • • is https://bugzilla.mozilla.org/show_bug.cgi?id=1074379 related?

Media

• Ringtones: GREEN
  • No blockers
• Non-ringtones: GREEN
  • 3 blockers, 2 Camera and 1 Gallery

https://bugzilla.mozilla.org/show_bug.cgi?id=1055270 https://bugzilla.mozilla.org/show_bug.cgi?id=1066885 https://bugzilla.mozilla.org/show_bug.cgi?id=1072535

Multimedia Platform

• No feature land to v2.1

Productivity

• GREEN
  • Blocker: 9
    • https://wiki.mozilla.org/FirefoxOS/productivity/releasetracking#Productivity_Blocker_2.1_Dashboard

Systems Front End

• Soft home: GREEN
  • Blocker: 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1072728 Under code review

Systems Platform

• Health: Green

Metrics Testing =

• Health: Yellow
  • Blockers: 3
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1070858
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1070875
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1071372
  • Un-resolved bugs: 6

Telephony/Networking

• NFC: GREEN
  • Blockers: 1

https://bugzilla.mozilla.org/show_bug.cgi?id=1072738

• • Vender related blockers: 2

https://bugzilla.mozilla.org/show_bug.cgi?id=1034418 https://bugzilla.mozilla.org/show_bug.cgi?id=1046516

• RIL: GREEN
  • Blocker: 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1074377 Under code review

Devices

• Bluetooth: RED
  • Blockers: 4

https://bugzilla.mozilla.org/show_bug.cgi?id=1070919 https://bugzilla.mozilla.org/show_bug.cgi?id=1072802 https://bugzilla.mozilla.org/show_bug.cgi?id=1072848 https://bugzilla.mozilla.org/show_bug.cgi?id=1052304

• MTP: YELLOW
  • No blockers
  • Blocking Nominate: 6

https://bugzilla.mozilla.org/show_bug.cgi?id=1073335 https://bugzilla.mozilla.org/show_bug.cgi?id=1074590 https://bugzilla.mozilla.org/show_bug.cgi?id=1074593 https://bugzilla.mozilla.org/show_bug.cgi?id=1074597 https://bugzilla.mozilla.org/show_bug.cgi?id=1074600 https://bugzilla.mozilla.org/show_bug.cgi?id=1074604

Graphics

• GREEN YELLOW
  • UPDATE: Late feature request for QA:
    • • https://bugzilla.mozilla.org/show_bug.cgi?id=995519
  • All features are now marked as verified
  • 3 open blockers in Core:Graphics/Core:Graphics:Layers,

https://bugzilla.mozilla.org/show_bug.cgi?id=1042291 https://bugzilla.mozilla.org/show_bug.cgi?id=1074521 https://bugzilla.mozilla.org/show_bug.cgi?id=1073252

• • 2 in Core:Graphics:Layers

https://bugzilla.mozilla.org/show_bug.cgi?id=1042291 https://bugzilla.mozilla.org/show_bug.cgi?id=1073252

• • 2 in Core: Video / Audio

https://bugzilla.mozilla.org/show_bug.cgi?id=1029552 https://bugzilla.mozilla.org/show_bug.cgi?id=1068963

• • 1 in Core:Panning/Zooming

https://bugzilla.mozilla.org/show_bug.cgi?id=1068571

• • 1 in Core:Layout

https://bugzilla.mozilla.org/show_bug.cgi?id=1062792

• • 4 waiting to be uplifted

https://bugzilla.mozilla.org/show_bug.cgi?id=1064479 https://bugzilla.mozilla.org/show_bug.cgi?id=1066664 https://bugzilla.mozilla.org/show_bug.cgi?id=1071241 https://bugzilla.mozilla.org/show_bug.cgi?id=1042104

• • 4 nominated for blocking

https://bugzilla.mozilla.org/show_bug.cgi?id=1072789 https://bugzilla.mozilla.org/show_bug.cgi?id=1075265 https://bugzilla.mozilla.org/show_bug.cgi?id=1072830 https://bugzilla.mozilla.org/show_bug.cgi?id=1070199

Smoketests

• YELLOW
  • Blockers: 2 Resolved Fixed

https://bugzilla.mozilla.org/show_bug.cgi?id=1074152 https://bugzilla.mozilla.org/show_bug.cgi?id=1075604

Performance

• Bug 1069452 - Regression across all gaia apps on Sep 16 2014
• Bug 1072500 - [Flame][KK] The time to start up camera from lockscreen is regressed compared to 2.0
• Bug 1059353 - [Clock] Startup time regressions of ~205 ms from 2.0 to 2.1
• who else is seeing perf regression issues?
• did a local test with more results to compare from 2.0 to 2.1 (480 tests)
• everything is ~200 ms slower
• publishing results soon for acceptance runs

Stability

• HEALTH: RED
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1064800 (Resolved)
  • Testing will continue next week

Agenda

• [PBylenga/JoshuaM] How to handle smoketest qawanted requests, verifyme tag, qa-approval.
• [Tony] remaining 2.1 schedule
• v184 to be released shortly

This Week - Decisions & Action Items

• [kevin] send a note out how qawanted, qa-approval, qaurgent