B2G/QA/Meetings/2015-03-04

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-2533, #92, #9245
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/
• QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)

Vacation plan

2.2 Feature work

• RTL (Marigold)
  • Health: Yellow
  • Test case coverage: https://wiki.mozilla.org/RTL

   5 P2 still ongoing, ETA 3/6

• • Details:

   TC: Keyboard, Setting, and Search are ongoing
   Bug: 14 bugs still unfix: http://mzl.la/1DTR6HJ
   

• Privacy (Gerry)
  • Health: Yellow
  • Test case coverage:
  • Details: 4 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1111992
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1136595
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1137083
• Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
  • Health: Yellow
  • Test case coverage:
  • Details: 2 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1130982
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1136041
• NFC (Alison)
  • Health: Green
  • Test case coverage:100%
  • Details:
    • Full run testing now
    • One regression blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1120849 (patch wait for checkin)
• short_name support in manifest.webapp (Hermes)
  • Health: Yellow
  • Test case coverage: 90%
  • Details: Not fully landed. 3 WIP blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1137498
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1137501
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1131338 (Resolved, but not uplift to 2.2)
    • Test cases in Moztrap will be done this week. (test data in qa-testcase-data repository)
• Search App (Hermes)
  • Health: Green
  • Test case coverage: 100%
  • Details: 3 WIP blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1138631
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1134350
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1132262
• App-grouping (Hermes)
  • Health: Green
  • Test case coverage: 100%
  • Details: No 2.2+ blockers for now
• Task Manager (Hermes)
  • Health: Green
  • Test case coverage: 100%
  • Details: 2 Blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1100610
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1107139
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1120974 (resolved not to 2.2)
• L-porting (Hermes)
  • Health: Green
  • Details:
    • Marigold has started to perform manual smoke test & regression test.
    • Camera recording is still not ready, and its patch is waiting for review. https://bugzilla.mozilla.org/show_bug.cgi?id=1120780
• CAF bugs (Eric)
  • Health: Green
  • Test case coverage: 100%
  • Details: Running regression test now.
• TCL bugs (Alison, Eric)
  • Health: Green
  • Test case coverage: 100%
  • Details: Running regression test now.
• Bluetooth (Eric, Teri)
  • Health: Yellow
  • Test case coverage: 100%
  • Details: Will start PTS certification test on flame-kk this week. Need to manually turn on bluetooth daemon(adb push an updated prop). Currently the new code with daemon is off by default due to bluetooth function break after FOTA, http://bugzil.la/1134821 a patch is under review.
• Metrics (Shing)
  • Health: Yellow
  • Test case coverage: 80%
  • Details:
    • 1 Blocker http://bugzil.la/1137063
    • 2 WIP http://bugzil.la/1130013, http://bugzil.la/1126524
• 256M RAM memory optimization for WFVGA, 5MP. (Teri)
  • Health: Green
  • Test case coverage: 100%
  • Details: Test in progress 50%, no blocker.
• Multicore performance (Edward)
  • Health:
  • Test case coverage:
  • Better performance on Multicore (App startup time for core apps is comparable to Android
  • Set up raptor for v2.2
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1132515
    • analyze and narrow down result from QA jenkins, http://bit.ly/1Glz30h. The problem should be between 4044 and 4045.

2.2 Smoketests

• Tester: Marigold
• Flame-KK Health Status: Green
• Nexus-5-L Health Status: Red http://bit.ly/1B3Y90x
  • Details: Skipped (17 cases): DSDS, FM, Video recording, OTA | Failed (5 cases) email https://bugzil.la/1138852
  • bug with [Nexus 5] in subject

2.2 Full run

• Tester: Marigold
  • Details: Flame-KK http://mzl.la/1BJfxZ9, Nexus-5-L http://mzl.la/1GlxEqA
  • Start running this Tuesday, will send out details in weekly update https://etherpad.mozilla.org/nexus-5-l-testing

2.2 Stability

• Tester: Alison, Paul
• Health Status: Red
• Details:
  • Nexus5-L: Not yet start since gaia ui test on Nexus 5 L still unstable.
  • Flame-kk: less than 10 hours.

Localization

• Tester: Delphine, localizers
• Health Status: Green
• Details: no bugs, no blockers

3.0 Smoketests

• Tester: Peter Bylenga
• Health Status: Yellow 1/5 days passing
• Details: 1 Major blocker this last week
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1139010 fixed by backout of [Bug 1075670] [e10s] event.screenX and event.screenY is wrong

3.0 Exploratory

• Tester: Peter Bylenga
• Health Status: Red
• Details: 58 Issues written, 18 Blockers & Nominations, 27 RTL issues
  • http://mzl.la/1zaHjY4

Agenda

• [eric] "Smoketest Results" http://bit.ly/15rM9JC can we add another sheet for v2.2 Lollipop? Done
  • [pbylenga] added Full sheet for Lollipop and granted Eric editing rights. I'll add in a reduced tab in as well.
• [nhirata] UI State Diagram : https://drive.google.com/a/mozilla.com/#folders/0B_0LdM1CVycIVTFWNWpXNFEyQmM
  • problems this helps solve: faster run, faster understanding of what needs testing, possible way to explain "exploratory testing", easier visibility in what is tested.
• [eric] Will call out for Flame-L as V2.2 FC is approaching, FC2015/04/06, CC2015/05/18 https://bugzil.la/1111890 2 months spent for nexus 5 v2.2 build to be ready
• [delphine] partner builds for alcatel pixi phones?