B2G/QA/2.2/2015-04-01Status

V2.2 Milestone

• 2015/05/18 V2.2 CC
• 2015/04/06 V2.2 FC <-
• 2015/02/23 V2.2 FL

V2.2 Current Blocker

• NEW feature-b2g=2.2+

Bugzilla query error

There was a problem during the HTTP request: 400 Bad Request

• NEW blocking-b2g=2.2+

Bugzilla query error

There was a problem during the HTTP request: 400 Bad Request

• NEW blocking-b2g=2.2?

Bugzilla query error

There was a problem during the HTTP request: 400 Bad Request

V2.2 Testing

Smoke Testing

Flame-KK Green

• No bug found blocking manual smoketests but we have couple automation bugs need to investigate.

• Manual reports - on Google doc
• Automation reports - are available on Github.IO & fxosqa-report-watchlist.

• New Bugs Breaking the Automation smoketests
  • [Investigating] test_clock_create_new_alarm.py - Bug 1138278- [Clock] After running test_clock_create_new_alarm.py, it should set the alarm time to 1 min more than the current time
  • [Investigating] test_ftu_skip_tour.py - Time out; After performed test script locally, it still has previous script issue mentioned at comment 28 of Bug 1134445.
  • [Investigating] test_marketplace_packaged_app.py - Bug 1146275 - test_marketplace_packaged_app.py failure.

Nexus-5-L 5.0 Yellow

• No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
• Manual - are available on Google Drive
• Known issues - OTA not working, Video recording not working, no FM radio support, no DSDS support and no MTP support.

Regression Testing

• RTL/V2.2 Flame-KK
  • Moztrap result - 76 fail, 326 pass, check with Josh for detail.

• Full Regression/V2.2 Flame-KK
  • Moztrap result - 56 fail, 3996 pass, 100% complete, bug rate 1.4%.

• Partial Regression/V2.2 Nexus-5-L
  • Moztrap result - 30 fail, 1216 pass, 100% complete
  • Bug list

• 1st Bluetooth PTS/V2.2 Flame-KK for FL.
  • Bug Meta dependency tree - 0 open bugs

Exploratory Testing

• 183 bugs
  • UNCONFIRMED, NEW, ASSIGNED, REOPENED - 170 bugs found.
  • RESOLVED FIXED, VERIFIED FIXED - 13 bugs found.

• 20 bugs
  • UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 12 bugs found.
  • RESOLVED FIXED, VERIFIED FIXED & 2.2?, 2.2+ - 8 bugs found.

• 20/183 ~ 10.1% goes to 2.2?|2.2+