B2G/QA/2.2/2015-06-15Status

From MozillaWiki
< B2G | QA | 2.2
Jump to navigation Jump to search

V2.2 Highlight & Risk

V2.2 Milestone

  • 2015/06/08 V2.2 CC
  • 2015/04/29 V2.2 Updated FC
  • 2015/02/23 V2.2 FL

V2.2 Testing Scope

Bugzilla query error

There was a problem during the HTTP request: 400 Bad Request


V2.2 Testing by Type

Smoke Testing

Nexus-5-L 5.1 Green

  • Testing on PVT build from 2015/04/14
  • Manual test results - are available on Google Drive
    • Green for 3+ weeks
  • Known issues
    • No FM radio support, no DSDS support and no UMS support.
    • OTA not working, but the update channel is fine for 2.2->2.2.

Flame-KK Green

Regression Testing

3rd Run (2015/05/19)

  • Exploratory tests

2nd Run (2015/04/14)

  • Result
    • 1119(total), 1090(passed), 8(failed), 21(invalid)
    • 0.007% fail rate
  • bugs
    • Total 5
    • http://mzl.la/1cYZZau (Bugs related to software home button, privacy or ui polish will be skipped for now)
  • Result
    • ​342(total), 334(passed), 5(failed), 3(invalid)
    • ​0.01% fail rate

1st Run (2015/03/03)

Functional Testing

  • RTL (Josh)
    • Health Status: Green
    • Details: 0 blocker
  • Cut, Copy, and Paste (Gerry, Edward, Teri)
    • Health Status: Green
    • Details: 0 blocker
  • NFC (Alison)
    • Health Status: Green
    • Details: 0 blocker
  • MTP/UMS (Alison)
    • Health Status: Green
    • Details: 0 blocker
  • System Frontend bugs (Hermes)
    • Health Status: Green
    • Details: 0 blocker
  • Bluetooth (Eric, Teri)
    • Health Status: Green
    • Details: 0 blocker
  • Productivity (Teri)
    • Health Status: Green
    • Details: 0 blocker
  • Metrics (Shing)
    • Health Status: Green
    • Details: 0 blocker
  • Video (eric)
    • Health Status: Green
    • Details: 0 blocker
  • Music (eric)
    • Health Status: Green
    • Details: 0 blocker
  • Gallery (eric)
    • Health Status: Green
    • Details: 0 blocker

Exploratory Test

Flame-KK & NEXUS-5-L

  • Regression bugs

Stability

NEXUS-5-L 5.1

- Result

  • NEXUS-5-L 5.1
    • Current run - NEXUS-5-L 5.1 * 4: 104.81 hrs

V2.2 Test Case Creation

On Track

Test Case Creation WIP

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (19 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (78 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
987532 npark@mozilla.com RESOLVED WORKSFORME Performance bignose1007+bugzilla@gmail.com [meta] Project Silk on B2G.
1018320 RESOLVED FIXED DOM: Core & HTML amarchesini@mozilla.com Implement RequestSync API for FirefoxOS
1020757 RESOLVED FIXED Gaia::Settings eragonj+moz@eragonj.me [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed
1043558 RESOLVED FIXED Graphics sotaro.ikeda.g@gmail.com Use gralloc buffers for WebRTC local camera preview
1061130 RESOLVED FIXED Gaia::Dialer gsvelto@mozilla.com [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)#
1068963 RESOLVED INCOMPLETE Audio/Video blakewu0205@gmail.com Frame drops during end-to-end playback
1071484 RESOLVED FIXED Audio/Video bobby.chien+bugzilla@gmail.com [Meta][User story] Support *.mkv container format
1073419 RESOLVED WONTFIX General nobody@mozilla.org [ALA] All gecko code needed to support adjustable location accuracy
1082268 edchen@mozilla.com RESOLVED WORKSFORME Gaia::Music bobby.chien+bugzilla@gmail.com [meta] Music app launch latency is worse compared to Android on quad core 1 GB device
1082290 RESOLVED FIXED Performance dhylands@gmail.com Implement cgroup swappiness feature for low memory target (256 MB)
1083953 RESOLVED FIXED Gaia marta@sec.t-labs.tu-berlin.de [META] Privacy Panel move from dev_apps to apps
1086963 edchen@mozilla.com RESOLVED WORKSFORME Gaia::Gallery bobby.chien+bugzilla@gmail.com [meta] Gallery app launch latency is worse than Android on quad core device
1092427 echang@mozilla.com RESOLVED FIXED Gaia::Dialer thills@mozilla.com Dialer app should follow text selection pattern.
1092437 echang@mozilla.com RESOLVED FIXED Gaia::SMS nobody@mozilla.org Messages app should follow text selection pattern
1092960 RESOLVED FIXED Gaia::Camera wilsonpage@mozilla.com Camera app to follow text selection pattern
1092966 RESOLVED FIXED Gaia::FMRadio jdarcangelo@mozilla.com FM Radio app to follow text selection pattern
1092967 RESOLVED FIXED Gaia::Gallery pdahiya@mozilla.com Gallery app to follow text selection pattern
1092969 echang@mozilla.com RESOLVED FIXED Gaia::Music dominickuo@csie.io Music app to follow text selection pattern
1092972 RESOLVED FIXED Gaia::Video rnicoletti@mozilla.com Video app to follow text selection pattern
1094121 RESOLVED FIXED General styang@mozilla.com [meta] Android L 5.0 Porting for B2G
1097865 shing.lyu@gmail.com RESOLVED WONTFIX Gaia::System marshall@mozilla.com [Telemetry] Collect metrics for voice call info
1098970 RESOLVED FIXED GonkIntegration boris.chiou@gmail.com [lollipop] Porting NativeWindow from LL to gonk
1099076 shing.lyu@gmail.com RESOLVED WONTFIX WebRTC nobody@mozilla.org Screen sharing support on B2G
1099079 RESOLVED WONTFIX Gaia nobody@mozilla.org Implement permission dialog for screen sharing
1107291 RESOLVED FIXED MTP/UMS viralwang@gmail.com SD/Storage (fuse) for L on Nexus 5
1107296 RESOLVED WORKSFORME General 6jamin@gmail.com [meta] GPS Android L Porting
1107298 RESOLVED FIXED General viralwang@gmail.com [meta] Sensors Android L Porting
1107305 RESOLVED FIXED General seinlin.maung@gmail.com [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD
1109422 shing.lyu@gmail.com RESOLVED FIXED General marshall@mozilla.com AppUsage Metric collection enhancements for MonthlyActiveUsers computation
1115356 RESOLVED INVALID Gaia::Settings jocheng@mozilla.com [meta]Privacy Bugs Meta

30 Total; 0 Open (0%); 30 Resolved (100%); 0 Verified (0%);


Verification Done

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
1107304 VERIFIED DUPLICATE General nobody@mozilla.org [meta] BT Android L Porting

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Retrieved from "https://wiki.allizom.org/w/index.php?title=B2G/QA/2.2/2015-06-15Status&oldid=1079975"