B2G/QA/2.2/2015-03-02Status: Difference between revisions

Jump to navigation Jump to search

B2G/QA/2.2/2015-03-02Status (view source)

Revision as of 08:40, 2 March 2015

364 bytes added ,  2 March 2015
→‎Functional Testing
Line 54: Line 54:
==== Functional Testing ====  
==== Functional Testing ====  
<span style="color:#000000; background:#FFFF00"> Yellow </span>
<span style="color:#000000; background:#FFFF00"> Yellow </span>
* QA focus - [http://mzl.la/150Afqw 33 bugs found].
* QA focus - [http://mzl.la/150Afqw 42 bugs found].


* RTL  (Marigold)
** Health: Yellow
** Test case coverage: 18/26 ready for testing
** Details: 11 blockers -
*** all from this week except one DOM bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1082060 filed on the 17th but possible workaround
*** All blockers found here: http://mzl.la/1wpXqXA
* Privacy  (Gerry)     
* Privacy  (Gerry)     
** Health: Red
** Health: Yellow (Features can work)
** Test case coverage:  
** Test case coverage:  
** Details: 5 blockers
** Details: 2 blockers
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1093688 - Got patches.
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1111992
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1111992 - Can't recreate
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1120577 - Have pull request, wait for landing
* Cut, Copy, and Paste  (Gerry, Edward, Teri, Eric)
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1120733 - Have fix.
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1121232 - Have fix.
*** Compile time - pref off
*** josh to talk to gerry on the compile time pref-off option
* RTL  (Marigold)
** Health: Yellow
** Health: Yellow
** Test case coverage: 50%
** Details:
*** v2.2 WIP, Wiki: http://mzl.la/16VA7Zz
*** 2.2 RTL Spec: http://bit.ly/1KKxkzD
* Cut, Copy, and Paste  (Gerry, Edward, Teri, Eric)
** Health: Green
** Test case coverage:  
** Test case coverage:  
** Details: WIP
** Details: 3 blockers
* NFC  (Alison)
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1130982
** Health: Green
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1114509
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1125045
* NFC  (Alison) absent today
** Health: Yellow
** Test case coverage: 100%
** Details:
*** User story [bug 1102019] is done. I will start test run to verify it.
*** User story [bug 979158] plans to postpone to 3.0 since part of features not finished yet.
* Search app (Hermes)
** Health: Yellow
** Test case coverage: 100%
** Test case coverage: 100%
** Details:  
** Details: Features have been landed.
*** v2.2 WIP
*** 5 WIP blockers:
*** 1 blocker (regression): https://bugzilla.mozilla.org/show_bug.cgi?id=1120849 (patch r+)
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1131966
* Search suggestion based on provider (Hermes)
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1125131
** Health: Green
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1131408
** Test case coverage: 90%
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1132262
** Details: WIP
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1133202
* App-grouping (Hermes)
* App-grouping (Hermes)
** Health: Green
** Health: Green
** Test case coverage: 100%
** Test case coverage:100%
** Details: All landed, will start a test run to verify it.
** Details: Features have been landed. No 2.2+ blockers for now.
* Task Manager (Hermes)
* Task Manager (Hermes)
** Health: Green
** Health: Green
** Test case coverage: 95%
** Test case coverage: 100%
** Details: All landed, will update test cases and then start a test run to verify it.
** Details: Features have been landed.
*** 2 WIP blockers:
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1120974
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1107139
* L-porting (Hermes)
* L-porting (Hermes)
** Health: Green
** Health: Green
** Details:  
** Details:  
*** PVT build can be downloaded for master. v2.2 WIP.
*** Camera recording is still not ready, and its patch is waiting for review. https://bugzilla.mozilla.org/show_bug.cgi?id=1120780
    https://bugzilla.mozilla.org/show_bug.cgi?id=1111890
*** PVT builds for 2.2 & master are all ready.
*** Camera recording is WIP. (https://bugzilla.mozilla.org/show_bug.cgi?id=1120780)
*** Regarding smoketest, we will perform once and then ask Marigold for daily run.
*** UICC Secure Element enablement (for NFC) is WIP (https://bugzilla.mozilla.org/show_bug.cgi?id=985892)
** smoketests running on L? [eric] planned but no v2.2 build yet
*** AI: https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 to help follow-up on L builds
**** [nhirata] commented.  KaiZhen already commented in 39.  Asked if there's any blockers.
** [gerry, eric] Automation trial run on master : 50+% fail rate
*** [hermes] run tests manually on master and send out the L-report
* CAF bugs (Eric)  
* CAF bugs (Eric)  
** Health: Green
** Health: Green
** Test case coverage: 100%
** Test case coverage: 100%
** Details: Regression running
** Details: no blocker.
*** Dialer regression, not related to CAF https://bugzil.la/1131938 TEF will try to land patch asap.
* TCL bugs (Alison, Eric)
* TCL bugs (Alison, Eric)
** Health: Green
** Health: Green
** Test case coverage: 100%
** Test case coverage: 100%
** Details:  
** Details: 1 blocker https://bugzil.la/1131261 r?
*** One blocker for feature [bug 1091544]: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567 (patch reviewing)
* Bluetooth (Eric, Teri)
* Bluetooth (Eric, Teri)
** Health: Green
** Health: Green
** Test case coverage: 100%
** Test case coverage: 100%
** Details:  
** Details: BT team is working on issues. Start testing next week.
** BT team test in progress
** Currently new daemon code is pref off due to OTA problem. https://bugzilla.mozilla.org/show_bug.cgi?id=1134821 need to wait for this to be resolved
** QA testing start on 3/2
* Metrics (Shing)
* Metrics (Shing)
** Health: Red
** Health: Yellow
** Test case coverage: 20%
** Test case coverage: 60%
** Details:  
** Details:  
*** 1 WIP: 1109422
*** 3 Testing https://bugzil.la/1119009 https://bugzil.la/1021173 https://bugil.la/1037495
*** 4 NEW coming: 1037495, 1119009, 1021173, 1126524
*** 2 WIP https://bugzil.la/1109422 https://bugzil.la/1126524
* 256M RAM memory optimization for WFVGA, 5MP.  (Teri)
* 256M RAM memory optimization for WFVGA, 5MP.  (Teri)
** Health: Green
** Health: Green
** Test case coverage: WIP
** Test case coverage: 100%
** Details:  
** Details: MTBF in progress. No blocker.  
** Code landed on mozilla-central, to be landed on V2.2
*** its landed on 2.2 as well
** Identify testing scope with RD
* Multicore performance (Edward)
* Multicore performance (Edward)
** Health:  
** Health:  
** Test case coverage:   
** Test case coverage:   
** Better performance on Multicore  (App startup time for core apps is comparable to Android
** Better performance on Multicore  (App startup time for core apps is comparable to Android
*** When and how can we get performance numbers (app launch latency times) for 2.2 using raptor ?==== Exploratory Testing ====  
** Upgrade raptor environment to 0.6.0
** Set up auto testing environment in TPE Lab
** So far, we provide performance results include "Gallery, Message, Music, Contacts, email, FM, Camera, Video,Clock" (Flame + master)
** Raptor still has some bugs such as touch event lose, we guess that binary format of Lollipop is changed. I need to identify this problem.
** Follow up performance drop issue (https://bugzilla.mozilla.org/show_bug.cgi?id=1132515)
 
 
 
==== Exploratory Testing ====  
<span style="color:#FFFFFF; background:#32CD32"> On Track </span>
<span style="color:#FFFFFF; background:#32CD32"> On Track </span>
* [http://mzl.la/1Cat1tY 212 bugs found] - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day.
* [http://mzl.la/1Cat1tY 212 bugs found] - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day.
Echang
Confirmed users
1,051

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/1058895"

Navigation menu