QA/Fennec/Milestones/2.0: Difference between revisions

Latest revision as of 23:19, 11 April 2011

« Mobile

Overview

Fennec Test Strategy

The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.

All of our releases are tested off of the "Fennec 2.0 Catch-All Test Run" on the Litmus TCM.

For more information about Fennec 2.0, take a look at the mobile team's Feature Planning page

Current Blocking Bugs List

Devices Supported

Device	OS	Manufacturer	Keyboard	GPS	Camera	Rotate	Resolution
Nokia N900	Maemo	Nokia	Slide Out	Yes	Yes	Yes	480x800
Nexus One	Android	Google	None	Yes	Yes	Yes	800x480
Droid	Android	Motorola	Yes	Yes	Yes	Yes	800x480
Desire	Android	HTC	Yes	Yes	Yes	Yes	800x480
Droid Incredible	Android	HTC	Yes	Yes	Yes	Yes	800x480
HTC Desire	Android	HTC	No	Yes	Yes	Yes	800x480

Build Location

Fennec 2.0 is currently built from trunk (mozilla-central) as well as the front end mobile-browser repositories. Nightly builds for all platforms are located at: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mobile-trunk/

Releases Tested

Alpha 1 - August 16th - Release Test Results
Beta 1 - October 7th - Release Test Results, build 3
Beta 2 - Release Test Results, build 2, build 3
Beta 3 - Release Test Results
Beta 4 - Release Test Results
Beta 5 - Release Test Results
RC 1 - Release Test Results
4.0.1 - Release Test Results

Test Areas

General Test Areas

Status	Action to Take
Testcases Added	Begin doing nightly runs of the BFT
Landed	Add testcases to Litmus Begin filing/verifying bugs
Dev Started	Contact the developer Build the Test Plan
Not Landed/Backed Out	Stay in a holding pattern

Platform (P1's)

Feature Area and Spec	Unit Testcases Needed/Added	QA Contact	Dev Contact	Links
e10s	Yes	mw22		Test Plan
Layers	Yes	mw22/aaronmt
Power Mgmt	Yes/No	mw22

P1 (must have's)

Feature Area and Spec	Litmus Testcases Needed/Added	QA Contact	Dev Contact	Links
Android Updater	Yes/Yes	nhirata	blassey, apakhotin	Test Plan
Multitouch	Yes/No	aakashd	mbrubeck	Test Plan
Virtual Keyboard	Yes/Yes	nhirata	jchen	Test Plan
Android Chrome Theme	Yes/No	AaronMT	madhava, martell
Weave Sync Integration	Yes/Yes	tchung	mfinkle	Test Plan
Platform integration (notification systems, back button, helper apps)	Yes/No	ashah	bunch of people
RTL Support	Yes/Yes	nhirata	vingtetun	Test Plan
Page Interactions	Yes/No	aakashd	vingtetun, mfinkle
Awesome Screen Redesign	Yes/No	AaronMT	vingtetun	Test Plan

P2 (should have's)

Feature Area and Spec	Litmus Testcases Needed/Added	QA Contact	Dev Contact	Links
Find In Page	Yes/Yes	vlad	vingtetun	Test Plan
Sharing	Yes/Yes	tchung	mbrubeck	Test Plan
Feedback and Help	Yes/Yes	nhirata	mfinkle	Test Plan
UI Transitions/Animations	No/No	aakashd
Basic RSS Support	Yes/No	nhirata	jmientenin	Test Plan
Scrolling Indicators	Yes/No	aakashd	mfinkle	Test Plan
Camera UI	Yes/No	vlad
Contacts Integration	Yes/No	tchung	mfinkle	Test Plan
Reflow on Zoom	Yes/No	mw22	mbrubeck	Test Plan
Form Assistant Refresh	Yes/Yes	aakashd	vingtetun	Test Plan

P3 (nice to have's)

Feature Area and Spec	Litmus Testcases Needed/Added	QA Contact	Dev Contact	Links
Long-Tap Support	Yes/No	nhirata		Test Plan
Session Restore	Yes/Yes	tchung	mfinkle
Make logging into websites easier	Yes/No	tchung
Better error pages	Yes/No	aakashd	stechz
Mobilize our messages/dialogs	Yes/No	mw22
Basic Webapp Support	No	tchung	fabrice

Automation

QA is undertaking the task of porting the unit tests from Firefox to Fennec for each platform. This is a lengthy task, but our goal is to have 100% unit tests passing by the 2.0 ship.

We have created a tracking system for the unit tests which we update on a regular basis.

@@ Line 11: / Line 11: @@
 For more information about Fennec 2.0, take a look at the mobile team's [[Mobile/Planning/2.0|Feature Planning page]]
 === Current Blocking Bugs List ===
-* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=blocking-fennec%3A2.0b1%2B Beta 1 blockers] : as of 9/14 - 27 blockers
-* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=cf_blocking_fennec&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=substring&value0-0-0=2.0a1%2B Alpha 1 blockers]
+* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=blocking-fennec%3A%2B fennec blockers]
+* [http://blocker-reports.brasstacks.mozilla.com/mobile.html blocker trends]
 === Devices Supported ===
@@ Line 35: / Line 36: @@
 === Build Location ===
-Fennec 2.0 is currently built from trunk (mozilla-central) as well as the front end mobile-browser repositories. To minimize branching and maintenance, we will target the 1.9.x (higher than 2) branch. All other platforms will build from the same branch.
-Nightly builds for Maemo (you need both fennec*.deb and xulrunner*.deb where the timestamps match) and Windows Mobile (only the .cab file is needed) are located here: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mobile-1.9.x/
+Fennec 2.0 is currently built from trunk (mozilla-central) as well as the front end mobile-browser repositories.  Nightly builds for all platforms are located at: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mobile-trunk/
 == Releases Tested ==
 * Alpha 1 - August 16th - [[QA/Fennec/Milestones/2.0/ReleaseTest/Alpha1|Release Test Results]]
-* Beta 1 - September xxx - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta1|Release Test Results]]
+* Beta 1 - October 7th - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta1|Release Test Results]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta1_Build3|build 3]]
+* Beta 2 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2|Release Test Results]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build2|build 2]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build3|build 3]]
+* Beta 3 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta3|Release Test Results]]
+* Beta 4 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta4|Release Test Results]]
+* Beta 5 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta5|Release Test Results]]
+* RC 1 - [[QA/Fennec/Milestones/2.0/ReleaseTest/RC1|Release Test Results]]
+* 4.0.1 - [[QA/Fennec/Milestones/2.0/ReleaseTest/4.0.1|Release Test Results]]
 == Test Areas ==
@@ Line 71: / Line 77: @@
 |}
-==== Platform (P1's) ====
+==== Platform (P1's)  ====
 {| class="standard-table sortable"
 |-
-|class="header"|Feature Area and Spec
+| class="header" | Feature Area and Spec
-|class="header"|Unit Testcases Needed/Added
+| class="header" | Unit Testcases Needed/Added
-|class="header"|QA Contact
+| class="header" | QA Contact
-|class="header"|Dev Contact
+| class="header" | Dev Contact
-|class="header"|Links
+| class="header" | Links
+|- style="background:#DFFFA5;"
+| [[Mobile/e10s|e10s]]
+| Yes
+| mw22
+|
+| [https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:e10s Test Plan]
+|- style="background:#DFFFA5;"
+| [[Gecko:Layers|Layers]]
+| Yes
+| mw22/aaronmt
+|
+|
 |- style="background:#DFFFA5;"
-|[[Mobile/e10s|e10s]]
+| [https://wiki.mozilla.org/Mobile/Powersaving Power Mgmt]
-|Yes
+| Yes/No
-|mw22
+| mw22
 |
-|[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:e10s Test Plan]
+|
-|- style="background:#FFCC99;"
-|[[Gecko:Layers|Layers]]
-|Yes
-|mw22
-|
-|
-|- style="background:#CD5555;"
-|[https://wiki.mozilla.org/Mobile/Powersaving Power Mgmt]
-|Yes/No
-|mw22
-|
-|
 |}
@@ Line 108: / Line 115: @@
 | class="header" | Dev Contact
 | class="header" | Links
+|- style="background:#FFFFFF;"
+| Android Updater
+| Yes/Yes
+| nhirata
+| blassey, apakhotin
+| [https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:Android_Update Test Plan]
 |- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/Mulititouch Multitouch]
@@ Line 114: / Line 127: @@
 | mbrubeck
 | [https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:MultiTouch Test Plan]
-|- style="background:#FFCC99;"
+|- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/Virtual_Keyboard Virtual Keyboard]
-| Yes/No
+| Yes/Yes
 | nhirata
 | jchen
 | [https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:Virtual_Keyboard Test Plan]
-|- style="background:#CD5555;"
+|- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/Android_Theme Android Chrome Theme]
 | Yes/No
@@ Line 132: / Line 145: @@
 | mfinkle
 | [https://wiki.mozilla.org/QA/Weave_Test_Plan/FennecSync Test Plan]
-|- style="background:#FFCC99;"
+|- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/PlatformIntegration Platform integration] (notification systems, back button, helper apps)
 | Yes/No
@@ Line 138: / Line 151: @@
 | bunch of people
 |
-|- style="background:#DFFFA5;"
+|- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/RTL_Support RTL Support]
-| Yes/No
+| Yes/Yes
 | nhirata
 | vingtetun
@@ Line 150: / Line 163: @@
 | vingtetun, mfinkle
 |
-|- style="background:#DFFFA5;"
+|- style="background:#FFFFFF;"
 | [https://wiki.mozilla.org/Mobile/Projects/AwesomeScreen2.0 Awesome Screen Redesign]
 | Yes/No
@@ Line 172: / Line 185: @@
 |vingtetun
 |[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:FindInPage Test Plan]
-|- style="background:#DFFFA5;"
+|- style="background:#FFFFFF;"
 |[https://wiki.mozilla.org/Mobile/Projects/Sharing Sharing]
 |Yes/Yes
@@ Line 178: / Line 191: @@
 |mbrubeck
 |[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:Sharing Test Plan]
-|- style="background:#DFFFA5;"
+|- style="background:#FFFFFF;"
 |[https://wiki.mozilla.org/Mobile/Projects/Feedback Feedback and Help]
-|Yes/No
+|Yes/Yes
 |nhirata
 |mfinkle
@@ Line 217: / Line 230: @@
 |[https://wiki.mozilla.org/Mobile/Projects/Reflow_on_zoom Reflow on Zoom]
 |Yes/No
-|vlad
+|mw22
-|stechz
+|mbrubeck
-|
+|[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:Reflow_on_zoom Test Plan]
 |- style="background:#FFFFFF;"
 |[https://wiki.mozilla.org/Mobile/Projects/FormAssistant2.0 Form Assistant Refresh]
@@ Line 242: / Line 255: @@
 |
 |[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:LongTapSupport Test Plan]
-|- style="background:#DFFFA5;"
+|- style="background:#FFFFFF;"
 |[https://wiki.mozilla.org/Mobile/Projects/SessionStore Session Restore]
-|Yes/No
+|Yes/Yes
 |tchung
 |mfinkle
@@ Line 266: / Line 279: @@
 |
 |
-|- style="background:#CD5555;"
+|- style="background:#FFCC99;"
 |[https://wiki.mozilla.org/Mobile/Projects/WebApp_Support Basic Webapp Support]
 |No

QA/Fennec/Milestones/2.0: Difference between revisions

Latest revision as of 23:19, 11 April 2011

Contents

Overview

Current Blocking Bugs List

Devices Supported

Build Location

Releases Tested

Test Areas

General Test Areas

Platform (P1's)

P1 (must have's)

P2 (should have's)

P3 (nice to have's)

Automation

Navigation menu

QA/Fennec/Milestones/2.0: Difference between revisions

Latest revision as of 23:19, 11 April 2011

Overview

Current Blocking Bugs List

Devices Supported

Build Location

Releases Tested

Test Areas

General Test Areas

Platform (P1's)

P1 (must have's)

P2 (should have's)

P3 (nice to have's)

Automation

Navigation menu

Search