Latest revision as of 16:39, 24 May 2012

« Fennec 14 Beta 2 | Fennec 14 Beta 3 | » Fennec 14 Beta 4

Native Fennec 14 Beta 3 Test Plan

Release: May 25th 2012
QA Contact: Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping kbrosnan
Builds: Firefox 14b3 | changeset | pushlog

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	Device	Completed	Results
Softvision	Galaxy SII 2.3.4	May 25th, 2012	PASS

Detailed Smoketest results

BFTs and Exploratory for Features

QA Task	Person/Group	How Often?
BFTs	Softvision	Once

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.

Assigned	Device	Completed	Results
Softvision	Galaxy Nexus 4.0.2/LG Optimus 2X 2.2.2/HTC Desire Z 2.3.3	May 25th, 2012	PASS

Detailed BFT results

Android Permissions Testing

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Assigned	Device	Completed	Results
Softvision	Samsung Galaxy Nexus 4.0.2	May 25th, 2012	PASS

Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions

L10N Spot Checks

QA Task	Person/Group	How Often?
Spot Check Verification	SoftVision	Every Beta

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Assigned	Device	Completed
SoftVision	Samsung Galaxy Nexus 4.0.2	May, 24th, 2012

Detailed L10N matrix

Bug Fix Verification

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Areas for exploratory testing

Sync
Graphics
New locales for beta 3

@@ Line 16: / Line 16: @@
 |-
 | Smoketests
-| Waverley
+| Softvision
 | Every Beta
 |}
@@ Line 31: / Line 31: @@
 |-
 | BFTs
-| Waverley
+| Softvision
 | Once
 |}
@@ Line 46: / Line 46: @@
 |-
 | Verification
-| Waverley
+| Softvision
 | Every Beta
 |}
@@ Line 77: / Line 77: @@
 |-
 | Verification
-| Waverley
+| Softvision
 | Every Beta
 |}
+* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=754286%2C754224%2C754947%2C756455%2C753035%2C709321%2C709323%2C750346%2C709313%2C709311%2C749384%2C754233%2C749426%2C752368%2C689707%2C754364%2C750293%2C754426%2C753742%2C732901%2C755935%2C754958%2C721835%2C748590%2C754872%2C707571%2C732901%2C743279%2C755549%2C745243%2C732572%2C731288%2C755771%2C752713%2C756555%2C755324%2C748509%2C756701%2C755383 Bugs fixed in beta 3]
+* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=754286%2C754224%2C754947%2C756455%2C753035%2C709321%2C709323%2C750346%2C709313%2C709311%2C749384%2C754233%2C749426%2C752368%2C689707%2C754364%2C750293%2C754426%2C753742%2C732901%2C755935%2C754958%2C721835%2C748590%2C754872%2C707571%2C732901%2C743279%2C755549%2C745243%2C732572%2C731288%2C755771%2C752713%2C756555%2C755324%2C748509%2C756701%2C755383;negate0=1;bug_id_type=anyexact;list_id=3168692;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 3]
 * [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
 ====Areas for exploratory testing====
+* Sync
+* Graphics
+* New locales for beta 3

QA/Fennec/14/Beta/3: Difference between revisions