Latest revision as of 22:39, 14 June 2012

« Fennec 14 Beta 5 | Fennec 14 Beta 6 | » Fennec 14 Beta 7

Native Fennec 14 Beta 7 Test Plan

Release: June 13th, 2012
QA Contact: Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping kbrosnan
Builds: Firefox 14b7 | changeset | pushlog

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	Device	Completed	Results
Softvision	Galaxy Nexus (4.0.2)	June 13th, 2012	PASS
Softvision	Galaxy SII (2.3.4)	June 13th, 2012	PASS

Detailed Smoketest results

BFTs and Exploratory for Features

QA Task	Person/Group	How Often?
BFTs	Softvision	Once

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.

Assigned	Device	Completed	Results
Softvision	Galaxy Nexus	June 13th,2012	PASS
Softvision	Galaxy SII	June 13th,2012	PASS
Softvision	LG Optimus 2x	June 13th,2012	PASS
Softvision	HTC Desire	June 13th,2012	PASS

Detailed BFT results

Android Permissions Testing

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Assigned	Device	Completed	Results
Softvision	Galaxy Nexus	June 13th , 2012	PASS

Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions

L10N Spot Checks

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

QA Task	Person/Group	How Often?
Spot Check Verification	SoftVision	Every Beta

Detailed L10N matrix

Bug Fix Verification

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Areas for exploratory testing

Native Fennec 14 Beta 7 Test Plan (build 2)

Release: June 13th, 2012
QA Contact: Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping kbrosnan
Builds: Firefox 14b7 | changeset | pushlog

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	Device	Completed	Results
XWei	HTC Desire HD	June 13, 2012	PASS
XWei	Motorola Droid 3	June 13, 2012	PASS

Detailed Smoketest results

Android Permissions Testing

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Assigned	Device	Completed	Results
kbrosnan	HTC G2	June 13th , 2012	PASS

Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions

L10N Spot Checks

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

QA Task	Person/Group	How Often?
Spot Check Verification	SoftVision	Every Beta

Assigned	Device	Completed	Result
Aaron	Samsung Galaxy Nexus 4.0.4	June 13th, 2012	PASS

Detailed L10N matrix

Bug Fix Verification

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Areas for exploratory testing

* bug 759678 bug 763592 Mobile pages / load / reload
* bug 764354 Font inflation was affecting the click to play box
* bug 764300 ko and pt-br not showing up in multilocale build

Native Fennec 14 Beta 7 Test Plan (build 3)

Release: June 15th, 2012
QA Contact: Kevin Brosnan
IRC: irc://irc.mozilla.org#qa ping kbrosnan
Builds: Firefox 14b7 | changeset | pushlog

Smoketests

QA Task	Person/Group	How Often?
Smoketests	Softvision	Every Beta

3

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned	Device	Completed	Results
Softvision	HTC Desire	June 15th 2012	PASS
Softvision	Samsung Galaxy SII	June 15th 2012	PASS

Detailed Smoketest results

L10N Spot Checks

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

QA Task	Person/Group	How Often?
Spot Check Verification	SoftVision	Every Beta

Assigned	Device	Completed	Result
Aaron	Samsung Galaxy Nexus (Android 4.0.4)	June 15th, 2012	PASS
SoftVision	Samsung Galaxy Nexus (Android 4.0.2)	June 15th, 2012	PASS

Detailed L10N matrix

Bug Fix Verification

QA Task	Person/Group	How Often?
Verification	Softvision	Every Beta

Areas for exploratory testing

* bug 747492 - Flash can open VKB even when the plugin element does not have focus
* bug 758193 - Places maintenance causing excessive battery usage
* bug 736272 - Add extra awesomeness weight to bookmark
* bug 759747 - Fullscreen Flash video does not appear on ICS

Bugs found through exploratory testing

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

XUL Fennec 14 Beta 7 Test Plan

No planned release

@@ Line 52: / Line 52: @@
 [[QA/Fennec/14/Beta/7/permissions-results|Detailed Android Permissions Testing Results]]
 ''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]
+=== L10N Spot Checks ===
+Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Spot Check Verification
+| SoftVision
+| Every Beta
+|}
+[[QA/Fennec/14/Beta/7/L10N matrix|Detailed L10N matrix]]
+=== Bug Fix Verification ===
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Verification
+| Softvision
+| Every Beta
+|}
+* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=756003,760675,747388,755517,753329,757937,748434,749186,747720,706193,760098,745340,754575,762407,736602,760169,736602,762590,763916,759755,756253,758820,764144 Bugs fixed in Beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=756003,760675,747388,755517,753329,757937,748434,749186,747720,706193,760098,745340,754575,762407,736602,760169,736602,762590,763916,759755,756253,758820,764144;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
+====Areas for exploratory testing====
+= Native Fennec 14 Beta 7 Test Plan (build 2) =
+* Release: June 13th, 2012
+* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]
+* IRC: irc://irc.mozilla.org#qa ping kbrosnan
+* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog]
+=== Smoketests ===
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Smoketests
+| Softvision
+| Every Beta
+|}
+Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
+{{:QA/Fennec/14/Beta/7/smoketests-results-build-2}}
+[[QA/Fennec/14/Beta/7/smoketests-results-build-2|Detailed Smoketest results]]
+=== Android Permissions Testing ===
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Verification
+| Softvision
+| Every Beta
+|}
+{{:QA/Fennec/14/Beta/7/permissions-results-build-2}}
+[[QA/Fennec/14/Beta/7/permissions-results-build-2|Detailed Android Permissions Testing Results]]
+''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]
+=== L10N Spot Checks ===
+Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Spot Check Verification
+| SoftVision
+| Every Beta
+|}
+{{:QA/Fennec/14/Beta/7/L10N matrix-build2}}
+[[QA/Fennec/14/Beta/7/L10N matrix-build2|Detailed L10N matrix]]
+=== Bug Fix Verification ===
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Verification
+| Softvision
+| Every Beta
+|}
+* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=763592,759678,764354 Bugs fixed in Beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=763592,759678,764354;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
+====Areas for exploratory testing====
+ * {{bug|759678}} {{bug|763592}} Mobile pages / load / reload
+ * {{bug|764354}} Font inflation was affecting the click to play box
+ * {{bug|764300}} ko and pt-br not showing up in multilocale build
+= Native Fennec 14 Beta 7 Test Plan (build 3) =
+* Release: June 15th, 2012
+* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]
+* IRC: irc://irc.mozilla.org#qa ping kbrosnan
+* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog]
+=== Smoketests ===
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Smoketests
+| Softvision
+| Every Beta
+|}3
+Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
+{{:QA/Fennec/14/Beta/7/smoketests-results-build-3}}
+[[QA/Fennec/14/Beta/7/smoketests-results-build-3|Detailed Smoketest results]]
+=== L10N Spot Checks ===
+Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
+{|width=100%
+|-
+| style="background-color: #efefef;"|'''QA Task'''
+| style="background-color: #efefef;"|'''Person/Group'''
+| style="background-color: #efefef;"|'''How Often?'''
+|-
+| Spot Check Verification
+| SoftVision
+| Every Beta
+|}
+{{:QA/Fennec/14/Beta/7/L10N matrix-build3}}
+[[QA/Fennec/14/Beta/7/L10N matrix-build3|Detailed L10N matrix]]
 === Bug Fix Verification ===
@@ Line 64: / Line 208: @@
 | Every Beta
 |}
-* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=757025%2C756366%2C750511%2C757039%2C754985%2C758257%2C755062%2C748994%2C755834%2C756689%2C753250%2C752709%2C752709%2C757646%2C755576%2C753200%2C744850%2C758010%2C750334;list_id=3245364 Bugs fixed in Beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=747492,758193,736272,759747 Bugs fixed in Beta 7]
-* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=757025%2C756366%2C750511%2C757039%2C754985%2C758257%2C755062%2C748994%2C755834%2C756689%2C753250%2C752709%2C752709%2C757646%2C755576%2C753200%2C744850%2C758010%2C750334;negate0=1;bug_id_type=anyexact;list_id=3168692;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
+* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=747492,758193,736272,759747;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
 * [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
 ====Areas for exploratory testing====
+ * {{bug|747492}} - Flash can open VKB even when the plugin element does not have focus
+ * {{bug|758193}} - Places maintenance causing excessive battery usage
+ * {{bug|736272}} - Add extra awesomeness weight to bookmark
+ * {{bug|759747}} - Fullscreen Flash video does not appear on ICS
+===== Bugs found through exploratory testing =====
+<bugzilla>{ "product" : "Fennec Native", "whiteboard" : "[14.0b7]" } </bugzilla>
 = XUL Fennec 14 Beta 7 Test Plan  =
 No planned release

QA/Fennec/14/Beta/7: Difference between revisions

Latest revision as of 22:39, 14 June 2012

Native Fennec 14 Beta 7 Test Plan

Smoketests

BFTs and Exploratory for Features

Android Permissions Testing

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Native Fennec 14 Beta 7 Test Plan (build 2)

Smoketests

Android Permissions Testing

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Native Fennec 14 Beta 7 Test Plan (build 3)

Smoketests

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Bugs found through exploratory testing

XUL Fennec 14 Beta 7 Test Plan

Navigation menu

QA/Fennec/14/Beta/7: Difference between revisions

Latest revision as of 22:39, 14 June 2012

Native Fennec 14 Beta 7 Test Plan

Smoketests

BFTs and Exploratory for Features

Android Permissions Testing

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Native Fennec 14 Beta 7 Test Plan (build 2)

Smoketests

Android Permissions Testing

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Native Fennec 14 Beta 7 Test Plan (build 3)

Smoketests

L10N Spot Checks

Bug Fix Verification

Areas for exploratory testing

Bugs found through exploratory testing

XUL Fennec 14 Beta 7 Test Plan

Navigation menu

Search