MozillaWiki

QA/Fennec/14/Beta/7: Difference between revisions

Page Discussion

QA/Fennec/14/Beta/7 (view source)

Revision as of 22:39, 14 June 2012

4,440 bytes added ,  14 June 2012
→‎Bugs found through exploratory testing
mNo edit summary
 
(18 intermediate revisions by 4 users not shown)
Line 52: Line 52:
[[QA/Fennec/14/Beta/7/permissions-results|Detailed Android Permissions Testing Results]]
[[QA/Fennec/14/Beta/7/permissions-results|Detailed Android Permissions Testing Results]]
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]
=== L10N Spot Checks ===
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Spot Check Verification
| SoftVision
| Every Beta
|}
[[QA/Fennec/14/Beta/7/L10N matrix|Detailed L10N matrix]]


=== Bug Fix Verification ===
=== Bug Fix Verification ===
Line 64: Line 81:
| Every Beta
| Every Beta
|}
|}
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=757025%2C756366%2C750511%2C757039%2C754985%2C758257%2C755062%2C748994%2C755834%2C756689%2C753250%2C752709%2C752709%2C757646%2C755576%2C753200%2C744850%2C758010%2C750334;list_id=3245364 Bugs fixed in Beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=756003,760675,747388,755517,753329,757937,748434,749186,747720,706193,760098,745340,754575,762407,736602,760169,736602,762590,763916,759755,756253,758820,764144 Bugs fixed in Beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=757025%2C756366%2C750511%2C757039%2C754985%2C758257%2C755062%2C748994%2C755834%2C756689%2C753250%2C752709%2C752709%2C757646%2C755576%2C753200%2C744850%2C758010%2C750334;negate0=1;bug_id_type=anyexact;list_id=3168692;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=756003,760675,747388,755517,753329,757937,748434,749186,747720,706193,760098,745340,754575,762407,736602,760169,736602,762590,763916,759755,756253,758820,764144;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
====Areas for exploratory testing====
====Areas for exploratory testing====


= XUL Fennec 14 Beta 7 Test Plan =
= Native Fennec 14 Beta 7 Test Plan (build 2) =
* Release: June 13th, 2012
* Release: June 13th, 2012
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]  
* IRC: irc://irc.mozilla.org#qa ping AaronMT
* IRC: irc://irc.mozilla.org#qa ping kbrosnan
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog]
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog]


Line 83: Line 100:
|-
|-
| Smoketests
| Smoketests
| Waverley
| Softvision
| Every Beta
| Every Beta
|}
|}
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite].
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/14/Beta/7/smoketests-xul-results}}
{{:QA/Fennec/14/Beta/7/smoketests-results-build-2}}
[[QA/Fennec/14/Beta/7/smoketests-xul-results|Detailed Smoketest results]]
[[QA/Fennec/14/Beta/7/smoketests-results-build-2|Detailed Smoketest results]]


=== Android Permissions Testing ===
=== Android Permissions Testing ===
Line 98: Line 115:
|-
|-
| Verification
| Verification
| Waverley
| Softvision
| Every Beta
| Every Beta
|}
|}
{{:QA/Fennec/14/Beta/7/permissions-xul-results}}
{{:QA/Fennec/14/Beta/7/permissions-results-build-2}}
[[QA/Fennec/14/Beta/7/permissions-xul-results|Detailed Android Permissions Testing Results]]
[[QA/Fennec/14/Beta/7/permissions-results-build-2|Detailed Android Permissions Testing Results]]
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]]


=== L10N Spot Checks ===
=== L10N Spot Checks ===
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{|width=100%
{|width=100%
|-
|-
Line 113: Line 132:
|-
|-
| Spot Check Verification
| Spot Check Verification
| Waverley
| SoftVision
| Every Beta
| Every Beta
|}
|}


{{:QA/Fennec/14/Beta/7/L10N matrix-build2}}
[[QA/Fennec/14/Beta/7/L10N matrix-build2|Detailed L10N matrix]]
=== Bug Fix Verification ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=763592,759678,764354 Bugs fixed in Beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=763592,759678,764354;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
====Areas for exploratory testing====
* {{bug|759678}} {{bug|763592}} Mobile pages / load / reload
* {{bug|764354}} Font inflation was affecting the click to play box
* {{bug|764300}} ko and pt-br not showing up in multilocale build
= Native Fennec 14 Beta 7 Test Plan (build 3) =
* Release: June 15th, 2012
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]
* IRC: irc://irc.mozilla.org#qa ping kbrosnan
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog]
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}3
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/14/Beta/7/smoketests-results-build-3}}
[[QA/Fennec/14/Beta/7/smoketests-results-build-3|Detailed Smoketest results]]
=== L10N Spot Checks ===
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/14/Beta/7/L10N xul matrix}}
 
[[QA/Fennec/14/Beta/7/L10N xul matrix|Detailed L10N matrix]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Spot Check Verification
| SoftVision
| Every Beta
|}
 
{{:QA/Fennec/14/Beta/7/L10N matrix-build3}}
[[QA/Fennec/14/Beta/7/L10N matrix-build3|Detailed L10N matrix]]


=== Bug Fix Verification ===
=== Bug Fix Verification ===
Line 129: Line 205:
|-
|-
| Verification
| Verification
| Waverley
| Softvision
| Every Beta
| Every Beta
|}
|}
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;type0-0-0=equals;value0-0-0=fixed;classification=Client%20Software;query_format=advanced;product=Fennec Fixes uplifted to 14]
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=747492,758193,736272,759747 Bugs fixed in Beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=747492,758193,736272,759747;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7]
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14]
====Areas for exploratory testing====
* {{bug|747492}} - Flash can open VKB even when the plugin element does not have focus
* {{bug|758193}} - Places maintenance causing excessive battery usage
* {{bug|736272}} - Add extra awesomeness weight to bookmark
* {{bug|759747}} - Fullscreen Flash video does not appear on ICS
 
===== Bugs found through exploratory testing =====
<bugzilla>{ "product" : "Fennec Native", "whiteboard" : "[14.0b7]" } </bugzilla>
 
= XUL Fennec 14 Beta 7 Test Plan  =
No planned release
Kbrosnan
Confirmed users
1,180

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/440690...441548"