QA/Fennec/14/Beta/7: Difference between revisions
Jump to navigation
Jump to search
| (12 intermediate revisions by 3 users not shown) | |||
| Line 85: | Line 85: | ||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | * [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | ||
====Areas for exploratory testing==== | ====Areas for exploratory testing==== | ||
= Native Fennec 14 Beta 7 Test Plan (build 2) = | |||
* Release: June 13th, 2012 | |||
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan] | |||
* IRC: irc://irc.mozilla.org#qa ping kbrosnan | |||
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog] | |||
=== Smoketests === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Smoketests | |||
| Softvision | |||
| Every Beta | |||
|} | |||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | |||
{{:QA/Fennec/14/Beta/7/smoketests-results-build-2}} | |||
[[QA/Fennec/14/Beta/7/smoketests-results-build-2|Detailed Smoketest results]] | |||
=== Android Permissions Testing === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/14/Beta/7/permissions-results-build-2}} | |||
[[QA/Fennec/14/Beta/7/permissions-results-build-2|Detailed Android Permissions Testing Results]] | |||
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]] | |||
=== L10N Spot Checks === | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Spot Check Verification | |||
| SoftVision | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/14/Beta/7/L10N matrix-build2}} | |||
[[QA/Fennec/14/Beta/7/L10N matrix-build2|Detailed L10N matrix]] | |||
=== Bug Fix Verification === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=763592,759678,764354 Bugs fixed in Beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=763592,759678,764354;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | |||
====Areas for exploratory testing==== | |||
* {{bug|759678}} {{bug|763592}} Mobile pages / load / reload | |||
* {{bug|764354}} Font inflation was affecting the click to play box | |||
* {{bug|764300}} ko and pt-br not showing up in multilocale build | |||
= Native Fennec 14 Beta 7 Test Plan (build 3) = | |||
* Release: June 15th, 2012 | |||
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan] | |||
* IRC: irc://irc.mozilla.org#qa ping kbrosnan | |||
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog] | |||
=== Smoketests === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Smoketests | |||
| Softvision | |||
| Every Beta | |||
|}3 | |||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | |||
{{:QA/Fennec/14/Beta/7/smoketests-results-build-3}} | |||
[[QA/Fennec/14/Beta/7/smoketests-results-build-3|Detailed Smoketest results]] | |||
=== L10N Spot Checks === | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Spot Check Verification | |||
| SoftVision | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/14/Beta/7/L10N matrix-build3}} | |||
[[QA/Fennec/14/Beta/7/L10N matrix-build3|Detailed L10N matrix]] | |||
=== Bug Fix Verification === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=747492,758193,736272,759747 Bugs fixed in Beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=747492,758193,736272,759747;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | |||
====Areas for exploratory testing==== | |||
* {{bug|747492}} - Flash can open VKB even when the plugin element does not have focus | |||
* {{bug|758193}} - Places maintenance causing excessive battery usage | |||
* {{bug|736272}} - Add extra awesomeness weight to bookmark | |||
* {{bug|759747}} - Fullscreen Flash video does not appear on ICS | |||
===== Bugs found through exploratory testing ===== | |||
<bugzilla>{ "product" : "Fennec Native", "whiteboard" : "[14.0b7]" } </bugzilla> | |||
= XUL Fennec 14 Beta 7 Test Plan = | = XUL Fennec 14 Beta 7 Test Plan = | ||
No planned release | No planned release | ||
Latest revision as of 22:39, 14 June 2012
« Fennec 14 Beta 5 | Fennec 14 Beta 6 | » Fennec 14 Beta 7
Native Fennec 14 Beta 7 Test Plan
- Release: June 13th, 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b7 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus (4.0.2) | June 13th, 2012 | PASS |
| Softvision | Galaxy SII (2.3.4) | June 13th, 2012 | PASS |
BFTs and Exploratory for Features
| QA Task | Person/Group | How Often? |
| BFTs | Softvision | Once |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus | June 13th,2012 | PASS |
| Softvision | Galaxy SII | June 13th,2012 | PASS |
| Softvision | LG Optimus 2x | June 13th,2012 | PASS |
| Softvision | HTC Desire | June 13th,2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus | June 13th , 2012 | PASS |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
Areas for exploratory testing
Native Fennec 14 Beta 7 Test Plan (build 2)
- Release: June 13th, 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b7 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| XWei | HTC Desire HD | June 13, 2012 | PASS |
| XWei | Motorola Droid 3 | June 13, 2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
| kbrosnan | HTC G2 | June 13th , 2012 | PASS |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
| Assigned | Device | Completed | Result |
| Aaron | Samsung Galaxy Nexus 4.0.4 | June 13th, 2012 | PASS |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
Areas for exploratory testing
* bug 759678 bug 763592 Mobile pages / load / reload * bug 764354 Font inflation was affecting the click to play box * bug 764300 ko and pt-br not showing up in multilocale build
Native Fennec 14 Beta 7 Test Plan (build 3)
- Release: June 15th, 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b7 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
3
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| Softvision | HTC Desire | June 15th 2012 | PASS |
| Softvision | Samsung Galaxy SII | June 15th 2012 | PASS |
L10N Spot Checks
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
| Assigned | Device | Completed | Result |
| Aaron | Samsung Galaxy Nexus (Android 4.0.4) | June 15th, 2012 | PASS |
| SoftVision | Samsung Galaxy Nexus (Android 4.0.2) | June 15th, 2012 | PASS |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
Areas for exploratory testing
* bug 747492 - Flash can open VKB even when the plugin element does not have focus * bug 758193 - Places maintenance causing excessive battery usage * bug 736272 - Add extra awesomeness weight to bookmark * bug 759747 - Fullscreen Flash video does not appear on ICS
Bugs found through exploratory testing
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
XUL Fennec 14 Beta 7 Test Plan
No planned release