QA/Fennec/14/Beta/7: Difference between revisions
| Line 86: | Line 86: | ||
====Areas for exploratory testing==== | ====Areas for exploratory testing==== | ||
= Native Fennec 14 Beta 7 Test Plan = | = Native Fennec 14 Beta 7 Test Plan (build 2) = | ||
* Release: June 13th, 2012 | |||
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan] | |||
* IRC: irc://irc.mozilla.org#qa ping kbrosnan | |||
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/14.0b7-candidates/ Firefox 14b7] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_14_0b7_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_14_0b6_RELEASE&tochange=FENNEC_14_0b7_RELEASE pushlog] | |||
=== Smoketests === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Smoketests | |||
| Softvision | |||
| Every Beta | |||
|} | |||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | |||
{{:QA/Fennec/14/Beta/7/smoketests-results-build-2}} | |||
[[QA/Fennec/14/Beta/7/smoketests-results-build-2|Detailed Smoketest results]] | |||
=== Android Permissions Testing === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/14/Beta/7/permissions-results-build-2}} | |||
[[QA/Fennec/14/Beta/7/permissions-results-build-2|Detailed Android Permissions Testing Results]] | |||
''' Verify permissions between what is currently on the store and with this beta build candidate'''. Details: [[QA/Fennec/Permissions|Android Permissions]] | |||
=== L10N Spot Checks === | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Spot Check Verification | |||
| SoftVision | |||
| Every Beta | |||
|} | |||
[[QA/Fennec/14/Beta/7/L10N matrix-build-2|Detailed L10N matrix]] | |||
=== Bug Fix Verification === | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=763592,759678,764354 Bugs fixed in Beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?bug_id=763592,759678,764354;negate0=1;bug_id_type=anyexact;field0-0-0=cf_status_firefox14;query_format=advanced;type0-0-0=equals;value0-0-0=verified Bugs that need to be verified for beta 7] | |||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=cf_status_firefox14;resolution=FIXED;classification=Client%20Software;query_format=advanced;bug_status=RESOLVED;type0-0-0=equals;value0-0-0=fixed;product=Fennec%20Native Fixes uplifted to 14] | |||
====Areas for exploratory testing==== | |||
* {{bug|759678}} {{bug|763592}} Mobile pages / load / reload | |||
* {{bug|764354}} Font inflation was affecting the click to play box | |||
* {{bug|764300}} ko and pt-br not showing up in multilocale build | |||
= XUL Fennec 14 Beta 7 Test Plan = | = XUL Fennec 14 Beta 7 Test Plan = | ||
No planned release | No planned release | ||
Revision as of 23:37, 13 June 2012
« Fennec 14 Beta 5 | Fennec 14 Beta 6 | » Fennec 14 Beta 7
Native Fennec 14 Beta 7 Test Plan
- Release: June 13th, 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b7 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus (4.0.2) | June 13th, 2012 | PASS |
| Softvision | Galaxy SII (2.3.4) | June 13th, 2012 | PASS |
BFTs and Exploratory for Features
| QA Task | Person/Group | How Often? |
| BFTs | Softvision | Once |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus | June 13th,2012 | PASS |
| Softvision | Galaxy SII | June 13th,2012 | PASS |
| Softvision | LG Optimus 2x | June 13th,2012 | PASS |
| Softvision | HTC Desire | June 13th,2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
| Softvision | Galaxy Nexus | June 13th , 2012 | PASS |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
Areas for exploratory testing
Native Fennec 14 Beta 7 Test Plan (build 2)
- Release: June 13th, 2012
- QA Contact: Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping kbrosnan
- Builds: Firefox 14b7 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| XWei | HTC Desire HD | June 13, 2012 | PASS |
| XWei | Motorola Droid 3 | June 13, 2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
| kbrosnan | HTC G2 | June 13th , 2012 | PASS |
Detailed Android Permissions Testing Results Verify permissions between what is currently on the store and with this beta build candidate. Details: Android Permissions
L10N Spot Checks
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
Areas for exploratory testing
* bug 759678 bug 763592 Mobile pages / load / reload * bug 764354 Font inflation was affecting the click to play box * bug 764300 ko and pt-br not showing up in multilocale build
XUL Fennec 14 Beta 7 Test Plan
No planned release