| (8 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
__NOTOC__ | __NOTOC__ | ||
<small>[[QA/Fennec/14/14.0.1/Release/Build_1|Fennec 14.0.1 Build 1]] | [[QA/Fennec/14/14.0.1/Release/Build_2|Fennec 14.0.1 Build | <small>[[QA/Fennec/14/14.0.1/Release/Build_1|« Fennec 14.0.1 Build 1]] | [[QA/Fennec/14/14.0.1/Release/Build_2|Fennec 14.0.1 Build 2]] |[[QA/Fennec/14/14.0.1/Release/Build_3|Fennec 14.0.1 Build 3»]] </small> | ||
= Native Fennec 14.0.1 Build | = Native Fennec 14.0.1 Build 2 Test Plan = | ||
* Release: July 17th 2012 | * Release: July 17th 2012 | ||
* QA Contact: [mailto:atrain@mozilla.com Aaron Train] | * QA Contact: [mailto:atrain@mozilla.com Aaron Train] | ||
| Line 20: | Line 20: | ||
|} | |} | ||
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | ||
{{:QA/Fennec/14/14.0.1/Release/Build_2/smoketests-results}} | |||
* [[QA/Fennec/14/14.0.1/Release/Build_2/smoketests-results|Detailed Smoketest results]] | * [[QA/Fennec/14/14.0.1/Release/Build_2/smoketests-results|Detailed Smoketest results]] | ||
| Line 35: | Line 35: | ||
|} | |} | ||
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=451 Fennec Phone 14 Test Suite], and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=452 Fennec Tablet 14 Test Suite]. | ||
{{:QA/Fennec/14/14.0.1/Release/Build_2/bft-results}} | |||
* [[QA/Fennec/14/14.0.1/Release/Build_2/bft-results|Detailed BFT results]] | * [[QA/Fennec/14/14.0.1/Release/Build_2/bft-results|Detailed BFT results]] | ||
| Line 67: | Line 67: | ||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | ||
{{:QA/Fennec/14/14.0.1/Release/Build_2/L10N matrix}} | {{:QA/Fennec/14/14.0.1/Release/Build_2/L10N matrix}} | ||
[[QA/Fennec/14/14.0.1/Release/Build_2/L10N matrix|Detailed L10N matrix]] | * [[QA/Fennec/14/14.0.1/Release/Build_2/L10N matrix|Detailed L10N matrix]] | ||
=== Bug Fix Verification === | === Bug Fix Verification === | ||
| Line 79: | Line 80: | ||
| Verification | | Verification | ||
| Softvision | | Softvision | ||
| | | | ||
|} | |} | ||
From Build 1: | * From Build 1: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
| Line 89: | Line 90: | ||
</bugzilla> | </bugzilla> | ||
From Build 2: | * From Build 2: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
Latest revision as of 00:09, 14 July 2012
« Fennec 14.0.1 Build 1 | Fennec 14.0.1 Build 2 |Fennec 14.0.1 Build 3»
Native Fennec 14.0.1 Build 2 Test Plan
- Release: July 17th 2012
- QA Contact: Aaron Train
- IRC: irc://irc.mozilla.org#qa ping AaronMT
- Builds: Firefox 14.0.1 Build 2 | changeset | pushlog
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
| SoftVision | SamsungGalaxy Nexus 4.0.4 | July, 16th | PASS |
BFTs and Exploratory for Features
| QA Task | Person/Group | How Often? |
| BFTs | Softvision | Once |
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 14. Tests are available on litmus under the Fennec Phone 14 Test Suite, and Fennec Tablet 14 Test Suite.
| Assigned | Device | Completed | Results |
| SoftVision | Samsung Galaxy Nexus (4.0.4) | July, 16th 2012 | PASS |
| SoftVision | HTC Desire Z (2.3.3) | July, 16th 2012 | PASS |
| Softvision | HTC Desire (Android 2.2.2) | July, 16th 2012 | PASS |
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
| Softvision | HTC Desire (Android 2.2.2) | July 16th 2012 | PASS |
- Detailed Android Permissions Testing Results
- Verify permissions between what is currently on the store and with this beta build candidate.
- Details: Android Permissions
L10N Spot Checks
| QA Task | Person/Group | How Often? |
| Spot Check Verification | SoftVision | Every Beta |
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| Assigned | Device | Completed | Results |
| SoftVision | Galaxy Nexus 4.0.4 | June 16th, 2012 | PASS |
Bug Fix Verification
| QA Task | Person/Group | How Often? |
| Verification | Softvision |
- From Build 1:
8 Total; 0 Open (0%); 1 Resolved (12.5%); 7 Verified (87.5%);
- From Build 2:
2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);