Confirmed users
7,000
edits
(adding testplan) |
(correcting data) |
||
(9 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
<small> « [[QA/Fennec/ | <small> « [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1 ]] | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]] | [[QA/Fennec/35/Beta/4| Fennec 35 Beta 4]] »</small> | ||
= Fennec (Firefox for Android) 35 Beta | = Fennec (Firefox for Android) 35 Beta 2 (build 1) Test Plan = | ||
* Release Week: December | * Release Week: December 8th, 2014 | ||
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; | * QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; | ||
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean; | * IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean; | ||
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35. | * Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b2-candidates/build1/ Fennec (Firefox for Android) 35 Beta 2] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b1_BUILD2&tochange=FENNEC_35_0b2_BUILD1 pushlog] | ||
= Checklist = | = Checklist = | ||
Pre-release | Pre-release | ||
* Smoketests executed, including new features and Yahoo search default, with no blockers found | * {{mdone}} Smoketests executed, including new features and Yahoo search default, with no blockers found | ||
* Android permissions tested with no blockers found | * {{mdone}} Android permissions tested with no blockers found | ||
* Branch bug fix verifications completed with no blockers found | * {{mdone}} Branch bug fix verifications completed with no blockers found | ||
* L10n spotchecks completed, including br & eo locales, with no blockers found | * {{mdone}} L10n spotchecks completed, including br & eo locales, with no blockers found | ||
Post-release | Post-release | ||
Line 33: | Line 32: | ||
|} | |} | ||
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/smoketests-results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/smoketests-results|Detailed Smoketest results]] | ||
* '''Because of Bug 1106108 - MediaCodec error; only audio when playing mp4s on Aurora on particular devices''' | |||
= Android Permissions Testing = | = Android Permissions Testing = | ||
Line 47: | Line 48: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/permissions-results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/permissions-results|Detailed Android Permissions Testing Results]] | ||
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''. | <br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''. | ||
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]] | <br/>Details: [[QA/Fennec/Permissions|Android Permissions]] | ||
Line 63: | Line 64: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
* '''[Firefox for Android (35) Bugs]''' | * '''[http://goo.gl/hYTII8 Firefox for Android (35) Bugs]''' | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/BugVerification}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/BugVerification|Detailed Bug Verification]] | ||
= L10N (Localization) Spot Checks = | = L10N (Localization) Spot Checks = | ||
Line 79: | Line 80: | ||
|} | |} | ||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/L10N-builds matrix}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/L10N-builds matrix|Detailed L10N matrix]] | ||
= AppThwack Automation = | = AppThwack Automation = | ||
Line 94: | Line 95: | ||
|} | |} | ||
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities | Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/AppThwack Results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/AppThwack Results|Detailed AppThwack Results]] |