Confirmed users
7,000
edits
QA/Fennec/35/Beta/2: Difference between revisions
adding testplan
(deleting page) |
(adding testplan) |
||
| Line 1: | Line 1: | ||
<small> « [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1 ]] | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]] | [[QA/Fennec/35/Beta/4| Fennec 35 Beta 4]] »</small> | |||
= Fennec (Firefox for Android) 35 Beta 2 (build 1) Test Plan = | |||
* Release Week: December 1st, 2014 | |||
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; | |||
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean; | |||
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b2-candidates/build1/ Fennec (Firefox for Android) 35 Beta 2] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b1_RELEASE&tochange=FENNEC_35_0b2_RELEASE pushlog] | |||
= Checklist = | |||
Pre-release | |||
* Smoketests executed, including new features and Yahoo search default, with no blockers found | |||
* Android permissions tested with no blockers found | |||
* Branch bug fix verifications completed with no blockers found | |||
* L10n spotchecks completed, including br & eo locales, with no blockers found | |||
* Interim solution to ''{{bug|1100361}} unable to install on devices with 5MB LinearAlloc limit'' - addressed with [[QA/Fennec/35/Beta/1/build2|build2]] | |||
Post-release | |||
* Verify release notes | |||
* Verify updates from previous Beta (no update on Gingerbread) | |||
* Verify download from the Play store | |||
* Verify download from beta.mozilla.org | |||
= Smoketests = | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Smoketests | |||
| Softvision | |||
| Every Beta | |||
|} | |||
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | |||
{{:QA/Fennec/35/Beta/2/smoketests-results}} | |||
[[QA/Fennec/35/Beta/2/smoketests-results|Detailed Smoketest results]] | |||
= Android Permissions Testing = | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
{{:QA/Fennec/35/Beta/2/permissions-results}} | |||
[[QA/Fennec/35/Beta/2/permissions-results|Detailed Android Permissions Testing Results]] | |||
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''. | |||
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]] | |||
= Branch Bug Fix Verifications = | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Verification | |||
| Softvision | |||
| Every Beta | |||
|} | |||
* '''[Firefox for Android (35) Bugs]''' | |||
{{:QA/Fennec/35/Beta/2/BugVerification}} | |||
[[QA/Fennec/35/Beta/2/BugVerification|Detailed Bug Verification]] | |||
= L10N (Localization) Spot Checks = | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|'''How Often?''' | |||
|- | |||
| Builds Verification | |||
| SoftVision | |||
| Every Beta | |||
|} | |||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | |||
{{:QA/Fennec/35/Beta/2/L10N-builds matrix}} | |||
[[QA/Fennec/35/Beta/2/L10N-builds matrix|Detailed L10N matrix]] | |||
= AppThwack Automation = | |||
{|width=100% | |||
|- | |||
| style="background-color: #efefef;"|'''QA Task''' | |||
| style="background-color: #efefef;"|'''Person/Group''' | |||
| style="background-color: #efefef;"|''How often?'' | |||
|- | |||
| Runs against ARMv7 | |||
| Ioana | |||
| Aurora SignOff, Beta 1,4,8, RC | |||
|} | |||
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities | |||
{{:QA/Fennec/35/Beta/2/AppThwack Results}} | |||
[[QA/Fennec/35/Beta/2/AppThwack Results|Detailed AppThwack Results]] | |||