QA/Fennec/35/Beta/2: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 35‎ | Beta
Jump to navigation Jump to search
(→‎Checklist: wrong details)
(deleting page)
Line 1: Line 1:
<small> « [[QA/Fennec/34/RC/2| Fennec 34 RC ]] | [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1]]  | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]]  »</small>


= Fennec (Firefox for Android) 35 Beta 1 (build 1) Test Plan =
* Release Week: December 1st, 2014
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; 
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean;
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b1-candidates/build1/ Fennec (Firefox for Android) 35 Beta 1] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_34_0_RELEASE&tochange=FENNEC_35_0b1_RELEASE pushlog]
= Checklist =
Pre-release
* Smoketests executed, including new features and Yahoo search default, with no blockers found
* Android permissions tested with no blockers found
* Branch bug fix verifications completed with no blockers found
* L10n spotchecks completed, including br & eo locales, with no blockers found
* Interim solution to ''{{bug|1100361}} unable to install on devices with 5MB LinearAlloc limit'' - addressed with [[QA/Fennec/35/Beta/1/build2|build2]]
Post-release
* Verify release notes
* Verify updates from previous Beta (no update on Gingerbread)
* Verify download from the Play store
* Verify download from beta.mozilla.org
= Smoketests =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/35/Beta/3/smoketests-results}}
[[QA/Fennec/35/Beta/3/smoketests-results|Detailed Smoketest results]]
= Android Permissions Testing =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
{{:QA/Fennec/35/Beta/3/permissions-results}}
[[QA/Fennec/35/Beta/3/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
= Branch Bug Fix Verifications =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Beta/3/BugVerification}}
[[QA/Fennec/35/Beta/3/BugVerification|Detailed Bug Verification]]
= L10N (Localization) Spot Checks =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Builds Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/35/Beta/3/L10N-builds matrix}}
[[QA/Fennec/35/Beta/3/L10N-builds matrix|Detailed L10N matrix]]
= AppThwack Automation =
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv7
| Ioana
| Aurora SignOff, Beta 1,4,8, RC
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Beta/3/AppThwack Results}}
[[QA/Fennec/35/Beta/3/AppThwack Results|Detailed AppThwack Results]]

Revision as of 15:48, 11 December 2014