QA/Fennec/35/Beta/2: Difference between revisions

correcting data
(adding testplan)
 
(correcting data)
 
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<small> « [[QA/Fennec/34/RC/2| Fennec 34 RC ]] | [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1]]  | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]]  »</small>
<small> « [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1 ]] | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]]  | [[QA/Fennec/35/Beta/4| Fennec 35 Beta 4]]  »</small>


= Fennec (Firefox for Android) 35 Beta 1 (build 1) Test Plan =
= Fennec (Firefox for Android) 35 Beta 2 (build 1) Test Plan =
* Release Week: December 1st, 2014
* Release Week: December 8th, 2014
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes];   
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes];   
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean;  
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean;  
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b1-candidates/build1/ Fennec (Firefox for Android) 35 Beta 1] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_34_0_RELEASE&tochange=FENNEC_35_0b1_RELEASE pushlog]
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b2-candidates/build1/ Fennec (Firefox for Android) 35 Beta 2] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b1_BUILD2&tochange=FENNEC_35_0b2_BUILD1 pushlog]
 
= Checklist =
= Checklist =
Pre-release
Pre-release
* Smoketests executed, including new features and Yahoo search default, with no blockers found
* {{mdone}} Smoketests executed, including new features and Yahoo search default, with no blockers found
* Android permissions tested with no blockers found
* {{mdone}} Android permissions tested with no blockers found
* Branch bug fix verifications completed with no blockers found
* {{mdone}} Branch bug fix verifications completed with no blockers found
* L10n spotchecks completed, including br & eo locales, with no blockers found
* {{mdone}} L10n spotchecks completed, including br & eo locales, with no blockers found
* Interim solution to ''{{bug|1100361}} unable to install on devices with 5MB LinearAlloc limit'' - addressed with [[QA/Fennec/35/Beta/1/build2|build2]]


Post-release
Post-release
Line 33: Line 32:
|}
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/35/Beta/3/smoketests-results}}
{{:QA/Fennec/35/Beta/2/smoketests-results}}
[[QA/Fennec/35/Beta/3/smoketests-results|Detailed Smoketest results]]
[[QA/Fennec/35/Beta/2/smoketests-results|Detailed Smoketest results]]
 
* '''Because of Bug 1106108 - MediaCodec error; only audio when playing mp4s on Aurora on particular devices'''


= Android Permissions Testing =
= Android Permissions Testing =
Line 47: Line 48:
| Every Beta
| Every Beta
|}
|}
{{:QA/Fennec/35/Beta/3/permissions-results}}
{{:QA/Fennec/35/Beta/2/permissions-results}}
[[QA/Fennec/35/Beta/3/permissions-results|Detailed Android Permissions Testing Results]]
[[QA/Fennec/35/Beta/2/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
Line 63: Line 64:
| Every Beta
| Every Beta
|}
|}
* '''[Firefox for Android (35) Bugs]'''
* '''[http://goo.gl/hYTII8 Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Beta/3/BugVerification}}
{{:QA/Fennec/35/Beta/2/BugVerification}}
[[QA/Fennec/35/Beta/3/BugVerification|Detailed Bug Verification]]
[[QA/Fennec/35/Beta/2/BugVerification|Detailed Bug Verification]]


= L10N (Localization) Spot Checks =
= L10N (Localization) Spot Checks =
Line 79: Line 80:
|}
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/35/Beta/3/L10N-builds matrix}}
{{:QA/Fennec/35/Beta/2/L10N-builds matrix}}
[[QA/Fennec/35/Beta/3/L10N-builds matrix|Detailed L10N matrix]]
[[QA/Fennec/35/Beta/2/L10N-builds matrix|Detailed L10N matrix]]


= AppThwack Automation =
= AppThwack Automation =
Line 94: Line 95:
|}
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Beta/3/AppThwack Results}}
{{:QA/Fennec/35/Beta/2/AppThwack Results}}
[[QA/Fennec/35/Beta/3/AppThwack Results|Detailed AppThwack Results]]
[[QA/Fennec/35/Beta/2/AppThwack Results|Detailed AppThwack Results]]
Confirmed users
7,000

edits