|
|
| Line 1: |
Line 1: |
| <small> « [[QA/Fennec/34/RC/2| Fennec 34 RC ]] | [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1]] | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]] »</small>
| |
|
| |
|
| = Fennec (Firefox for Android) 35 Beta 1 (build 1) Test Plan =
| |
| * Release Week: December 1st, 2014
| |
| * QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes];
| |
| * IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean;
| |
| * Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b1-candidates/build1/ Fennec (Firefox for Android) 35 Beta 1] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_34_0_RELEASE&tochange=FENNEC_35_0b1_RELEASE pushlog]
| |
|
| |
| = Checklist =
| |
| Pre-release
| |
| * Smoketests executed, including new features and Yahoo search default, with no blockers found
| |
| * Android permissions tested with no blockers found
| |
| * Branch bug fix verifications completed with no blockers found
| |
| * L10n spotchecks completed, including br & eo locales, with no blockers found
| |
| * Interim solution to ''{{bug|1100361}} unable to install on devices with 5MB LinearAlloc limit'' - addressed with [[QA/Fennec/35/Beta/1/build2|build2]]
| |
|
| |
| Post-release
| |
| * Verify release notes
| |
| * Verify updates from previous Beta (no update on Gingerbread)
| |
| * Verify download from the Play store
| |
| * Verify download from beta.mozilla.org
| |
|
| |
| = Smoketests =
| |
| {|width=100%
| |
| |-
| |
| | style="background-color: #efefef;"|'''QA Task'''
| |
| | style="background-color: #efefef;"|'''Person/Group'''
| |
| | style="background-color: #efefef;"|'''How Often?'''
| |
| |-
| |
| | Smoketests
| |
| | Softvision
| |
| | Every Beta
| |
| |}
| |
| Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| |
| {{:QA/Fennec/35/Beta/3/smoketests-results}}
| |
| [[QA/Fennec/35/Beta/3/smoketests-results|Detailed Smoketest results]]
| |
|
| |
| = Android Permissions Testing =
| |
| {|width=100%
| |
| |-
| |
| | style="background-color: #efefef;"|'''QA Task'''
| |
| | style="background-color: #efefef;"|'''Person/Group'''
| |
| | style="background-color: #efefef;"|'''How Often?'''
| |
| |-
| |
| | Verification
| |
| | Softvision
| |
| | Every Beta
| |
| |}
| |
| {{:QA/Fennec/35/Beta/3/permissions-results}}
| |
| [[QA/Fennec/35/Beta/3/permissions-results|Detailed Android Permissions Testing Results]]
| |
| <br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
| |
| <br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
| |
|
| |
| = Branch Bug Fix Verifications =
| |
| {|width=100%
| |
| |-
| |
| | style="background-color: #efefef;"|'''QA Task'''
| |
| | style="background-color: #efefef;"|'''Person/Group'''
| |
| | style="background-color: #efefef;"|'''How Often?'''
| |
| |-
| |
| | Verification
| |
| | Softvision
| |
| | Every Beta
| |
| |}
| |
| * '''[Firefox for Android (35) Bugs]'''
| |
| {{:QA/Fennec/35/Beta/3/BugVerification}}
| |
| [[QA/Fennec/35/Beta/3/BugVerification|Detailed Bug Verification]]
| |
|
| |
| = L10N (Localization) Spot Checks =
| |
| {|width=100%
| |
| |-
| |
| | style="background-color: #efefef;"|'''QA Task'''
| |
| | style="background-color: #efefef;"|'''Person/Group'''
| |
| | style="background-color: #efefef;"|'''How Often?'''
| |
| |-
| |
| | Builds Verification
| |
| | SoftVision
| |
| | Every Beta
| |
| |}
| |
| Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| |
| {{:QA/Fennec/35/Beta/3/L10N-builds matrix}}
| |
| [[QA/Fennec/35/Beta/3/L10N-builds matrix|Detailed L10N matrix]]
| |
|
| |
| = AppThwack Automation =
| |
| {|width=100%
| |
| |-
| |
| | style="background-color: #efefef;"|'''QA Task'''
| |
| | style="background-color: #efefef;"|'''Person/Group'''
| |
| | style="background-color: #efefef;"|''How often?''
| |
| |-
| |
| | Runs against ARMv7
| |
| | Ioana
| |
| | Aurora SignOff, Beta 1,4,8, RC
| |
| |}
| |
| Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
| |
| {{:QA/Fennec/35/Beta/3/AppThwack Results}}
| |
| [[QA/Fennec/35/Beta/3/AppThwack Results|Detailed AppThwack Results]]
| |