QA/Fennec/35/Aurora/SignOff: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 35‎ | Aurora
Jump to navigation Jump to search
No edit summary
 
(38 intermediate revisions by 6 users not shown)
Line 1: Line 1:
__NOTOC__
<small> [[QA/Fennec/34/Aurora/SignOff|Fennec 34]] [[QA/Fennec/35/Aurora/SignOff|Fennec 35]] [[QA/Fennec/36/Aurora/SignOff|Fennec 36]] »</small>
<small> [[QA/Fennec/34/Aurora/SignOff|Fennec 34 Aurora Sign Off]] [[QA/Fennec/35/Aurora/SignOff|Fennec 35 Aurora Sign Off]] [[QA/Fennec/36/Aurora/SignOff|Fennec 36 Aurora Sign Off]] »</small>


= Firefox for Android 35 Aurora Sign Off Test Plan =
; Checklist
* Release: Week of October 17, 2014
* {{done|}} [https://crash-stats.mozilla.com/topcrasher/products/FennecAndroid/versions/35.0a2/date_range_type/report/crash_type/browser/os_name/None/result_count/300?days=7 Top crashes] reported and assigned
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]
* {{done|}} [[QA/Fennec/35/Aurora#Features|Enabled features signed off as "ready for Aurora"]]
* IRC: irc://irc.mozilla.org#qa ping ashughes
* {{done|}} Disabled features signed off as disabled
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-aurora-android/ latest-mozilla-aurora-android]
* {{done|}} Smoketests run and bugs reported
* {{done|}} Appthwack results reviewed and bugs reported
* {{done|}} [https://www-dev.allizom.org/en-US/mobile/35.0a2/auroranotes/ Review the release notes] for accuracy and completeness
* {{done|}} If there is a permissions bump, ensure [https://wiki.mozilla.org/QA/Fennec/Permissions permissions] documentation is updated
* {{done|}} Send sign-off email


=== Features ===
; [[QA/Fennec/35/Aurora/SignOff/smoketests-results|Smoketesting]]
''See the [https://wiki.mozilla.org/Mobile/Fx35 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
 
{| class="querytable"
| class="header" | Feature
| class="header" | Owner
| class="header" | Status
| class="header" | Tests
|}
 
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run=5614 phone] and [https://moztrap.mozilla.org/results/cases/?filter-run=5616 tablet] smoketest suites. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the [https://moztrap.mozilla.org/results/cases/?filter-run=5617 BFTs].
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
[[QA/Fennec/35/Aurora/SignOff/smoketests-results|Detailed Smoketest results]]


=== BFTs and Exploratory Testing ===
; [[QA/Fennec/35/Aurora/SignOff/bft-results|Basic Functional Testing]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| BFTs
| Softvision
| Alternating
|}
Basic Functional Tests are a more comprehensive set of [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] manually covered tests that cover functional testing of features that have landed.
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
[[QA/Fennec/35/Aurora/SignOff/bft-results|Detailed BFT results]]


=== Branch Bug Fix Verifications ===
; [[QA/Fennec/35/Aurora/SignOff/BugVerification|Bug Verification]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://mzl.la/1Dd6YUR Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}
[[QA/Fennec/35/Aurora/SignOff/BugVerification|Detailed Bug Verification]]


=== AppThwack Automation ===
; [[QA/Fennec/35/Aurora/SignOff/AppThwack Results|AppThwack Automation]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv6 and ARMv7
| Aaron
| Alternating
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
[[QA/Fennec/35/Aurora/SignOff/AppThwack Results|Detailed AppThwack Results]]
{{:Mobile/Fx35}}

Latest revision as of 23:25, 17 October 2014

Fennec 34 Fennec 35 Fennec 36 »

Checklist
Smoketesting
Assigned Device Completed Results
Teodora Vermesan Nexus 7 (Android 4.4.3) 14th October, 2014 PASS
Ioana Chiorean ZTE x86 ( Android 4.0.4) October 14th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 14th, 2014 PASS


Basic Functional Testing
Assigned Device Completed Results
Ioana Chiorean Acer Iconia ( Android 3.2.1) October 16th, 2014 PASS
Flaviu Cos Nexus 4 ( Android 4.4.4) October 16th, 2014 PASS
Cristina Madaras Asus Transformer Pad TF300T ( Android 4.2.1) October 16th, 2014 PASS
Mihai Pop Samsung Galaxy Nexus ( Android 4.2.1) October 16th, 2014 PASS
Teodora Vermesan Nexus 7 ( Android 4.4.2) October 16th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 16th, 2014 PASS


Bug Verification
Assigned Device Completed Results
Cristina Madaras Asus Transformer Pad TF300T (Android 4.2.1) October 15th, 2014 DONE


AppThwack Automation
Assigned Build Completed Results
Ioana Chiorean fennec-35.0a2.multi.android-arm-armv7.apk October 15th, 2014 PASS
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/35/Aurora/SignOff&oldid=1026264"