QA/Fennec/35/Aurora/SignOff: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 35‎ | Aurora
Jump to navigation Jump to search
No edit summary
 
(34 intermediate revisions by 6 users not shown)
Line 1: Line 1:
__NOTOC__
<small> [[QA/Fennec/34/Aurora/SignOff|Fennec 34]] [[QA/Fennec/35/Aurora/SignOff|Fennec 35]] [[QA/Fennec/36/Aurora/SignOff|Fennec 36]] »</small>
<small> [[QA/Fennec/34/Aurora/SignOff|Fennec 34 Aurora Sign Off]] [[QA/Fennec/35/Aurora/SignOff|Fennec 35 Aurora Sign Off]] [[QA/Fennec/36/Aurora/SignOff|Fennec 36 Aurora Sign Off]] »</small>


= Firefox for Android 35 Aurora Sign Off Test Plan =
; Checklist
== Details ==
* {{done|}} [https://crash-stats.mozilla.com/topcrasher/products/FennecAndroid/versions/35.0a2/date_range_type/report/crash_type/browser/os_name/None/result_count/300?days=7 Top crashes] reported and assigned
* Release: Week of October 17, 2014
* {{done|}} [[QA/Fennec/35/Aurora#Features|Enabled features signed off as "ready for Aurora"]]
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]
* {{done|}} Disabled features signed off as disabled
* IRC: irc://irc.mozilla.org#qa ping ashughes
* {{done|}} Smoketests run and bugs reported
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-aurora-android/ latest-mozilla-aurora-android]
* {{done|}} Appthwack results reviewed and bugs reported
* {{done|}} [https://www-dev.allizom.org/en-US/mobile/35.0a2/auroranotes/ Review the release notes] for accuracy and completeness
* {{done|}} If there is a permissions bump, ensure [https://wiki.mozilla.org/QA/Fennec/Permissions permissions] documentation is updated
* {{done|}} Send sign-off email


== Features ==
; [[QA/Fennec/35/Aurora/SignOff/smoketests-results|Smoketesting]]
''See the [[Mobile/Roadmap#Firefox_35_.28Nightly.29|Feature Release Tracking]] wiki for a general overview of this release.''
{| class="wikitable"
! Feature
! Owner
! Status
! Tests
|-
| Accept-Language header customization UI
|
|
|
|-
| Change default search engine
|
|
|
|-
| Enable NetworkLinkService
|
|
|
|-
| HTTPS for Bing searches
|
|
|
|-
| Moz Stumbler
|
|
|
|-
| Search activity v1
|
|
|
|-
| Send tile network ping
|
|
|
|-
| Settings Improvements
|
|
|
|-
| Sync tabs panel
|
|
|
|-
| Use system download manager on Gingerbread or newer
|
|
|
|-
| Widget for searching from error pages
|
|
|
|-
|}
 
== Smoketests ==
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run=5614 phone] and [https://moztrap.mozilla.org/results/cases/?filter-run=5616 tablet] smoketest suites. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the [https://moztrap.mozilla.org/results/cases/?filter-run=5617 BFTs].
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
[[QA/Fennec/35/Aurora/SignOff/smoketests-results|Detailed Smoketest results]]


== BFTs and Exploratory Testing ==
; [[QA/Fennec/35/Aurora/SignOff/bft-results|Basic Functional Testing]]
Basic Functional Tests are a more comprehensive set of [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] manually covered tests that cover functional testing of features that have landed.
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
[[QA/Fennec/35/Aurora/SignOff/bft-results|Detailed BFT results]]


== Branch Bug Fix Verifications ==
; [[QA/Fennec/35/Aurora/SignOff/BugVerification|Bug Verification]]
Testing and verification of fixes targeted at this version of Firefox for Android. (''[[QA/Fennec/35/Aurora/SignOff/BugVerification|details]]'')
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}


== AppThwack Automation ==
; [[QA/Fennec/35/Aurora/SignOff/AppThwack Results|AppThwack Automation]]
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
[[QA/Fennec/35/Aurora/SignOff/AppThwack Results|Detailed AppThwack Results]]

Latest revision as of 23:25, 17 October 2014

Fennec 34 Fennec 35 Fennec 36 »

Checklist
Smoketesting
Assigned Device Completed Results
Teodora Vermesan Nexus 7 (Android 4.4.3) 14th October, 2014 PASS
Ioana Chiorean ZTE x86 ( Android 4.0.4) October 14th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 14th, 2014 PASS


Basic Functional Testing
Assigned Device Completed Results
Ioana Chiorean Acer Iconia ( Android 3.2.1) October 16th, 2014 PASS
Flaviu Cos Nexus 4 ( Android 4.4.4) October 16th, 2014 PASS
Cristina Madaras Asus Transformer Pad TF300T ( Android 4.2.1) October 16th, 2014 PASS
Mihai Pop Samsung Galaxy Nexus ( Android 4.2.1) October 16th, 2014 PASS
Teodora Vermesan Nexus 7 ( Android 4.4.2) October 16th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 16th, 2014 PASS


Bug Verification
Assigned Device Completed Results
Cristina Madaras Asus Transformer Pad TF300T (Android 4.2.1) October 15th, 2014 DONE


AppThwack Automation
Assigned Build Completed Results
Ioana Chiorean fennec-35.0a2.multi.android-arm-armv7.apk October 15th, 2014 PASS