QA/Fennec/35/Aurora/SignOff: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 35‎ | Aurora
Jump to navigation Jump to search
Line 3: Line 3:


= Firefox for Android 35 Aurora Sign Off Test Plan =
= Firefox for Android 35 Aurora Sign Off Test Plan =
== Details ==
* Release: Week of October 17, 2014
* Release: Week of October 17, 2014
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]
Line 8: Line 9:
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-aurora-android/ latest-mozilla-aurora-android]
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-aurora-android/ latest-mozilla-aurora-android]


== Testing ==
=== Features ===
=== Features ===
''See the [https://wiki.mozilla.org/Mobile/Fx35 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
''See the [[Mobile/Roadmap#Firefox_35_.28Nightly.29|Feature Release Tracking]] wiki for a general overview of this release.''
 
{| class="wikitable"
{| class="querytable"
! Feature
  | class="header" | Feature
! Owner
  | class="header" | Owner
! Status
  | class="header" | Status
! Tests
  | class="header" | Tests
|-
  | Accept-Language header customization UI
|
|
|
|-
| Change default search engine
|
|
|
|-
| Enable NetworkLinkService
|
|
|
|-
| HTTPS for Bing searches
|
|
|
|-
| Moz Stumbler
|
|
|
|-
| Search activity v1
|
|
|
|-
| Send tile network ping
|
|
|
|-
| Settings Improvements
|
|
|
|-
| Sync tabs panel
|
|
|
|-
| Use system download manager on Gingerbread or newer
|
|
|
  |-
| Widget for searching from error pages
  |
|
  |
|-
  |}
  |}


=== Smoketests ===
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run=5614 phone] and [https://moztrap.mozilla.org/results/cases/?filter-run=5616 tablet] smoketest suites. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the [https://moztrap.mozilla.org/results/cases/?filter-run=5617 BFTs].
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run=5614 phone] and [https://moztrap.mozilla.org/results/cases/?filter-run=5616 tablet] smoketest suites. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the [https://moztrap.mozilla.org/results/cases/?filter-run=5617 BFTs].
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
{{:QA/Fennec/35/Aurora/SignOff/smoketests-results}}
Line 34: Line 81:


=== BFTs and Exploratory Testing ===
=== BFTs and Exploratory Testing ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| BFTs
| Softvision
| Alternating
|}
Basic Functional Tests are a more comprehensive set of [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] manually covered tests that cover functional testing of features that have landed.
Basic Functional Tests are a more comprehensive set of [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] manually covered tests that cover functional testing of features that have landed.
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
{{:QA/Fennec/35/Aurora/SignOff/bft-results}}
Line 49: Line 86:


=== Branch Bug Fix Verifications ===
=== Branch Bug Fix Verifications ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://mzl.la/1Dd6YUR Firefox for Android (35) Bugs]'''
* '''[http://mzl.la/1Dd6YUR Firefox for Android (35) Bugs]'''
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}
{{:QA/Fennec/35/Aurora/SignOff/BugVerification}}
Line 64: Line 91:


=== AppThwack Automation ===
=== AppThwack Automation ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv6 and ARMv7
| Aaron
| Alternating
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
{{:QA/Fennec/35/Aurora/SignOff/AppThwack Results}}
[[QA/Fennec/35/Aurora/SignOff/AppThwack Results|Detailed AppThwack Results]]
[[QA/Fennec/35/Aurora/SignOff/AppThwack Results|Detailed AppThwack Results]]
{{:Mobile/Fx35}}

Revision as of 20:42, 15 October 2014

Fennec 34 Aurora Sign Off Fennec 35 Aurora Sign Off Fennec 36 Aurora Sign Off »

Firefox for Android 35 Aurora Sign Off Test Plan

Details

Testing

Features

See the Feature Release Tracking wiki for a general overview of this release.

Feature Owner Status Tests
Accept-Language header customization UI
Change default search engine
Enable NetworkLinkService
HTTPS for Bing searches
Moz Stumbler
Search activity v1
Send tile network ping
Settings Improvements
Sync tabs panel
Use system download manager on Gingerbread or newer
Widget for searching from error pages

Smoketests

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the phone and tablet smoketest suites. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned Device Completed Results
Teodora Vermesan Nexus 7 (Android 4.4.3) 14th October, 2014 PASS
Ioana Chiorean ZTE x86 ( Android 4.0.4) October 14th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 14th, 2014 PASS

Detailed Smoketest results

BFTs and Exploratory Testing

Basic Functional Tests are a more comprehensive set of Mozilla Moztrap manually covered tests that cover functional testing of features that have landed.

Assigned Device Completed Results
Ioana Chiorean Acer Iconia ( Android 3.2.1) October 16th, 2014 PASS
Flaviu Cos Nexus 4 ( Android 4.4.4) October 16th, 2014 PASS
Cristina Madaras Asus Transformer Pad TF300T ( Android 4.2.1) October 16th, 2014 PASS
Mihai Pop Samsung Galaxy Nexus ( Android 4.2.1) October 16th, 2014 PASS
Teodora Vermesan Nexus 7 ( Android 4.4.2) October 16th, 2014 PASS
Catalin Suciu Samsung Galaxy Note 3 ( Android 4.4.2) October 16th, 2014 PASS

Detailed BFT results

Branch Bug Fix Verifications

Assigned Device Completed Results
Cristina Madaras Asus Transformer Pad TF300T (Android 4.2.1) October 15th, 2014 DONE

Detailed Bug Verification

AppThwack Automation

Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities

Assigned Build Completed Results
Ioana Chiorean fennec-35.0a2.multi.android-arm-armv7.apk October 15th, 2014 PASS

Detailed AppThwack Results

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/35/Aurora/SignOff&oldid=1025619"