QA/Fennec/62/RC: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
Line 33: Line 33:
|}
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on TestRail under the Milestone 59. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on TestRail under the Milestone 59. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/60/RC/smoketests-results}}
{{:QA/Fennec/62/RC/smoketests-results}}
[[QA/Fennec/60/RC/smoketests-results|Detailed Smoketest results]]
[[QA/Fennec/62/RC/smoketests-results|Detailed Smoketest results]]


== Results ==
== Results ==

Revision as of 06:57, 29 August 2018

Fennec (Firefox for Android) 62.0 (build 1) Test Plan

Checklist

Pre-release

  • {{}} Android permissions tested with no blockers found
  • [Not planned] BFTs ran, verifying all features are stable
  • {{}} Branch bug fix verifications completed with no blockers found
  • {{}} L10n spotchecks completed, with no blockers found
  • [Not planned] AppThwack automation executed with no blockers found

Post-release

  • Verify release notes
  • Verify download from the Play store
  • Verify download from beta.mozilla.org

Features

Smoketests

QA Task Person/Group How Often?
Smoketests Softvision Every Beta

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on TestRail under the Milestone 59. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned API type Device Completed Results
Oana Horvath API 16 Sony Xperia Z2 (Android 5.1.1) August 29th, 2018 PASS
Bogdan Surd API 16 Huawei MediaPad M2 (Android 5.1.1) August 29th, 2018 PASS
Deiac Stefan-Vasile API 16 OnePlus 5T (Android 8.1.0) August 29th, 2018 PASS
Lobontiu-Roman Mirabela API 16 Nexus 9 (Android 6.0.1) August 29th, 2018 PASS
Levente Sacal API 16 Google Pixel C (Android 8.0.0) August 29th, 2018 PASS
Andrei Bodea API 16 Samsung Galaxy S8+ (Android 8.0.0) August 29th, 2018 PASS
Igor Lazar API 16 Xiamomi MiPad (Android 7.0) August 29th, 2018 PASS
Deiac Stefan-Vasile x86 Xiaomi Mi Pad 2 (Android 5.1) August 29th, 2018 PASS

Detailed Smoketest results

Results

SmokeTests detailed results

Issues

  • New
  • New to this Release
  • Important issues:
  • Known Issues:


Example Bug: **{{Bug|1305969}} - Fennec sometimes get stuck in a state where there is a perma-bar of white on the bottom of the screen

Android Permissions Testing

QA Task Person/Group How Often?
Verification Softvision Every Beta

Detailed Android Permissions Testing Results
Verify permissions between what is currently on the store and with this beta build candidate.
Details: Android Permissions

Branch Bug Fix Verifications

QA Task Person/Group How Often?
Verification Softvision Every Beta

Detailed Bug Verification

L10N (Localization) Spot Checks

QA Task Person/Group How Often?
Builds Verification SoftVision Every Beta

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Detailed L10N matrix