QA/Fennec/35/Beta/2: Difference between revisions
Jump to navigation
Jump to search
(→Checklist: wrong details) |
(correcting data) |
||
| (7 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<small> « [[QA/Fennec/ | <small> « [[QA/Fennec/35/Beta/1| Fennec 35 Beta 1 ]] | [[QA/Fennec/35/Beta/2| Fennec 35 Beta 2]] | [[QA/Fennec/35/Beta/4| Fennec 35 Beta 4]] »</small> | ||
= Fennec (Firefox for Android) 35 Beta | = Fennec (Firefox for Android) 35 Beta 2 (build 1) Test Plan = | ||
* Release Week: December | * Release Week: December 8th, 2014 | ||
* QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; | * QA Contact: [mailto:ahughes@mozilla.com Anthony Hughes]; | ||
* IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean; | * IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean; | ||
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35. | * Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/35.0b2-candidates/build1/ Fennec (Firefox for Android) 35 Beta 2] | [http://hg.mozilla.org/releases/mozilla-beta/rev/9f0a7b24c5bd changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_35_0b1_BUILD2&tochange=FENNEC_35_0b2_BUILD1 pushlog] | ||
= Checklist = | = Checklist = | ||
Pre-release | Pre-release | ||
* Smoketests executed, including new features and Yahoo search default, with no blockers found | * {{mdone}} Smoketests executed, including new features and Yahoo search default, with no blockers found | ||
* Android permissions tested with no blockers found | * {{mdone}} Android permissions tested with no blockers found | ||
* Branch bug fix verifications completed with no blockers found | * {{mdone}} Branch bug fix verifications completed with no blockers found | ||
* L10n spotchecks completed, including br & eo locales, with no blockers found | * {{mdone}} L10n spotchecks completed, including br & eo locales, with no blockers found | ||
Post-release | Post-release | ||
| Line 33: | Line 32: | ||
|} | |} | ||
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 35.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs. | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/smoketests-results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/smoketests-results|Detailed Smoketest results]] | ||
* '''Because of Bug 1106108 - MediaCodec error; only audio when playing mp4s on Aurora on particular devices''' | |||
= Android Permissions Testing = | = Android Permissions Testing = | ||
| Line 47: | Line 48: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/permissions-results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/permissions-results|Detailed Android Permissions Testing Results]] | ||
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''. | <br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''. | ||
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]] | <br/>Details: [[QA/Fennec/Permissions|Android Permissions]] | ||
| Line 63: | Line 64: | ||
| Every Beta | | Every Beta | ||
|} | |} | ||
* '''[Firefox for Android (35) Bugs]''' | * '''[http://goo.gl/hYTII8 Firefox for Android (35) Bugs]''' | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/BugVerification}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/BugVerification|Detailed Bug Verification]] | ||
= L10N (Localization) Spot Checks = | = L10N (Localization) Spot Checks = | ||
| Line 79: | Line 80: | ||
|} | |} | ||
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations. | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/L10N-builds matrix}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/L10N-builds matrix|Detailed L10N matrix]] | ||
= AppThwack Automation = | = AppThwack Automation = | ||
| Line 94: | Line 95: | ||
|} | |} | ||
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities | Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities | ||
{{:QA/Fennec/35/Beta/ | {{:QA/Fennec/35/Beta/2/AppThwack Results}} | ||
[[QA/Fennec/35/Beta/ | [[QA/Fennec/35/Beta/2/AppThwack Results|Detailed AppThwack Results]] | ||
Latest revision as of 13:53, 15 December 2014
« Fennec 35 Beta 1 | Fennec 35 Beta 2 | Fennec 35 Beta 4 »
Fennec (Firefox for Android) 35 Beta 2 (build 1) Test Plan
- Release Week: December 8th, 2014
- QA Contact: Anthony Hughes;
- IRC: irc://irc.mozilla.org#qa ping ashughes; ioanachiorean;
- Build 1: Fennec (Firefox for Android) 35 Beta 2 | changeset | pushlog
Checklist
Pre-release
- [DONE] Smoketests executed, including new features and Yahoo search default, with no blockers found
- [DONE] Android permissions tested with no blockers found
- [DONE] Branch bug fix verifications completed with no blockers found
- [DONE] L10n spotchecks completed, including br & eo locales, with no blockers found
Post-release
- Verify release notes
- Verify updates from previous Beta (no update on Gingerbread)
- Verify download from the Play store
- Verify download from beta.mozilla.org
Smoketests
| QA Task | Person/Group | How Often? |
| Smoketests | Softvision | Every Beta |
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 35.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
| Assigned | Device | Completed | Results |
|---|---|---|---|
| Cristina Madaras | Asus Transformer Pad TF300T (Android 4.2.1) | December 12th, 2014 | PASS |
| Flaviu Cos | Nexus 4 (Android 4.4.4) | December 12th, 2014 | PASS |
| Teodora Vermesan | Samsung Galaxy Tab (Android 4.0.4) | December 12th, 2014 | PASS |
| Teodora Vermesan | ZTE x86 (Android 4.0.4) | December 12th, 2014 | PASS |
| Ioana Chiorean | Nexus 7 ( Android 5.0) | December 12th, 2014 | PASS |
| Mihai Pop | Alcatel One Touch 8008D ( Android 4.1.2) | December 12th, 2014 | PASS* |
| Catalin Suciu | Nexus 5 ( Android 5.0) | December 12th, 2014 | PASS |
- Because of Bug 1106108 - MediaCodec error; only audio when playing mp4s on Aurora on particular devices
Android Permissions Testing
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Device | Completed | Results |
|---|---|---|---|
| Teodora Vermesan | ZTE x86 (Android 4.0.4) | December 12th, 2014 | PASS |
| Cristina Madaras | Asus Transformer Pad TF300T (Android 4.2.1) | December 12th, 2014 | PASS |
| Flaviu Cos | Nexus 4 (Android 4.4.4) | December 12th, 2014 | PASS |
Detailed Android Permissions Testing Results
Verify permissions between what is currently on the store and with this beta build candidate.
Details: Android Permissions
Branch Bug Fix Verifications
| QA Task | Person/Group | How Often? |
| Verification | Softvision | Every Beta |
| Assigned | Completed | Results | |
|---|---|---|---|
| Mihai Pop | Alcatel One Touch 8008D (Android 4.1.2) | December 12th, 2014 | DONE |
L10N (Localization) Spot Checks
| QA Task | Person/Group | How Often? |
| Builds Verification | SoftVision | Every Beta |
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
| Assigned | Device | Completed | Results |
|---|---|---|---|
| Catalin Suciu | Nexus 5 (Android 5.0) | December 12th, 2014 | Done |
AppThwack Automation
| QA Task | Person/Group | How often? |
| Runs against ARMv7 | Ioana | Aurora SignOff, Beta 1,4,8, RC |
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities QA/Fennec/35/Beta/2/AppThwack Results Detailed AppThwack Results