Confirmed users
2,959
edits
(Created page with "For each branch that is 2.0 or later: 1. Run the smoketests that are not covered by automation manually (http://mzl.la/T4x9vi) 2. Spend one hour exploratory testing areas cal...") |
No edit summary |
||
Line 1: | Line 1: | ||
For each branch that is 2.0 or later: | For each branch that is 2.0 or later: | ||
# Run the smoketests that are not covered by automation manually (http://mzl.la/T4x9vi) | |||
# Spend one hour exploratory testing areas called out by the day of the week | |||
** Monday - Comms (e.g. Messages, Usage, Dialer, Contacts, WAP Push) | ** Monday - Comms (e.g. Messages, Usage, Dialer, Contacts, WAP Push) | ||
** Tuesday - Media (e.g. Camera, Gallery, YouTube, Music, FM Radio, Ringtones, Video, Wallpaper) | ** Tuesday - Media (e.g. Camera, Gallery, YouTube, Music, FM Radio, Ringtones, Video, Wallpaper) | ||
Line 8: | Line 8: | ||
** Thursday - Productivity (e.g. Email, Calendar, Clock) | ** Thursday - Productivity (e.g. Email, Calendar, Clock) | ||
** Friday - Misc (e.g. Bluetooth, Browse Cell Data/Wifi, FxAccounts, USB Storage, FindMyDevice, Keyboard, Settings) | ** Friday - Misc (e.g. Bluetooth, Browse Cell Data/Wifi, FxAccounts, USB Storage, FindMyDevice, Keyboard, Settings) | ||
# Formulate a smoketest report that calls out: | |||
** The automated smoketest results from today's run | ** The automated smoketest results from today's run | ||
** The manual smoketest results from today's run | ** The manual smoketest results from today's run | ||
Line 14: | Line 14: | ||
For [3], an example report would be something like the following: | For [3], an example report would be something like the following: | ||
Title: 05/30/2014 Flame 2.0 Smoke Test Results - 62/64 smoketests, 2 new blockers | Title: 05/30/2014 Flame 2.0 Smoke Test Results - 62/64 smoketests, 2 new blockers | ||
Test Results | Test Results | ||
* 40/41 automated smoketests passing | * 40/41 automated smoketests passing | ||
* 22/23 manual smoketests passing | * 22/23 manual smoketests passing | ||
* 0 reboots | * 0 reboots | ||
* 0 crashes | * 0 crashes | ||
New Bugs Breaking Manual Smoketests: | New Bugs Breaking Manual Smoketests: | ||
- [B2G][Dialer] Inbound call icon missing in call log | - [B2G][Dialer] Inbound call icon missing in call log | ||
https://bugzilla.mozilla.org/show_bug.cgi?id=1018474 | https://bugzilla.mozilla.org/show_bug.cgi?id=1018474 | ||
- Settings has a broken icon on the homescreen | - Settings has a broken icon on the homescreen | ||
https://bugzilla.mozilla.org/show_bug.cgi?id=1018183 | https://bugzilla.mozilla.org/show_bug.cgi?id=1018183 | ||
**Note: Resolved Fixed, should be fixed in tomorrow's build | **Note: Resolved Fixed, should be fixed in tomorrow's build | ||
Existing Bugs Breaking Manual Smoketests: | Existing Bugs Breaking Manual Smoketests: | ||
- None reported | - None reported | ||
New Bugs Breaking Automated Smoketests: | New Bugs Breaking Automated Smoketests: | ||
- None reported | - None reported | ||
Existing Bugs Breaking Automated Smoketests: | Existing Bugs Breaking Automated Smoketests: | ||
- [v2.0] Geolocation enabled by default in FTU app | - [v2.0] Geolocation enabled by default in FTU app | ||
https://bugzilla.mozilla.org/show_bug.cgi?id=1013859 | https://bugzilla.mozilla.org/show_bug.cgi?id=1013859 | ||
Build Information | Build Information | ||
* Build ID: 20140530040207 | * Build ID: 20140530040207 | ||
* Version: 32.0a1 | * Version: 32.0a1 | ||
* Gecko: e6f113c83095 | * Gecko: e6f113c83095 | ||
* Gaia: 26d8fcab9b61f46451600f39c51e0387ef3c4f88 | * Gaia: 26d8fcab9b61f46451600f39c51e0387ef3c4f88 | ||
* Base Image: v10G-2 | * Base Image: v10G-2 | ||
Links | Links | ||
* Daily Smoketest Logs: https://docs.google.com/a/qanalydocs.com/spreadsheet/ccc?key=0AjRc6aVFoOW9dGZLdVdiWGZLbVdORlFpUGt5XzZ3Znc&usp=drive_web#gid=0 | * Daily Smoketest Logs: https://docs.google.com/a/qanalydocs.com/spreadsheet/ccc?key=0AjRc6aVFoOW9dGZLdVdiWGZLbVdORlFpUGt5XzZ3Znc&usp=drive_web#gid=0 | ||
* MozTrap Results: https://moztrap.mozilla.org/results/cases/?filter-run=4214 | * MozTrap Results: https://moztrap.mozilla.org/results/cases/?filter-run=4214 |