B2G/QA/Smoketest: Difference between revisions

no edit summary
(Created page with "For each branch that is 2.0 or later: 1. Run the smoketests that are not covered by automation manually (http://mzl.la/T4x9vi) 2. Spend one hour exploratory testing areas cal...")
 
No edit summary
Line 1: Line 1:
For each branch that is 2.0 or later:
For each branch that is 2.0 or later:


1. Run the smoketests that are not covered by automation manually (http://mzl.la/T4x9vi)
# Run the smoketests that are not covered by automation manually (http://mzl.la/T4x9vi)
2. Spend one hour exploratory testing areas called out by the day of the week
# Spend one hour exploratory testing areas called out by the day of the week
** Monday - Comms (e.g. Messages, Usage, Dialer, Contacts, WAP Push)
** Monday - Comms (e.g. Messages, Usage, Dialer, Contacts, WAP Push)
** Tuesday - Media (e.g. Camera, Gallery, YouTube, Music, FM Radio, Ringtones, Video, Wallpaper)
** Tuesday - Media (e.g. Camera, Gallery, YouTube, Music, FM Radio, Ringtones, Video, Wallpaper)
Line 8: Line 8:
** Thursday - Productivity (e.g. Email, Calendar, Clock)
** Thursday - Productivity (e.g. Email, Calendar, Clock)
** Friday - Misc (e.g. Bluetooth, Browse Cell Data/Wifi, FxAccounts, USB Storage, FindMyDevice, Keyboard, Settings)
** Friday - Misc (e.g. Bluetooth, Browse Cell Data/Wifi, FxAccounts, USB Storage, FindMyDevice, Keyboard, Settings)
3. Formulate a smoketest report that calls out:
# Formulate a smoketest report that calls out:
** The automated smoketest results from today's run
** The automated smoketest results from today's run
** The manual smoketest results from today's run
** The manual smoketest results from today's run
Line 14: Line 14:
For [3], an example report would be something like the following:
For [3], an example report would be something like the following:


Title: 05/30/2014 Flame 2.0 Smoke Test Results - 62/64 smoketests, 2 new blockers
  Title: 05/30/2014 Flame 2.0 Smoke Test Results - 62/64 smoketests, 2 new blockers


Test Results
  Test Results
* 40/41 automated smoketests passing
  * 40/41 automated smoketests passing
* 22/23 manual smoketests passing
  * 22/23 manual smoketests passing
* 0 reboots
  * 0 reboots
* 0 crashes
  * 0 crashes


New Bugs Breaking Manual Smoketests:
  New Bugs Breaking Manual Smoketests:
- [B2G][Dialer] Inbound call icon missing in call log  
  - [B2G][Dialer] Inbound call icon missing in call log  
https://bugzilla.mozilla.org/show_bug.cgi?id=1018474
  https://bugzilla.mozilla.org/show_bug.cgi?id=1018474
- Settings has a broken icon on the homescreen
  - Settings has a broken icon on the homescreen
https://bugzilla.mozilla.org/show_bug.cgi?id=1018183
  https://bugzilla.mozilla.org/show_bug.cgi?id=1018183
**Note: Resolved Fixed, should be fixed in tomorrow's build
  **Note: Resolved Fixed, should be fixed in tomorrow's build


Existing Bugs Breaking Manual Smoketests:
  Existing Bugs Breaking Manual Smoketests:
- None reported
  - None reported


New Bugs Breaking Automated Smoketests:
  New Bugs Breaking Automated Smoketests:
- None reported
  - None reported


Existing Bugs Breaking Automated Smoketests:
  Existing Bugs Breaking Automated Smoketests:
- [v2.0] Geolocation enabled by default in FTU app
  - [v2.0] Geolocation enabled by default in FTU app
https://bugzilla.mozilla.org/show_bug.cgi?id=1013859
  https://bugzilla.mozilla.org/show_bug.cgi?id=1013859


Build Information
  Build Information
* Build ID: 20140530040207
  * Build ID: 20140530040207
* Version: 32.0a1
  * Version: 32.0a1
* Gecko: e6f113c83095
  * Gecko: e6f113c83095
* Gaia: 26d8fcab9b61f46451600f39c51e0387ef3c4f88
  * Gaia: 26d8fcab9b61f46451600f39c51e0387ef3c4f88
* Base Image: v10G-2  
  * Base Image: v10G-2  


Links
  Links
* Daily Smoketest Logs: https://docs.google.com/a/qanalydocs.com/spreadsheet/ccc?key=0AjRc6aVFoOW9dGZLdVdiWGZLbVdORlFpUGt5XzZ3Znc&usp=drive_web#gid=0
  * Daily Smoketest Logs: https://docs.google.com/a/qanalydocs.com/spreadsheet/ccc?key=0AjRc6aVFoOW9dGZLdVdiWGZLbVdORlFpUGt5XzZ3Znc&usp=drive_web#gid=0
* MozTrap Results: https://moztrap.mozilla.org/results/cases/?filter-run=4214
  * MozTrap Results: https://moztrap.mozilla.org/results/cases/?filter-run=4214
Confirmed users
2,959

edits