QA/Fennec/Milestones/5.0: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones
Jump to navigation Jump to search
 
(13 intermediate revisions by one other user not shown)
Line 3: Line 3:
== Overview ==
== Overview ==


[[QA/Fennec/TestStrategy| Fennec Test Strategy]]
The goal of this Overall Test Plan is to lay out testing strategy, results, and tracking for each milestone as it crosses through each channel of the Firefox development process.
 
The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status of this milestone as it crosses through each channel of the Firefox development process.


All of our releases are tested off of the "Fennec 5.0 Catch-All Test Run" on the [http://litmus.mozilla.org/ Litmus TCM].
All of our releases are tested off of the "Fennec 5.0 Catch-All Test Run" on the [http://litmus.mozilla.org/ Litmus TCM].
Line 14: Line 12:


* [https://bugzilla.mozilla.org/buglist.cgi?list_id=247247&field0-0-0=cf_blocking_fennec&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&bug_status=VERIFIED&type0-0-0=substring&value0-0-0=%2B&target_milestone=Firefox%205&target_milestone=mozilla5 Bugs FIXED]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=247247&field0-0-0=cf_blocking_fennec&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&bug_status=VERIFIED&type0-0-0=substring&value0-0-0=%2B&target_milestone=Firefox%205&target_milestone=mozilla5 Bugs FIXED]
== Test Plans and Results ==
{|width=100%
|-
|style="background-color: #efefef;"|Channel
|style="background-color: #efefef;"|Start Date
|-
| [[QA/Fennec/Milestones/5.0a1|Nightly]]
| 4/11
|-
| [[QA/Fennec/Milestones/5.0a2|Aurora]]
| 4/11
|-
| [[QA/Fennec/Milestones/5.0b1|Beta]]
| 5/17
|}


== General Responsibilities ==
== General Responsibilities ==
Line 38: Line 18:
{|width=100%
{|width=100%
|-
|-
|style="background-color: #efefef;"|'''Channel'''
|style="background-color: #efefef;"|'''Test Plan and Results'''
|style="background-color: #efefef;"|'''Start Date'''
|style="background-color: #efefef;"|'''Start Date'''
|-
|-
| [[QA/Fennec/Milestones/5.0a1|Nightly]]
| style="background-color: #FEF1B5;"|[[QA/Fennec/Milestones/5.0a1|Nightly]]
| 4/11
| style="background-color: #FEF1B5;"|---
|}
|}


Line 64: Line 44:
|-
|-
| Bug Verification
| Bug Verification
| Waverley
| nhirata/Andreea
| As-needed
| Daily
|-
|-
| Crash Reporting
| Crasher Triage
| mw22
| mw22
| Daily
| Daily
Line 83: Line 63:
{|width=100%
{|width=100%
|-
|-
|style="background-color: #efefef;"|'''Channel'''
|style="background-color: #efefef;"|'''Test Plan and Results'''
|style="background-color: #efefef;"|'''Start Date'''
|style="background-color: #efefef;"|'''Start Date'''
|-
|-
| [[QA/Fennec/Milestones/5.0a2|Aurora]]
| style="background-color: #FEF1B5;"|[[QA/Fennec/Milestones/5.0a2|Aurora]]
| 4/11
| style="background-color: #FEF1B5;"|4/11
|}
|}


Line 101: Line 81:
|-
|-
| Bug Verification
| Bug Verification
| Waverley
| nhirata/Andreea
| As-needed
| As-needed
|}
|}
Line 108: Line 88:
{|width=100%
{|width=100%
|-
|-
|style="background-color: #efefef;"|'''Channel'''
|style="background-color: #efefef;"|'''Test Plan and Results'''
|style="background-color: #efefef;"|'''Start Date'''
|style="background-color: #efefef;"|'''Start Date'''


|-
|-
| [[QA/Fennec/Milestones/6.0b1|Beta]]
| style="background-color: #FEF1B5;"|[[QA/Fennec/Milestones/5.0b1|Beta]]
| 5/17
| style="background-color: #FEF1B5;"|5/17
|}
|}


Line 124: Line 104:
| Smoketests
| Smoketests
| Waverley
| Waverley
| Once a build
| Once
|-
| Crasher Triage
| mw22
| Daily
|-
|-
| L10n Tier 1 Locale Check
| L10n Tier 1 Locale Check
| nhirata
| nhirata
| Once a build
| Once
|-
| Crash Reporting
| mw22
| Daily
|-
|-
| Device Compatibility
| Device Compatibility
Line 145: Line 125:
| kbrosnan
| kbrosnan
| Once
| Once
|}
== Features Tracked ==
{| class="fullwidth-table sortable" style="width:100%;"
|-
| style="font-weight: bold; background: #DDD;" | Feature
| style="font-weight: bold; background: #DDD;" | Status
| style="font-weight: bold; background: #DDD;" | Owner
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=607417 Optimized layout and interaction with some mobile web pages (improved position:fixed support)]
| landed
SDR: N &#124;&#124; SIR: N
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=646550 Add images downloaded in Firefox to the Android Gallery immediately (before: images were visible only after reboot]
| landed
SDR: N &#124;&#124; SIR: <span style="font-weight: bold;">C</span> - 04/27
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=610784 Add a "More" button to the Android Menu when needed)]
| landed
SDR: N &#124;&#124; SIR: N
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=641014 Fix issue with color conversion for better display of images and video (Fix broken NEON Y'CbCr to RGB conversion)]
| landed
SDR: N &#124;&#124; '''SIR: P&nbsp;'''
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=648268 Resolves recent breakage that would show an "undefined" error when trying to load web pages while outside of wifi or network coverave (Add remoteXUL strings for Firefox Mobile)]
| landed
SDR: N &#124;&#124; SIR: N
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=561694 Slight improvement of page load speed, especially on 3G network (e10s HTTP: Implement nsIProgressEventSink:part2)]
| landed
SDR: N &#124;&#124; SIR: N
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=648654 Add user-visible pref for Do Not Track]
SDR: N &#124;&#124; SIR: N
QA: Verified/Tests Created
| landed
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=618989 Finish new theme styles for dialogs/prompts (prompts and confirms look like android dialogs)]
| landed
SDR: N &#124;&#124; '''SIR: C''' - 04-27
QA: Verified
| Thomas
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=639179 Smooth panning (resolves an issue where consecutive pans were a bit jumpy before)]
| landed
SDR: N &#124;&#124; SIR: N
QA: Verified
| Thomas
|}
|}

Latest revision as of 22:59, 17 May 2011

« Mobile

Overview

The goal of this Overall Test Plan is to lay out testing strategy, results, and tracking for each milestone as it crosses through each channel of the Firefox development process.

All of our releases are tested off of the "Fennec 5.0 Catch-All Test Run" on the Litmus TCM.

For more information about Fennec 5.0, take a look at the mobile team's Feature Planning page

Bugs in Release

General Responsibilities

Nightly

Test Plan and Results Start Date
Nightly ---
QA Task Person/Group How Often?
Smoketests Waverley Daily
BFTs Waverley/Feature QA Weekly
OS Integration Waverley Weekly
Bug Verification nhirata/Andreea Daily
Crasher Triage mw22 Daily
Bug Triage MoCo team Weekly
Testday kbrosnan Once

Aurora

Test Plan and Results Start Date
Aurora 4/11
QA Task Person/Group How Often?
Smoketests Waverley/Feature QA Weekly
Bug Verification nhirata/Andreea As-needed

Beta

Test Plan and Results Start Date
Beta 5/17
QA Task Person/Group How Often?
Smoketests Waverley Once
Crasher Triage mw22 Daily
L10n Tier 1 Locale Check nhirata Once
Device Compatibility AaronMT Once
Website Compatibility AaronMT Once
Testday kbrosnan Once

Features Tracked

Feature Status Owner
Optimized layout and interaction with some mobile web pages (improved position:fixed support) landed

SDR: N || SIR: N QA: Verified

Thomas
Add images downloaded in Firefox to the Android Gallery immediately (before: images were visible only after reboot landed

SDR: N || SIR: C - 04/27 QA: Verified

Thomas
Add a "More" button to the Android Menu when needed) landed

SDR: N || SIR: N QA: Verified

Thomas
Fix issue with color conversion for better display of images and video (Fix broken NEON Y'CbCr to RGB conversion) landed

SDR: N || SIR: P  QA: Verified

Thomas
Resolves recent breakage that would show an "undefined" error when trying to load web pages while outside of wifi or network coverave (Add remoteXUL strings for Firefox Mobile) landed

SDR: N || SIR: N QA: Verified

Thomas
Slight improvement of page load speed, especially on 3G network (e10s HTTP: Implement nsIProgressEventSink:part2) landed

SDR: N || SIR: N QA: Verified

Thomas
Add user-visible pref for Do Not Track

SDR: N || SIR: N QA: Verified/Tests Created

landed Thomas
Finish new theme styles for dialogs/prompts (prompts and confirms look like android dialogs) landed

SDR: N || SIR: C - 04-27 QA: Verified

Thomas
Smooth panning (resolves an issue where consecutive pans were a bit jumpy before) landed

SDR: N || SIR: N QA: Verified

Thomas