QA/Fennec/8: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
(Created page with "<small>« Fennec:fx6 | Fennec:fx7 | Fennec:fx8 » </small> <small>« Mobile</small> == Ov...")
 
No edit summary
 
(4 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<small>[[QA/Fennec/Milestones/6.0|« Fennec:fx6]] | [[QA/Fennec/7|Fennec:fx7]] | [[QA/Fennec/Milestones/8|Fennec:fx8 »]] </small>
<small>[[QA/Fennec/7|« Fennec:fx7]] | [[QA/Fennec/8|Fennec:fx8]] | [[QA/Fennec/9|Fennec:fx9 »]] </small>
 
<small>[[Mobile|&laquo; Mobile]]</small>
<small>[[Mobile|&laquo; Mobile]]</small>


Line 15: Line 16:


== General Responsibilities ==
== General Responsibilities ==
=== Nightly ===
=== Nightly ===


{|width=100%
{| width="100%"
|-
|-
|style="background-color: #efefef;"|'''Test Plan and Results'''
| style="background-color: #efefef;" | '''Test Plan and Results'''  
|style="background-color: #efefef;"|'''Start Date'''
| style="background-color: #efefef;" | '''Start Date'''
|-
|-
| [[QA/Fennec/8/Nightly|Nightly]]
| [[QA/Fennec/8/Nightly|Nightly]]  
| ?/?
| &nbsp;07/05/2011
|}
|}


{|width=100%
{| width="100%"
|-
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;" | '''QA Task'''  
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;" | '''Person/Group'''  
| style="background-color: #efefef;"|'''How Often?'''
| style="background-color: #efefef;" | '''How Often?'''
|-
|-
| Smoketests
| Smoketests  
| Waverley
| Waverley  
| Daily
| Daily
|-  
|-
| BFTs
| BFTs  
| Waverley/Feature QA
| Waverley/Feature QA  
| Weekly
| Weekly
|-
|-
| OS Integration
| OS Integration  
| Waverley
| Waverley  
| Weekly
| Weekly
|-
|-
| Bug Verification
| Bug Verification  
| Waverley
| Waverley  
| As-needed
| As-needed
|-
|-
| Crash Reporting
| Crash Reporting  
| mw22 / nhirata
| mw22 / nhirata  
| Daily
| Daily
|-
|-
| Bug Triage
| Bug Triage  
| MoCo team
| MoCo team  
| Weekly
| Weekly
|-
|-
| Testday
| Testday  
| kbrosnan
| kbrosnan  
| Once
| Once
|}
|}


=== Aurora ===
=== Aurora ===
{|width=100%
 
{| width="100%"
|-
|-
|style="background-color: #efefef;"|'''Test Plan and Results'''
| style="background-color: #efefef;" | '''Test Plan and Results'''  
|style="background-color: #efefef;"|'''Start Date'''
| style="background-color: #efefef;" | '''Start Date'''
|-
|-
| [[QA/Fennec/8/Aurora|Aurora]]
| [[QA/Fennec/8/Aurora|Aurora]]  
| ?/?
| &nbsp;08/16/2011
|}
|}


{|width=100%
{| width="100%"
|-
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;" | '''QA Task'''  
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;" | '''Person/Group'''  
| style="background-color: #efefef;"|'''How Often?'''
| style="background-color: #efefef;" | '''How Often?'''
|-  
|-
| Smoketests
| Smoketests  
| Waverley/Feature QA
| Waverley/Feature QA  
| Weekly
| Weekly
|-
|-
| Bug Verification
| Bug Verification  
| Waverley
| Waverley  
| As-needed
| As-needed
|}
|}


=== Beta ===
=== Beta ===
{|width=100%
 
{| width="100%"
|-
|-
|style="background-color: #efefef;"|'''Test Plan and Results'''
| style="background-color: #efefef;" | '''Test Plan and Results'''  
|style="background-color: #efefef;"|'''Start Date'''
| style="background-color: #efefef;" | '''Start Date'''
 
|-
|-
| [[QA/Fennec/8/Beta|Beta]]
| [[QA/Fennec/8/Beta|Beta]]  
| ?/?
| &nbsp;09/27/2011
|}
|}


{|width=100%
{| width="100%"
|-
|-
| style="background-color: #efefef;"|'''QA Task'''  
| style="background-color: #efefef;" | '''QA Task'''  
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;" | '''Person/Group'''  
| style="background-color: #efefef;"|'''How Often?'''
| style="background-color: #efefef;" | '''How Often?'''
|-
|-
| Smoketests
| Smoketests  
| Waverley
| Waverley  
| Once
| Once
|-
|-
| Crash Reporting
| Crash Reporting  
| mw22
| mw22  
| Daily
| Daily
|-
|-
| L10n Tier 1 Locale Check
| L10n Tier 1 Locale Check  
| nhirata
| nhirata  
| Once
| Once
|-
|-
| Device Compatibility
| Device Compatibility  
| AaronMT
| AaronMT  
| Once
| Once
|-
|-
| Website Compatibility
| Website Compatibility  
| AaronMT
| AaronMT  
| Once
| Once
|-
|-
| Testday
| Testday  
| kbrosnan
| kbrosnan  
| Once
| Once
|}
|}


== Features Tracked ==
== Features Tracked ==
<table class="querytable sortable">
<tr>
<td class="header" style="width: 20%;">Feature</td>
<td class="header" style="width: 10%;">Stage</td>
<td class="header" style="width: 35%;">Status note</td>
<td class="header" style="width: 10%;">Health</td>
<td class="header" style="width: 15%;">Feature manager</td>
</tr>
{{#ask: [[Category:Feature Page]] [[Feature list::Mobile]] [[Feature version::Firefox 8]]
| ?#
| ?Feature name#
| ?Feature stage#
| ?Feature status note#
| ?Feature health#
| ?Feature feature manager#
| mainlabel=-
| sort=Feature stage
| format=template
| template=ReleaseTrackingTable
}}
</table>
== 8/8+ Bug List ==
New Features in Fennec 8.0/8.0+:
[https://bugzilla.mozilla.org/buglist.cgi?list_id=833093&field0-0-0=cf_blocking_fennec&classification=Client%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&type0-0-0=substring&value0-0-0=8&product=Fennec Bug list]
* Faster Startup
** {{Bug|622908}} - meta: Fastest possible fennec startup
** {{Bug|674345}} New: Only load the one necessary locale
* [https://wiki.mozilla.org/Fennec/Features/TabletUI TabletUI]
** Bug 655762 - [meta] Modify the Fennec UI for Android tablets
*** ("browser.ui.layout.tablet" = -1)
** need to check with UX on design status
** [https://wiki.mozilla.org/Fennec/Features/visualrefresh Visual Refresh]
** {{Bug|653136}} - Create Fennec Honeycomb theme
** {{Bug|655762}} - [meta] Modify the Fennec UI for Android tablets
** {{Bug|656329}} - Use a Honeycomb-style action bar on Android tablets
** {{Bug|672675}} - Remove right sidebar
* [https://wiki.mozilla.org/Features/Mobile/webapps Web App]
** {{Bug|584767}} - webapps frontend
** {{Bug|596649}} Check if a web app is installed to not install dupes
** {{Bug|596650}} - Use the "sizes" attribute to select the best web app icon
** {{Bug|663571}} - OS agnostic webapps backend
** {{Bug|667530}} - Add ability to add application/bookmark shortcuts to Launcher screens
** {{Bug|669352}} - Need an about:webapps page
** {{Bug|670677}} - Notify user of successfully installed web app
** {{Bug|609043}} Add support for Open Web Apps
* Master Password
** https://addons.mozilla.org/en-US/mobile/addon/master-password-270907/
** {{Bug|592772}} Fennec should offer to use master password
* Mobile friendly error pages
**{{Bug|582048}} Make network error pages mobile friendly
**{{Bug|482874}} Provide a friendlier/more useful alternative when the user encounters a 404 error page.
* Telemetry
**{{Bug|671454}} New: Implement telemetry ui on mobile
* Upstream Helper Apps add-on
** {{Bug|653833}} - Upstream Helper Apps add-on for spawning to Android helper apps from Fennec
* Network connection type exposed
** {{Bug|667980}} - Expose network connection type to chrome
* [https://wiki.mozilla.org/Fennec/Features/video Video Playback]
** {{bug|612799}} Remote Audio - Signal errors to the child AudioStream.
** {{Bug|599089}} - Remote audio
* Web Vibrator
** {{Bug|679966}} WebVibrator
<br>
Misc Bug fixes
* Others:
** [https://bugzilla.mozilla.org/show_bug.cgi?id=459117 Make Fennec Faster]
** Power Management:
*** {{Bug|446418}} - [meta] Investigate power management issues
*** {{Bug|673352}} webgl demo keeps playing when returning to android menu (sucking battery power)
*** {{Bug|608440}} Battery lifetime is decreased with Fennec due to background tabs
**{{Bug|564667}} - Allow bootstrapped add-ons to have chrome
**{{Bug|454880}} Allow access to recent history through back/forward buttons
**{{Bug|662936}} fennec silently fails while running talos
*** azakai is working on a better stack traces with a custom-compiled libc
**{{Bug|616348}} [meta] Web compatibility for Mobile Firefox (Fennec)
**{{Bug|636042}} - When two fonts with the same name but different available characters exist we should be able to use characters from either one
**{{Bug|672304}} Dom Inspector does not work for Fennec anymore
**{{Bug|564667}} Allow bootstrapped add-ons to have chrome
**{{Bug|670056}} no context menu in http auth dialog
**{{Bug|634997}} - no synthetic bolding on Android
**{{Bug|669407}} - Reduce disk space requirements for Safe Browsing
<br>
* Sync
**{{Bug|664792}} - Tune sync intervals according to user behaviour
<br>
Gfx:
* {{Bug|607684}} [OGL] OpenGL on mobile
* {{Bug|619615}} - [OGL] Accelerated layers hangs Fennec and results in a phone reboot on Nexus 1
* {{Bug|621745}} - [OGL] Duplicate urlbar flickers at bottom of awesomescreen when keyboard appears (Android + GL)
*{{Bug|670930}} - Texture updates happen synchronously and harm interactive performance
<br>
VKB:
* {{Bug|672661}} Backspace key in Swiftkey X causes characters to be duplicated
* {{Bug|617298}} Text input causes SwiftKey keyboard to force close
* {{Bug|664364}} - Entering newline after Japanese in a textarea doesn't change cursor position
<br>
Core:
* Networking
* {{Bug|447866}} - http pipelining is bursty
* {{Bug|665532}} - Fix unused variable warnings in nsWifiScanner*.cpp
* Memory:
** {{Bug|682326}}
**{{Bug|671352}} - Split chrome into multiple compartments for better accounting of JS memory used by chrome code (and add-ons)
**{{Bug|669346}} Don't force a second GC on memory pressure
**{{Bug|666713}} - Dynamic analysis of chrome->content operations in Firefox
**{{Bug|640791}} - (mtools-fx5+) [meta] improve memory tools for Firefox 5+
**{Bug|640457}} - (mslim-fx5+) [meta] memory size reductions for Firefox 5+
** {{Bug|671971}} - Look into reducing max % of memory cache consumed by any one object
** {{Bug|672443}} - [Jetpack] Too many compartments! 
<br>
Crash Reporter:
*{{Bug|672287}} - Get symbols for libc for most common Android installs
*{{Bug|668210}} - Write an extension to gather Breakpad symbols from system libraries
*{{Bug|664510}} - Get valid crashreporter reports again
== 7 Follow up Bug List ==
* Camera Support
**{{Bug|659188}} - Camera support for Android
**{{Bug|671356}} - Add Camera Feature Request to Android
* Selecting text in web content followup bugs
* Language picker support for locales on AMO
**{{Bug|666973}} Don't show localepicker if system locale is available
**{{Bug|669154}} Empty button briefly visible during startup from locale picker
* VKB:
** {{Bug|673291}} - Show the keyboard with a magnifying glass instead of GO when in a search field
== 6 Follow up Bug List ==
* Accelerometer: (landed in 6)
** {{Bug|667919}} - window.ondevicemotion and window.ondeviceorientation
** {{Bug|673922}} - API to block orientationchange
** {{Bug|557642}} - An option should be added to disable auto-rotation
** {{Bug|615940}} Using Device Orientation events starts an immortal rapid timer
** {{Bug|603336}} - e10s & MozOrientation: Infinite page loading
** {{Bug|615597}} - Implement the W3C DeviceOrientation Event Specification
** {{Bug|662678}} - w3c device orientation spec changes
** {{Bug|673472}} - Segfault when using acceleration event handler that calls console.log

Latest revision as of 07:41, 28 September 2011

« Fennec:fx7 | Fennec:fx8 | Fennec:fx9 »

« Mobile

Overview

The goal of this Overall Test Plan is to lay out testing strategy, results, and tracking for each milestone as it crosses through each channel of the Firefox development process.

All of our releases are tested off of the "Fennec 8.0 Catch-All Test Run" on the Litmus TCM.

For more information about Fennec 8.0, take a look at the mobile team's Feature Planning page.

Bugs in Release

General Responsibilities

Nightly

Test Plan and Results Start Date
Nightly  07/05/2011
QA Task Person/Group How Often?
Smoketests Waverley Daily
BFTs Waverley/Feature QA Weekly
OS Integration Waverley Weekly
Bug Verification Waverley As-needed
Crash Reporting mw22 / nhirata Daily
Bug Triage MoCo team Weekly
Testday kbrosnan Once

Aurora

Test Plan and Results Start Date
Aurora  08/16/2011
QA Task Person/Group How Often?
Smoketests Waverley/Feature QA Weekly
Bug Verification Waverley As-needed

Beta

Test Plan and Results Start Date
Beta  09/27/2011
QA Task Person/Group How Often?
Smoketests Waverley Once
Crash Reporting mw22 Daily
L10n Tier 1 Locale Check nhirata Once
Device Compatibility AaronMT Once
Website Compatibility AaronMT Once
Testday kbrosnan Once

Features Tracked

{{#ask: Feature list::MobileFeature version::Firefox 8 | ?# | ?Feature name# | ?Feature stage# | ?Feature status note# | ?Feature health# | ?Feature feature manager# | mainlabel=- | sort=Feature stage | format=template | template=ReleaseTrackingTable }}
Feature Stage Status note Health Feature manager

8/8+ Bug List

New Features in Fennec 8.0/8.0+: Bug list


Misc Bug fixes

  • Others:
    • Make Fennec Faster
    • Power Management:
      • bug 446418 - [meta] Investigate power management issues
      • bug 673352 webgl demo keeps playing when returning to android menu (sucking battery power)
      • bug 608440 Battery lifetime is decreased with Fennec due to background tabs
    • bug 564667 - Allow bootstrapped add-ons to have chrome
    • bug 454880 Allow access to recent history through back/forward buttons
    • bug 662936 fennec silently fails while running talos
      • azakai is working on a better stack traces with a custom-compiled libc
    • bug 616348 [meta] Web compatibility for Mobile Firefox (Fennec)
    • bug 636042 - When two fonts with the same name but different available characters exist we should be able to use characters from either one
    • bug 672304 Dom Inspector does not work for Fennec anymore
    • bug 564667 Allow bootstrapped add-ons to have chrome
    • bug 670056 no context menu in http auth dialog
    • bug 634997 - no synthetic bolding on Android
    • bug 669407 - Reduce disk space requirements for Safe Browsing


  • Sync
    • bug 664792 - Tune sync intervals according to user behaviour


Gfx:

  • bug 607684 [OGL] OpenGL on mobile
  • bug 619615 - [OGL] Accelerated layers hangs Fennec and results in a phone reboot on Nexus 1
  • bug 621745 - [OGL] Duplicate urlbar flickers at bottom of awesomescreen when keyboard appears (Android + GL)
  • bug 670930 - Texture updates happen synchronously and harm interactive performance


VKB:

  • bug 672661 Backspace key in Swiftkey X causes characters to be duplicated
  • bug 617298 Text input causes SwiftKey keyboard to force close
  • bug 664364 - Entering newline after Japanese in a textarea doesn't change cursor position


Core:

  • Networking
  • bug 447866 - http pipelining is bursty
  • bug 665532 - Fix unused variable warnings in nsWifiScanner*.cpp
  • Memory:
    • bug 682326
    • bug 671352 - Split chrome into multiple compartments for better accounting of JS memory used by chrome code (and add-ons)
    • bug 669346 Don't force a second GC on memory pressure
    • bug 666713 - Dynamic analysis of chrome->content operations in Firefox
    • bug 640791 - (mtools-fx5+) [meta] improve memory tools for Firefox 5+
    • {Bug|640457}} - (mslim-fx5+) [meta] memory size reductions for Firefox 5+
    • bug 671971 - Look into reducing max % of memory cache consumed by any one object
    • bug 672443 - [Jetpack] Too many compartments!


Crash Reporter:

  • bug 672287 - Get symbols for libc for most common Android installs
  • bug 668210 - Write an extension to gather Breakpad symbols from system libraries
  • bug 664510 - Get valid crashreporter reports again

7 Follow up Bug List

  • Camera Support
  • Selecting text in web content followup bugs
  • Language picker support for locales on AMO
    • bug 666973 Don't show localepicker if system locale is available
    • bug 669154 Empty button briefly visible during startup from locale picker
  • VKB:
    • bug 673291 - Show the keyboard with a magnifying glass instead of GO when in a search field

6 Follow up Bug List

  • Accelerometer: (landed in 6)
    • bug 667919 - window.ondevicemotion and window.ondeviceorientation
    • bug 673922 - API to block orientationchange
    • bug 557642 - An option should be added to disable auto-rotation
    • bug 615940 Using Device Orientation events starts an immortal rapid timer
    • bug 603336 - e10s & MozOrientation: Infinite page loading
    • bug 615597 - Implement the W3C DeviceOrientation Event Specification
    • bug 662678 - w3c device orientation spec changes
    • bug 673472 - Segfault when using acceleration event handler that calls console.log