QA/Fennec1.0/TestPlan:Beta1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
(New page: <small>« Mobile</small> <small>« QA/Fennec1.0/TestPlan</small> == Overview == Alpha 2 is a big release to add many required features, more...)
 
 
(15 intermediate revisions by the same user not shown)
Line 3: Line 3:


== Overview ==
== Overview ==
Alpha 2 is a big release to add many required features, more usability, configurability, stability and performance.
Beta1 release builds on the performance of Alpha2 with some additional performance work and adding the features that people expect in a web browser.  This is a release where there are very few known crashes or large errors.
For Beta 1 QA expects to see:
* daily builds for [[ftp://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mobile-browser-linux-arm/ linux-arm]].
* Talos results
* All unit tests running on Maemo and failures documented
* all bugs for Beta 1 verified
* Completed test plan
* Full set of [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] test cases
 
== Schedule ==
* Beta1 - March 17th
** Code Complete - Feb 20
** Handoff to Test (B1 RC1) - Feb 23
*** Will need official maemo bits from build
*** Will need semi-official desktop bits
** 48 hour test pass, Test Signs off - Feb 26
** Upload and blog - Feb 27
 
Our 48 hour test pass includes:
* Unit tests
* Litmus Smoketests, BFT's
* Manual spot checking for feature FFT's
* [[QA/Fennec1.0/TestStrategy#Web_Compatibility_Tests|Web Compatibility]] and [[QA/Fennec1.0/TestPlan#Banking_and_Financial_Sites|Banking]] top sites test
* Install and update testing
* Bug verification


For Alpha 2 QA expects to see:
A 4 hour respin test includes:
* daily builds for [[ftp://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mobile-browser-linux-arm/ linux-arm]].
* Unit tests
* daily builds for windows mobile.
* Litmus Smoketests
* mochitests running on nokia device.
* Litmus BFT's for affected area(s)
* all bugs for Alpha 2 verified
* Top 10 website spot check
* Completed test plan for Alpha 1 and 2 features
 
** linked [[QA/Fennec1.0/TestPlan| wiki]] documents
== Bugs QA would like fixed ==
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=455891 455891]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469244 469244]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469166 469166]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472334 472334]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472166 472166]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472513 472513]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470951 470951]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470303 470303]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470870 470870]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470443 470443]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469048 469048]]


** defined test cases in [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] and automation
== Test Results ==
* a [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] test run


== Test Results ==
- Litmus results
- Bug verification:
- Mochitest results
- Mochitest-Chrome results
- Reftest results
- Crashtest results
- Completed test plan/documentation items
- Bugs found


== Test Areas ==
== Test Areas ==
Line 42: Line 84:
* Animate zoom: {{bug|437957}}
* Animate zoom: {{bug|437957}}
|-
|-
|Awesome bar and search
|Add-ons manager
|[[QA/Fennec1.0/TestPlan:Awesome_bar_Search| here]]
|
|
|jmaher
|
|enndeakin
|
|mfinkle
|N
|N
|
|
* Awesome-bar - {{bug|431842}}
* AMO for mobile: {{bug|436073}}
* Find - {{bug|436074}}
* Add-on install: {{bug|437958}}
* Add-on view: {{bug|437959}}
* Add-on removal: {{bug|437960}}
|-
|Navigation
|
|
|
|mfinkle, dougt
|M
|
* General: {{bug|436068}}
* Spatial navigation: {{bug|436084}} [http://www.mozilla.org/access/keyboard/snav/ info]
* Animated: {{bug|444248}}
|-
|Panning
|
|
|
|gavin
|Y
|
* {{bug|431843}}
* non-responsive: {{bug|441364}}
|-
|-
|Download Manager
|Download Manager
Line 62: Line 127:
|-
|-
|Running Firefox's mochitests
|Running Firefox's mochitests
|[[Mobile/Fennec_Mochitest| here]]
|[[Mobile/Fennec_Mochitest|here]]
|Support OOM and hung tests on Nokia
|[[Mobile/Fennec_Automation|Status]]
|jmaher
|jmaher
|jmaher
|jmaher
Line 69: Line 134:
|
|
* {{bug|445876}}
* {{bug|445876}}
|-
|Updates
|
|
|
|
|N
|
* Update notification {{bug|431837}}
|-
|-
|Windows Mobile
|Windows Mobile
|[[QA/Fennec1.0/TestPlan:Windows_Mobile| here]]
|[[QA/Fennec1.0/TestPlan:Windows_Mobile|here]]
|build/installation notes
|[[Mobile/Build/Windows_Mobile_Build_Instructions|build notes]]
|jmaher
|jmaher
|wolfe
|wolfe
Line 79: Line 153:
* Windows installer {{bug|430682}}
* Windows installer {{bug|430682}}
* Windows XULrunner build {{bug|432792}}
* Windows XULrunner build {{bug|432792}}
|-
|Performance
|
|Low disk/mem, large pages, startup time
|
|
|Y
|
* network {{bug|437953}}
* Startup time {{bug|431824}}
* Startup RAM {{bug|431825}}
|-
|Bookmarks
|
|
|
|
|N
|
* edit/view {{bug|456490}}
* move {{bug|465294}}
* sort {{bug|465298}}
* delete {{bug|465291}}
* add folder {{bug|465290}}
* delete folder {{bug|465292}}
|-
|-
|Certificate Management
|Certificate Management
Line 98: Line 197:
* {{bug|436055}}
* {{bug|436055}}
|-
|-
|Interop
|Find
|
|
|
|Dictionary, T9, etc...
|
|
|christian
|neil
|Y
|Y
|
|
* input field: {{bug|436075}}
* Find: {{bug|436074}}
|-
|-
|Keyboard
|Browsing History
|
|
|
|open, close, access, hardkeys, user defined
|
|
|db48x, neil
|gavin
|Y
|N
|
|
* keyboard shortcuts: {{bug|436080}}
* view: {{bug|436069}}
* user defined shortcuts: {{bug|441794}}
* delete: {{bug|465288}}
|}
|}


Line 125: Line 224:
*[[Mobile/Fennec/Releases | Getting builds for N800/N810]]
*[[Mobile/Fennec/Releases | Getting builds for N800/N810]]
*note: for anything not requiring a device, a desktop build of fennec is sufficient (use Ubuntu if you need mochitests)
*note: for anything not requiring a device, a desktop build of fennec is sufficient (use Ubuntu if you need mochitests)
*[[Mobile/Build/Windows_Mobile_Build_Instructions|Windows mobile]] build instructions


testing:
testing:
*[[Mobile/Fennec_Mochitest | Mochitests on Fennec]]
*[[Mobile/Fennec_Automation|Unit tests]]
 
*Need build and installation instructions for windows mobile

Latest revision as of 17:38, 24 March 2009

« Mobile « QA/Fennec1.0/TestPlan

Overview

Beta1 release builds on the performance of Alpha2 with some additional performance work and adding the features that people expect in a web browser. This is a release where there are very few known crashes or large errors.

For Beta 1 QA expects to see:

  • daily builds for [linux-arm].
  • Talos results
  • All unit tests running on Maemo and failures documented
  • all bugs for Beta 1 verified
  • Completed test plan
  • Full set of [litmus] test cases

Schedule

  • Beta1 - March 17th
    • Code Complete - Feb 20
    • Handoff to Test (B1 RC1) - Feb 23
      • Will need official maemo bits from build
      • Will need semi-official desktop bits
    • 48 hour test pass, Test Signs off - Feb 26
    • Upload and blog - Feb 27

Our 48 hour test pass includes:

  • Unit tests
  • Litmus Smoketests, BFT's
  • Manual spot checking for feature FFT's
  • Web Compatibility and Banking top sites test
  • Install and update testing
  • Bug verification

A 4 hour respin test includes:

  • Unit tests
  • Litmus Smoketests
  • Litmus BFT's for affected area(s)
  • Top 10 website spot check

Bugs QA would like fixed

Test Results

- Litmus results
- Bug verification:
- Mochitest results
- Mochitest-Chrome results
- Reftest results
- Crashtest results
- Completed test plan/documentation items
- Bugs found

Test Areas

Feature Focused Areas

Feature Area and Spec Test Plan Location Testing Notes QA Contact Dev Contact Device Needed Links
Zoom gavin M
Add-ons manager mfinkle N
Navigation mfinkle, dougt M
Panning gavin Y
Download Manager here jmaher mfinkle N
Running Firefox's mochitests here Status jmaher jmaher N
Updates N
Windows Mobile here build notes jmaher wolfe Y
Performance Low disk/mem, large pages, startup time Y
Bookmarks N
Certificate Management johnath N
Weave dolske N
Find neil Y
Browsing History gavin N

Additional References

This section is left to add any additional references relevant to the Mobile project

building:

testing:

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec1.0/TestPlan:Beta1&oldid=135944"