QA/Fennec1.0/TestPlan:Alpha2: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
(New page: <small>« Mobile</small> == Overview == The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status. Since Fenne...)
 
 
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
<small>[[Mobile|&laquo; Mobile]]</small>
<small>[[Mobile|&laquo; Mobile]]</small>
<small>[[QA/Fennec1.0/TestPlan|&laquo; QA/Fennec1.0/TestPlan]]</small>


== Overview ==
== Overview ==
The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.
Alpha 2 is a big release to add many required features, more usability, configurability, stability and performance.


Since Fennec is not installed or used in the same way Firefox is, the test approach needs to be modified. We will automate as much as possible. The automation we will use will be a subset (as all features are not in Fennec) of the Firefox automation with new tests developed to test specific issues of firefox.  Key pieces of automation will be functionality, performance, and stability.
For Alpha 2 QA expects to see:
* daily builds for [[ftp://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mobile-browser-linux-arm/ linux-arm]].
* daily builds for windows mobile.
* mochitests running on nokia device.
* all bugs for Alpha 2 verified
* Completed test plan for Alpha 1 and 2 features
** linked [[QA/Fennec1.0/TestPlan| wiki]] documents


There will be a lot of unique tests which are device specific and Fennec specific that will be too expensive to automate. With these we will add them to litmus and run them by hand.
** defined test cases in [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] and automation
* a [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] test run


== Test Results ==  
== Test Results ==  
Line 33: Line 41:
* Zoom to fit: {{bug|436078}}, {{bug|436079}}
* Zoom to fit: {{bug|436078}}, {{bug|436079}}
* Animate zoom: {{bug|437957}}
* Animate zoom: {{bug|437957}}
|-
|Add-ons manager
|
|
|
|mfinkle
|N
|
* Add-on install: {{bug|437958}}
* Add-on view: {{bug|437959}}
* Add-on removal: {{bug|437960}}
|-
|-
|Awesome bar and search
|Awesome bar and search
|[[QA/Fennec1.0/TestPlan:Awesome_bar_Search| here]]
|
|
|
|jmaher
|
|enndeakin
|enndeakin
|N
|N
|
|
* {{bug|431842}}
* Awesome-bar - {{bug|431842}}
|-
* Find - {{bug|436074}}
|Tel: uri
|
|
|
|blassey
|N
|
* General: {{bug|437949}}
* Linkify: {{bug|437956}}
|-
|Multiple document
|
|Already some Firefox tests for this
|
|enndeakin
|N
|
* {{bug|436064}}
|-
|Navigation
|
|
|
|mfinkle, dougt
|M
|
* General: {{bug|436068}}
* Spatial navigation: {{bug|436084}} [http://www.mozilla.org/access/keyboard/snav/ info]
* Animated: {{bug|444248}}
|-
|Geolocation
|
|
|harthur
|dougt
|N
|
* {{bug|449508}}
|-
|Panning
|
|
|
|gavin
|Y
|
* {{bug|431843}}
* non-responsive: {{bug|441364}}
|-
|-
|Download Manager
|Download Manager
|[[QA/Fennec1.0/TestPlan:Download_Manager| here]]
|
|
|
|jmaher
|
|mfinkle
|mfinkle
|N
|N
|
|
* {{bug|436070}}
* {{bug|436070}}
|-
|Kinetic Scrolling
|
|Manual testing
|
|blassey
|Y
|
* {{bug|443212}}
|-
|-
|Running Firefox's mochitests
|Running Firefox's mochitests
|
|[[Mobile/Fennec_Mochitest| here]]
|
|Support OOM and hung tests on Nokia
|harthur
|jmaher
|
|jmaher
|N
|N
|
|
* {{bug|445876}}
* {{bug|445876}}
|-
|Updates
|
|
|
|
|N
|
* Update notification {{bug|431837}}
|-
|-
|Windows Mobile
|Windows Mobile
|
|[[QA/Fennec1.0/TestPlan:Windows_Mobile| here]]
|
|build/installation notes
|
|jmaher
|
|wolfe
|Y
|Y
|
|
* Windows installer {{bug|430682}}
* Windows installer {{bug|430682}}
* Windows XULrunner build {{bug|432792}}
* Windows XULrunner build {{bug|432792}}
|-
|Performance
|
|Low disk/mem, large pages, startup time
|
|
|Y
|
* network {{bug|437953}}
* Startup time {{bug|431824}}
* Startup RAM {{bug|431825}}
|-
|Bookmarks
|
|
|
|
|N
|
* edit/view {{bug|456490}}
|-
|Preferences
|
|
|
|
|N
|
* Preferences {{bug|436077}}
|-
|-
|Certificate Management
|Certificate Management
Line 182: Line 84:
|
|
|
|
|
|johnath
|N
|N
|
|
* {{bug|436076}}
* {{bug|436076}}
|-
|-
|Password manager
|Weave
|
|
|
|
|
|
|
|dolske
|N
|N
|
|
* {{bug|436054}}
* {{bug|436055}}
|-
|-
|Popup Blocker
|Interop
|
|
|
|
|N
|
* {{bug|436057}}
|-
|Breakpad
|
|
|
|
|Y
|
* ARM/Linux {{bug|431838}}
* Windows {{bug|431839}}
|-
|Soft keyboard
|
|
|
|
|Dictionary, T9, etc...
|
|
|christian
|Y
|Y
|
|
* {{bug|439053}}
* input field: {{bug|436075}}
|-
|Weave
|
|
|
|
|N
|
* {{bug|436055}}
|-
|-
|Interop
|Keyboard
|email, print, cut/paste, phone
|
|
|
|open, close, access, hardkeys, user defined
|
|
|db48x, neil
|Y
|Y
|
|
* mailto: {{bug|437950}}
* keyboard shortcuts: {{bug|436080}}
* print plugin: {{bug|456092}}
* user defined shortcuts: {{bug|441794}}
|}
|}


== Additional References ==  
== Additional References ==  
Line 255: Line 128:
testing:
testing:
*[[Mobile/Fennec_Mochitest | Mochitests on Fennec]]
*[[Mobile/Fennec_Mochitest | Mochitests on Fennec]]
*Need build and installation instructions for windows mobile

Latest revision as of 22:24, 24 October 2008

« Mobile « QA/Fennec1.0/TestPlan

Overview

Alpha 2 is a big release to add many required features, more usability, configurability, stability and performance.

For Alpha 2 QA expects to see:

  • daily builds for [linux-arm].
  • daily builds for windows mobile.
  • mochitests running on nokia device.
  • all bugs for Alpha 2 verified
  • Completed test plan for Alpha 1 and 2 features
    • defined test cases in [litmus] and automation
  • a [litmus] test run

Test Results

Test Areas

Feature Focused Areas

Feature Area and Spec Test Plan Location Testing Notes QA Contact Dev Contact Device Needed Links
Zoom gavin M
Awesome bar and search here jmaher enndeakin N
Download Manager here jmaher mfinkle N
Running Firefox's mochitests here Support OOM and hung tests on Nokia jmaher jmaher N
Windows Mobile here build/installation notes jmaher wolfe Y
Certificate Management johnath N
Weave dolske N
Interop Dictionary, T9, etc... christian Y
Keyboard open, close, access, hardkeys, user defined db48x, neil Y

Additional References

This section is left to add any additional references relevant to the Mobile project

building:

testing:

  • Need build and installation instructions for windows mobile
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec1.0/TestPlan:Alpha2&oldid=114079"