QA/Fennec1.0/TestPlan:Beta1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
 
(10 intermediate revisions by the same user not shown)
Line 13: Line 13:
* Full set of [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] test cases
* Full set of [[https://litmus.mozilla.org/run_tests.cgi?test_run_id=35 litmus]] test cases


== Schedule ==
* Beta1 - March 17th
** Code Complete - Feb 20
** Handoff to Test (B1 RC1) - Feb 23
*** Will need official maemo bits from build
*** Will need semi-official desktop bits
** 48 hour test pass, Test Signs off - Feb 26
** Upload and blog - Feb 27
Our 48 hour test pass includes:
* Unit tests
* Litmus Smoketests, BFT's
* Manual spot checking for feature FFT's
* [[QA/Fennec1.0/TestStrategy#Web_Compatibility_Tests|Web Compatibility]] and [[QA/Fennec1.0/TestPlan#Banking_and_Financial_Sites|Banking]] top sites test
* Install and update testing
* Bug verification
A 4 hour respin test includes:
* Unit tests
* Litmus Smoketests
* Litmus BFT's for affected area(s)
* Top 10 website spot check


== Bugs QA would like fixed ==
== Bugs QA would like fixed ==
*[[https://bugzilla.mozilla.org/show_bug.cgi?id=455891 455891]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=469244 469244]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=469166 469166]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=472334 472334]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=472166 472166]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=472513 472513]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=470951 470951]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=470303 470303]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=470870 470870]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=470443 470443]] *[[https://bugzilla.mozilla.org/show_bug.cgi?id=469048 469048]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=455891 455891]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469244 469244]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469166 469166]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472334 472334]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472166 472166]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=472513 472513]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470951 470951]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470303 470303]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470870 470870]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=470443 470443]]
* [[https://bugzilla.mozilla.org/show_bug.cgi?id=469048 469048]]


== Test Results ==
== Test Results ==
Line 192: Line 224:
*[[Mobile/Fennec/Releases | Getting builds for N800/N810]]
*[[Mobile/Fennec/Releases | Getting builds for N800/N810]]
*note: for anything not requiring a device, a desktop build of fennec is sufficient (use Ubuntu if you need mochitests)
*note: for anything not requiring a device, a desktop build of fennec is sufficient (use Ubuntu if you need mochitests)
*[[Mobile/Build/Windows_Mobile_Build_Instructions|Windows mobile]] build instructions


testing:
testing:
*[[Mobile/Fennec_Mochitest | Mochitests on Fennec]]
*[[Mobile/Fennec_Automation|Unit tests]]
 
*Need build and installation instructions for windows mobile

Latest revision as of 17:38, 24 March 2009

« Mobile « QA/Fennec1.0/TestPlan

Overview

Beta1 release builds on the performance of Alpha2 with some additional performance work and adding the features that people expect in a web browser. This is a release where there are very few known crashes or large errors.

For Beta 1 QA expects to see:

  • daily builds for [linux-arm].
  • Talos results
  • All unit tests running on Maemo and failures documented
  • all bugs for Beta 1 verified
  • Completed test plan
  • Full set of [litmus] test cases

Schedule

  • Beta1 - March 17th
    • Code Complete - Feb 20
    • Handoff to Test (B1 RC1) - Feb 23
      • Will need official maemo bits from build
      • Will need semi-official desktop bits
    • 48 hour test pass, Test Signs off - Feb 26
    • Upload and blog - Feb 27

Our 48 hour test pass includes:

  • Unit tests
  • Litmus Smoketests, BFT's
  • Manual spot checking for feature FFT's
  • Web Compatibility and Banking top sites test
  • Install and update testing
  • Bug verification

A 4 hour respin test includes:

  • Unit tests
  • Litmus Smoketests
  • Litmus BFT's for affected area(s)
  • Top 10 website spot check

Bugs QA would like fixed

Test Results

- Litmus results
- Bug verification:
- Mochitest results
- Mochitest-Chrome results
- Reftest results
- Crashtest results
- Completed test plan/documentation items
- Bugs found

Test Areas

Feature Focused Areas

Feature Area and Spec Test Plan Location Testing Notes QA Contact Dev Contact Device Needed Links
Zoom gavin M
Add-ons manager mfinkle N
Navigation mfinkle, dougt M
Panning gavin Y
Download Manager here jmaher mfinkle N
Running Firefox's mochitests here Status jmaher jmaher N
Updates N
Windows Mobile here build notes jmaher wolfe Y
Performance Low disk/mem, large pages, startup time Y
Bookmarks N
Certificate Management johnath N
Weave dolske N
Find neil Y
Browsing History gavin N

Additional References

This section is left to add any additional references relevant to the Mobile project

building:

testing:

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec1.0/TestPlan:Beta1&oldid=135944"