QA/Fennec/Milestones/2.0: Difference between revisions
(6 intermediate revisions by 5 users not shown) | |||
Line 11: | Line 11: | ||
For more information about Fennec 2.0, take a look at the mobile team's [[Mobile/Planning/2.0|Feature Planning page]] | For more information about Fennec 2.0, take a look at the mobile team's [[Mobile/Planning/2.0|Feature Planning page]] | ||
=== Current Blocking Bugs List === | === Current Blocking Bugs List === | ||
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=blocking-fennec% | |||
* [ | * [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=blocking-fennec%3A%2B fennec blockers] | ||
* [http://blocker-reports.brasstacks.mozilla.com/mobile.html blocker trends] | |||
=== Devices Supported === | === Devices Supported === | ||
Line 35: | Line 36: | ||
=== Build Location === | === Build Location === | ||
Fennec 2.0 is currently built from trunk (mozilla-central) as well as the front end mobile-browser repositories. Nightly builds for all platforms are located at: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mobile-trunk/ | |||
== Releases Tested == | == Releases Tested == | ||
Line 45: | Line 45: | ||
* Beta 2 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2|Release Test Results]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build2|build 2]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build3|build 3]] | * Beta 2 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2|Release Test Results]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build2|build 2]], [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta2_Build3|build 3]] | ||
* Beta 3 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta3|Release Test Results]] | * Beta 3 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta3|Release Test Results]] | ||
* Beta 4 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta4|Release Test Results]] | |||
* Beta 5 - [[QA/Fennec/Milestones/2.0/ReleaseTest/Beta5|Release Test Results]] | |||
* RC 1 - [[QA/Fennec/Milestones/2.0/ReleaseTest/RC1|Release Test Results]] | |||
* 4.0.1 - [[QA/Fennec/Milestones/2.0/ReleaseTest/4.0.1|Release Test Results]] | |||
== Test Areas == | == Test Areas == | ||
Line 73: | Line 77: | ||
|} | |} | ||
==== Platform (P1's) ==== | ==== Platform (P1's) ==== | ||
{| class="standard-table sortable" | {| class="standard-table sortable" | ||
|- | |- | ||
|class="header"|Feature Area and Spec | | class="header" | Feature Area and Spec | ||
|class="header"|Unit Testcases Needed/Added | | class="header" | Unit Testcases Needed/Added | ||
|class="header"|QA Contact | | class="header" | QA Contact | ||
|class="header"|Dev Contact | | class="header" | Dev Contact | ||
|class="header"|Links | | class="header" | Links | ||
|- style="background:#DFFFA5;" | |- style="background:#DFFFA5;" | ||
|[[Mobile/e10s|e10s]] | | [[Mobile/e10s|e10s]] | ||
|Yes | | Yes | ||
|mw22 | | mw22 | ||
| | | | ||
|[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:e10s Test Plan] | | [https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:e10s Test Plan] | ||
|- style="background:#DFFFA5;" | |- style="background:#DFFFA5;" | ||
|[[Gecko:Layers|Layers]] | | [[Gecko:Layers|Layers]] | ||
|Yes | | Yes | ||
|mw22 | | mw22/aaronmt | ||
| | | | ||
| | | | ||
|- style="background:#DFFFA5;" | |- style="background:#DFFFA5;" | ||
|[https://wiki.mozilla.org/Mobile/Powersaving Power Mgmt] | | [https://wiki.mozilla.org/Mobile/Powersaving Power Mgmt] | ||
|Yes/No | | Yes/No | ||
|mw22 | | mw22 | ||
| | | | ||
| | | | ||
|} | |} | ||
Line 225: | Line 230: | ||
|[https://wiki.mozilla.org/Mobile/Projects/Reflow_on_zoom Reflow on Zoom] | |[https://wiki.mozilla.org/Mobile/Projects/Reflow_on_zoom Reflow on Zoom] | ||
|Yes/No | |Yes/No | ||
| | |mw22 | ||
| | |mbrubeck | ||
| | |[https://wiki.mozilla.org/QA/Fennec/Milestones/2.0/TestPlan:Reflow_on_zoom Test Plan] | ||
|- style="background:#FFFFFF;" | |- style="background:#FFFFFF;" | ||
|[https://wiki.mozilla.org/Mobile/Projects/FormAssistant2.0 Form Assistant Refresh] | |[https://wiki.mozilla.org/Mobile/Projects/FormAssistant2.0 Form Assistant Refresh] |
Latest revision as of 23:19, 11 April 2011
Overview
The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.
All of our releases are tested off of the "Fennec 2.0 Catch-All Test Run" on the Litmus TCM.
For more information about Fennec 2.0, take a look at the mobile team's Feature Planning page
Current Blocking Bugs List
Devices Supported
Device | OS | Manufacturer | Keyboard | GPS | Camera | Rotate | Resolution |
---|---|---|---|---|---|---|---|
Nokia N900 | Maemo | Nokia | Slide Out | Yes | Yes | Yes | 480x800 |
Nexus One | Android | None | Yes | Yes | Yes | 800x480 | |
Droid | Android | Motorola | Yes | Yes | Yes | Yes | 800x480 |
Desire | Android | HTC | Yes | Yes | Yes | Yes | 800x480 |
Droid Incredible | Android | HTC | Yes | Yes | Yes | Yes | 800x480 |
HTC Desire | Android | HTC | No | Yes | Yes | Yes | 800x480 |
Build Location
Fennec 2.0 is currently built from trunk (mozilla-central) as well as the front end mobile-browser repositories. Nightly builds for all platforms are located at: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mobile-trunk/
Releases Tested
- Alpha 1 - August 16th - Release Test Results
- Beta 1 - October 7th - Release Test Results, build 3
- Beta 2 - Release Test Results, build 2, build 3
- Beta 3 - Release Test Results
- Beta 4 - Release Test Results
- Beta 5 - Release Test Results
- RC 1 - Release Test Results
- 4.0.1 - Release Test Results
Test Areas
General Test Areas
Status | Action to Take |
Testcases Added |
|
Landed |
|
Dev Started |
|
Not Landed/Backed Out |
|
Platform (P1's)
Feature Area and Spec | Unit Testcases Needed/Added | QA Contact | Dev Contact | Links |
e10s | Yes | mw22 | Test Plan | |
Layers | Yes | mw22/aaronmt | ||
Power Mgmt | Yes/No | mw22 |
P1 (must have's)
Feature Area and Spec | Litmus Testcases Needed/Added | QA Contact | Dev Contact | Links |
Android Updater | Yes/Yes | nhirata | blassey, apakhotin | Test Plan |
Multitouch | Yes/No | aakashd | mbrubeck | Test Plan |
Virtual Keyboard | Yes/Yes | nhirata | jchen | Test Plan |
Android Chrome Theme | Yes/No | AaronMT | madhava, martell | |
Weave Sync Integration | Yes/Yes | tchung | mfinkle | Test Plan |
Platform integration (notification systems, back button, helper apps) | Yes/No | ashah | bunch of people | |
RTL Support | Yes/Yes | nhirata | vingtetun | Test Plan |
Page Interactions | Yes/No | aakashd | vingtetun, mfinkle | |
Awesome Screen Redesign | Yes/No | AaronMT | vingtetun | Test Plan |
P2 (should have's)
Feature Area and Spec | Litmus Testcases Needed/Added | QA Contact | Dev Contact | Links |
Find In Page | Yes/Yes | vlad | vingtetun | Test Plan |
Sharing | Yes/Yes | tchung | mbrubeck | Test Plan |
Feedback and Help | Yes/Yes | nhirata | mfinkle | Test Plan |
UI Transitions/Animations | No/No | aakashd | ||
Basic RSS Support | Yes/No | nhirata | jmientenin | Test Plan |
Scrolling Indicators | Yes/No | aakashd | mfinkle | Test Plan |
Camera UI | Yes/No | vlad | ||
Contacts Integration | Yes/No | tchung | mfinkle | Test Plan |
Reflow on Zoom | Yes/No | mw22 | mbrubeck | Test Plan |
Form Assistant Refresh | Yes/Yes | aakashd | vingtetun | Test Plan |
P3 (nice to have's)
Feature Area and Spec | Litmus Testcases Needed/Added | QA Contact | Dev Contact | Links |
Long-Tap Support | Yes/No | nhirata | Test Plan | |
Session Restore | Yes/Yes | tchung | mfinkle | |
Make logging into websites easier | Yes/No | tchung | ||
Better error pages | Yes/No | aakashd | stechz | |
Mobilize our messages/dialogs | Yes/No | mw22 | ||
Basic Webapp Support | No | tchung | fabrice |
Automation
QA is undertaking the task of porting the unit tests from Firefox to Fennec for each platform. This is a lengthy task, but our goal is to have 100% unit tests passing by the 2.0 ship.
We have created a tracking system for the unit tests which we update on a regular basis.