QA/Fennec/Milestones/7.0/Beta: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 7.0
Jump to navigation Jump to search
(Created page with "= Fennec 7.0 Beta Test Plan = == Overview == The goal of this Overall Test Plan is to lay out our testing strategy, determine who will own certain test areas and when they will...")
 
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Fennec 7.0 Beta Test Plan =
= Fennec 7.0 Beta Test Plan =
<small>[[QA/Fennec/Milestones|« Milestones]] | [[QA/Fennec/Milestones/7.0/Beta|Fennec 7.0 Beta]] | [[QA/Fennec/Milestones/7.0/Beta/Beta_1|» Fennec 7.0 Beta 1]] </small>


== Overview ==
== Overview ==
Line 6: Line 8:


== Project contacts ==  
== Project contacts ==  
PM: Thomas Arend (tarend) <BR>
'''PM''': Thomas Arend (tarend) <BR>
Dev Lead: Mark Finkle (mfinkle) <BR>
'''Dev''': Lead: Mark Finkle (mfinkle) <BR>
Build: John Oduinn  (joduinn)<BR>
'''Build''': John Oduinn  (joduinn)<BR>
QA: Aaron Train (aaronmt)<BR>
'''QA''': Aaron Train (aaronmt)<BR>


== Schedule ==
== Schedule ==
* Start Date: 7/05/2011
* '''Start Date''': 8/16/2011
* End Date: 8/16/2011
* '''End Date''': 9/27/2011


=== Bugs in Release ===
=== Bugs in Release ===


* [https://bugzilla.mozilla.org/buglist.cgi?order=Bug%20Number&type0-1-0=equals&field0-1-0=cf_status_firefox7&field0-0-0=cf_blocking_fennec&resolution=---&resolution=FIXED&resolution=INVALID&resolution=WONTFIX&resolution=DUPLICATE&resolution=WORKSFORME&resolution=INCOMPLETE&resolution=SUPPORT&resolution=EXPIRED&resolution=MOVED&query_format=advanced&value0-1-0=fixed&type0-0-0=equals&value0-0-0=7%2B Tracking Firefox 7, FIXED]
* [https://bugzilla.mozilla.org/buglist.cgi?order=Bug%20Number&type0-1-0=equals&field0-1-0=cf_status_firefox7&field0-0-0=cf_blocking_fennec&resolution=---&resolution=FIXED&resolution=INVALID&resolution=WONTFIX&resolution=DUPLICATE&resolution=WORKSFORME&resolution=INCOMPLETE&resolution=SUPPORT&resolution=EXPIRED&resolution=MOVED&query_format=advanced&value0-1-0=fixed&type0-0-0=equals&value0-0-0=7%2B Tracking Firefox 7, FIXED]
=== Beta Testplans ===
<small>[[QA/Fennec/Milestones|« Milestones]] | [[QA/Fennec/Milestones/7.0/Beta|Fennec 7.0 Beta]] | [[QA/Fennec/Milestones/7.0/Beta/Beta_1|» Fennec 7.0 Beta 1]] </small>
* [[QA/Fennec/Milestones/7.0/Beta/Beta_1| Fennec 7.0 Beta 1]]
* [[QA/Fennec/Milestones/7.0/Beta/Beta_2| Fennec 7.0 Beta 2]]
* [[QA/Fennec/Milestones/7.0/Beta/Beta_3| Fennec 7.0 Beta 3]]
* [[QA/Fennec/Milestones/7.0/Beta/Beta_4| Fennec 7.0 Beta 4]]
* [[QA/Fennec/Milestones/7.0/Beta/Beta_5| Fennec 7.0 Beta 5]]
* [[QA/Fennec/Milestones/7.0/Beta/Beta_6| Fennec 7.0 Beta 6]]
* [[QA/Fennec/Milestones/7.0/RC_1| Fennec 7.0 RC1]]


== Build Location and IDs ==
== Build Location and IDs ==


# Go to the [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/ candidatesfolder] in our ftp directory
# Go to the [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/ candidates folder] in our ftp directory
# Go to the "latest-mozilla-beta" folder
# Go to the "latest-mozilla-beta" folder
# Download and install the latest 7.0b-candidate build onto your Android phone/device
# Download and install the latest 7.0b-candidate build onto your Android phone/device
Line 34: Line 48:
|-
|-
|}
|}
; 7/7+ Bug List
New Features in Fennec 7.0/7.0+: [https://bugzilla.mozilla.org/buglist.cgi?order=Bug%20Number&type0-1-0=equals&field0-1-0=cf_status_firefox7&field0-0-0=cf_blocking_fennec&resolution=---&resolution=FIXED&resolution=INVALID&resolution=WONTFIX&resolution=DUPLICATE&resolution=WORKSFORME&resolution=INCOMPLETE&resolution=SUPPORT&resolution=EXPIRED&resolution=MOVED&query_format=advanced&value0-1-0=fixed&type0-0-0=equals&value0-0-0=7%2B Bug List]
* [https://wiki.mozilla.org/Fennec/Features/androidcopypaste Text Selection From Content]
** {{bug|661388}} - Support selecting text in content
** {{bug|659022}} - Implement copy from content
* [https://wiki.mozilla.org/Fennec/Features/langchoice Language Choice on First Run]
** {{bug|653141}} - Allow language choice on first-run
* Moz-Icon support on Android
** {{bug|649381}}
* [https://wiki.mozilla.org/Fennec/Features/sessionstore Session Store Enhancements]
** {{bug|604463}} - Request for session store to retain the browsing history and scroll offsets
; Also tracking
* {{bug|537787}} - e10s: Remote WebSockets


== Test Areas ==
== Test Areas ==
Line 49: Line 77:
|}
|}


Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=306 Fennec 7.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.


Results details can be found in [https://wiki.mozilla.org/QA/Fennec/Waverley#Results Waverley's results wiki].
Results details can be found in [https://wiki.mozilla.org/QA/Fennec/Waverley#Results Waverley's results wiki].


=== BFTs for 6.0 Features ===
=== BFTs for 7.0 Features ===
{|width=100%
{|width=100%
|-
|-
Line 65: Line 93:
|}
|}


BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6 Test Suite].  
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=306 Fennec 7 Test Suite].  


Results details can be found in [[QA/Fennec/Waverley#Results|Waverley's results wiki]].
Results details can be found in [[QA/Fennec/Waverley#Results|Waverley's results wiki]].

Latest revision as of 23:31, 23 September 2011

Fennec 7.0 Beta Test Plan

« Milestones | Fennec 7.0 Beta | » Fennec 7.0 Beta 1

Overview

The goal of this Overall Test Plan is to lay out our testing strategy, determine who will own certain test areas and when they will do it and, finally, track the status. All of our releases are tested off of the "Fennec 7.0 Beta Catch-All Test Run" on the Litmus TCM. For more information about Fennec 7.0, take a look at the mobile team's Feature Planning page.

Project contacts

PM: Thomas Arend (tarend)
Dev: Lead: Mark Finkle (mfinkle)
Build: John Oduinn (joduinn)
QA: Aaron Train (aaronmt)

Schedule

  • Start Date: 8/16/2011
  • End Date: 9/27/2011

Bugs in Release

Beta Testplans

« Milestones | Fennec 7.0 Beta | » Fennec 7.0 Beta 1

Build Location and IDs

  1. Go to the candidates folder in our ftp directory
  2. Go to the "latest-mozilla-beta" folder
  3. Download and install the latest 7.0b-candidate build onto your Android phone/device

Features Enabled

Feature Status Owner
7/7+ Bug List

New Features in Fennec 7.0/7.0+: Bug List

Also tracking

Test Areas

Smoketests

QA Task Person/Group How Often?
Smoketests Waverley Once

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 7.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Results details can be found in Waverley's results wiki.

BFTs for 7.0 Features

QA Task Person/Group How Often?
BFTs Waverley Once

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6. Tests are available on litmus under the Fennec 7 Test Suite.

Results details can be found in Waverley's results wiki.

Crasher Triage

QA Task Person/Group How Often?
Crasher Triage mw22 / nhirata Daily

Socorro is Mozilla's primary web interface for triaging crash reports sent in by our user base. Due to the relatively large amount of changes coming in on a nightly basis, there is a need to check for crash reports coming in for every build. The owner of this task will triage through top crashers on a daily basis, file bugs if necessary and find steps to reproduce for those crashers if possible.

Device Compatibility

QA Task Person/Group How Often?
Device Compatibility AaronMT Once

As part of our testing strategy, we will want to verify device compatibility checking for regressions or major issues in Firefox by running through our compatibility criteria spreadsheet . Mobile users can also contribute towards device qualifying by submitting feedback via our untested device survey.

Website Compatibility

QA Task Person/Group How Often?
Website Compatibility Aaronmt Once

As part of our testing cycle we want to cover and include a general testing process that focuses on website compatibility with sites viewed in mobile Firefox. We want you to use mobile Firefox to assist us in identifying any noticeably major issues found in websites. Issues can range from pages that do not look right, layout and positioning problems, interactivity issues, font issues and pages that greatly differ from browser to browser and what you would expect. You can help us by completing a website exploration form here, and following the companion instructional test-plan.

Testday

QA Task Person/Group How Often?
Testday kbrosnan Once

To continue determining better quality metrics, we'll want to work with our community to find new bugs and performance/stability metrics through the use of a Testday once per cycle per channel (i.e. nightly and beta). The QA owner for this task will send announcements, create a testplan, moderate the channel and post results for the Testday. To see when the next testday is schedule, please take a look at the Test_Days wiki.

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/Milestones/7.0/Beta&oldid=350921"