QA/Fennec/Milestones/6.0/Nightly: Difference between revisions

Jump to navigation Jump to search

QA/Fennec/Milestones/6.0/Nightly (view source)

Revision as of 03:07, 18 May 2011

5,029 bytes added ,  18 May 2011
→‎Fennec 6.0 Nightly Test Plan
Line 19: Line 19:


[https://bugzilla.mozilla.org/buglist.cgi?list_id=287763&resolution=FIXED&chfieldto=2011-05-24&query_format=advanced&chfield=resolution&chfieldfrom=2011-04-12&chfieldvalue=FIXED&component=Widget%3A%20Android&product=Core&target_milestone=mozilla6 Widget: Android bugs]
[https://bugzilla.mozilla.org/buglist.cgi?list_id=287763&resolution=FIXED&chfieldto=2011-05-24&query_format=advanced&chfield=resolution&chfieldfrom=2011-04-12&chfieldvalue=FIXED&component=Widget%3A%20Android&product=Core&target_milestone=mozilla6 Widget: Android bugs]
== Build Location and IDs ==
# Go to the [http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly nightly builds folder] in our ftp directory
# Go to the "latest-mozilla-central" folder
# Download and install the candidate onto your Android phone/device
== Test Areas ==
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Waverley
| Daily
|}
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=xxx Fennec 5.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Results details can be found in [https://wiki.mozilla.org/QA/Fennec/Waverley#Results Waverley's results wiki].
=== BFTs for 5.0 Features ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| BFTs
| Waverley
| Daily
|}
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=195 Fennec 2.0 Test Suite]. 
Results details can be found in the [[QA/Fennec/Waverley#Results|Waverley results wiki]]
=== OS Integration ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| OS Integration
| Waverley
| Weekly
|}
The OS Integration testsuite is a set of tests that encompass device-level and operating-system-level tests for the Android platform. In terms of criteria, they will determine a quality criteria for pass or failure of the system level characteristics of the application.
Results can be found in the [[QA/Fennec/Waverley|Waverley results wiki]].
=== Fixed Bugs Verifications ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Bug Verification
| Waverley
| Daily
|}
The following link contains a list of bugs that are fixed for 6.0 and need verifications: Fixed [https://bugzilla.mozilla.org/buglist.cgi?list_id=258704&field0-0-0=cf_blocking_fennec&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&bug_status=VERIFIED&type0-0-0=substring&value0-0-0=%2B&target_milestone=Firefox%205&target_milestone=mozilla5 Firefox Mobile 5.0a2 bugs] (even verified bugs) should be checked to make sure the fix landed in the Mobile-5.0 Aurora tree.
=== Crasher Triage ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Crasher Triage
| mw22
| Daily
|}
[http://crash-stats.mozilla.com/products/Fennec Socorro] is Mozilla's primary web interface for triaging crash reports sent in by our user base. Due to the relatively large amount of changes coming in on a nightly basis, there is a need to check for crash reports coming in for every build. The owner of this task will triage through top crashers on a daily basis, file bugs if necessary and find steps to reproduce for those crashers if possible.
=== Bug Triage ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Bug Triage
| MoCo Team
| Weekly
|}
On average, the "Fennec" product in Bugzilla receives 30-40 bugs filed every week. The QA-Mobile team will be triaging through those bugs on a weekly basis on Mondays at 9am Pacific. The bug query used is [https://bugzilla.mozilla.org/buglist.cgi?emailtype2=exact&list_id=285289&field0-0-0=cf_blocking_fennec&chfieldto=Now&query_format=advanced&chfield=[Bug%20creation]&chfieldfrom=-1w&bug_status=UNCONFIRMED&bug_status=NEW&email2=nobody%40mozilla.org&emailassigned_to2=1&type0-0-0=equals&value0-0-0=---&product=Fennec for non-triaged bugs filed over the past week].
=== Testday ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Testday
| kbrosnan
| Once
|}
To continue determining better quality metrics, we'll want to work with our community to find new bugs and performance/stability metrics through the use of a Testday once per cycle per channel (i.e. nightly and beta). The QA owner for this task will send announcements, create a testplan, moderate the channel and post results for the Testday. To see when the next testday is schedule, please take a look at the [[QA/Test_Days#Upcoming_Schedule|Test_Days wiki]].
Kbrosnan
Confirmed users
1,180

edits

Retrieved from "https://wiki.allizom.org/Special:MobileDiff/309906"

Navigation menu