QA/Fennec/Milestones/6.0/RC 1: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 6.0
Jump to navigation Jump to search
No edit summary
 
(7 intermediate revisions by 2 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
<small>[[QA/Fennec/Milestones/6.0/Beta_6|« Fennec:fx6b6]] | [[QA/Fennec/Milestones/6.0/RC_1|» Fennec:fx6rc1]] | [[QA/Fennec/Milestones/6.0/RC_2|» Fennec:fx6rc2]] </small>
<small>[[QA/Fennec/Milestones/6.0/Beta_5|« Fennec:fx6b5]] | [[QA/Fennec/Milestones/6.0/Beta_6|Fennec:fx6b6]] | [[QA/Fennec/Milestones/6.0/RC_1|» Fennec:fx6rc1]] </small>


= Fennec 6.0 Beta Test Plan =
= Fennec 6.0 Beta Test Plan =
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Mobile Firefox mobile 6]
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Mobile Firefox mobile 6]
* Release: Thursday Aug 11th
* Release: Tuesday  Aug 16th
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]
* QA Contact: [mailto:kbrosnan@mozilla.com Kevin Brosnan]
* IRC: irc://irc.mozilla.org#qa kbrosnan
* IRC: irc://irc.mozilla.org#qa kbrosnan
* Builds: [ftp://ftp.mozilla.org/pub/mobile/candidates/6.0-candidates/ Firefox 6.0] | [http://hg.mozilla.org/releases/mozilla-beta/rev/FENNEC_6_0b6_RELEASE changeset] | [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FIREFOX_6_0b5_RELEASE&tochange=FENNEC_6_0b6_RELEASE pushlog]
* Builds: [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/6.0-candidates/ Firefox 6.0]  


=== Smoketests ===
=== Smoketests ===
{{:QA/Fennec/Milestones/6.0/smoketests-results}}
{{:QA/Fennec/Milestones/6.0/RC_1/smoketests-results}}
[[QA/Fennec/Milestones/6.0/smoketests-results|Detailed Smoketest results]]
[[QA/Fennec/Milestones/6.0/RC_1/smoketests-results|Detailed Smoketest results]]


Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.


=== BFTs for 6.0 Features ===
=== BFTs for 6.0 Features ===
{{:QA/Fennec/Milestones/6.0/BFT-results|BFT results}}
{{:QA/Fennec/Milestones/6.0/RC_1/BFT-results|BFT results}}
[[QA/Fennec/Milestones/6.0/BFT-results|Detailed BFT results]]
[[QA/Fennec/Milestones/6.0/RC_1/BFT-results|Detailed BFT results]]


BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6 Test Suite].
BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6.  Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=300 Fennec 6 Test Suite].
Line 23: Line 23:
=== Virtual Machines ===
=== Virtual Machines ===
Verify tests against the following devices - smoketest and BFTs
Verify tests against the following devices - smoketest and BFTs
{{:QA/Fennec/Milestones/6.0/VM-results|VM results}}
{{:QA/Fennec/Milestones/6.0/RC_1/VM-results|VM results}}
[[QA/Fennec/Milestones/6.0/VM-results|Detailed VM results]]
[[QA/Fennec/Milestones/6.0/RC_1/VM-results|Detailed VM results]]


=== Bug Fixes ===
=== Bug Fixes ===
Line 31: Line 31:
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686267&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&target_milestone=Firefox%206&product=Fennec Fennec resolved fixed bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686267&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&target_milestone=Firefox%206&product=Fennec Fennec resolved fixed bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686277&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Widget%3A%20Android&target_milestone=mozilla6&product=Core Widget: Android bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686277&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Widget%3A%20Android&target_milestone=mozilla6&product=Core Widget: Android bugs]
Mobile bugs fixed in this release
* {{Bug|669289}}
* {{Bug|676780}}


'''Issues Found/Reopened Bugs'''
'''Issues Found/Reopened Bugs'''
*{{Bug|676780}} - Fennec is unable to load webpages and close tabs


=== Exploratory Testing ===
=== Exploratory Testing ===
Spend time interacting with the session restore. See how the fixes interact with the Start Page setting {Firefox start, Blank, Current Page} in the preferences. Check how those preferences interact with changing language, installing extensions that need a restart, using Quit Fennec extension, etc.
Spend time testing the release canidate builds on as many devices as possible. Work through the [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdEJFZ3NoZkRoRTM3TTRpQll3UjZLYnc&hl=en_US#gid=0 top site tests].


=== Web Content Review ===
=== Web Content Review ===

Latest revision as of 11:12, 12 August 2011

« Fennec:fx6b5 | Fennec:fx6b6 | » Fennec:fx6rc1

Fennec 6.0 Beta Test Plan

Smoketests

Assigned Device Status
Andreea Android Completed - August 12th
Andreea Maemo - N900 Completed - August 12th
Andreea Tablet Completed - August 12th

Detailed Smoketest results

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 6.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

BFTs for 6.0 Features

Assigned Device Status
Anna, Cristian, Catalin Android: Devices: Motorola Droid 2 (Android 2.2), HTC Desire Z (Android 2.3), HTC Desire (Android 2.2) Completed, August 12th

Detailed BFT results

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 6. Tests are available on litmus under the Fennec 6 Test Suite.

Virtual Machines

Verify tests against the following devices - smoketest and BFTs

Assigned Device Status
Andreea HTC Evo 4G Completed - August 12th
Andreea Xperia Play Completed - August 12th

Detailed VM results

Bug Fixes

Work includes wrapping up bug verifications from the Aurora channel. There are no specific beta bug fixes in this first release.

Issues Found/Reopened Bugs

  • bug 676780 - Fennec is unable to load webpages and close tabs

Exploratory Testing

Spend time testing the release canidate builds on as many devices as possible. Work through the top site tests.

Web Content Review

Review web content prepared for the release. Make sure that the bugs fixed in the release are noted and that version numbers through the document are correct. Read through the document and look for other inconsistencies.

Signoff on update/install

After Firefox is released to the Android market verify that updating and installing Firefox mobile works on several devices. Send an email to release drivers on completion of this work.

Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/Milestones/6.0/RC_1&oldid=339091"