MozillaWiki

QA/Fennec/Milestones/7.0/Beta/Beta 3: Difference between revisions

< QA‎ | Fennec‎ | Milestones‎ | 7.0‎ | Beta
(Created page with "__NOTOC__ <small>« Fennec 7.0 Beta 2 | Fennec 7.0 Beta 3 | [[QA/Fennec/Milestones/7.0/Beta/Beta...")
 
 
(10 intermediate revisions by the same user not shown)
Line 4: Line 4:
= Fennec 7.0 Beta 3 Test Plan =
= Fennec 7.0 Beta 3 Test Plan =
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_7:_Mobile Firefox Mobile 7.0]
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_7:_Mobile Firefox Mobile 7.0]
* Release: TBD
* Release: August 31st, 2011
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]
* IRC: irc://irc.mozilla.org#qa AaronMT
* IRC: irc://irc.mozilla.org#qa AaronMT
Line 15: Line 15:
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=306 Fennec 7.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=306 Fennec 7.0 Test Suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.


=== BFTs for 7.0 Features ===
=== L10N Spot Checks ===
{{:QA/Fennec/Milestones/7.0/Beta/Beta_2/BFT-results|BFT results}}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
[[QA/Fennec/Milestones/7.0/Beta/Beta_2/BFT-results|Detailed BFT results]]
{{:QA/Fennec/Milestones/7.0/Beta/Beta_3/L10N matrix}}
[[QA/Fennec/Milestones/7.0/Beta/Beta_3/L10N matrix|Detailed L10N matrix]]


BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 7. Tests are available on litmus under the [https://litmus.mozilla.org/run_tests.cgi?test_run_id=306 Fennec 7 Test Suite].
=== Bug Fixes  ===
{{bug|682927}} - Dis-trust DigiNotar root certificate
{{bug|682073}} - AndroidBridge uses wrong method for calling setClipboardText
*[https://bugzilla.mozilla.org/buglist.cgi?list_id=686267&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&target_milestone=Firefox%207&product=Fennec Fennec RESOLVED FIXED bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?list_id=686277&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Widget%3A%20Android&target_milestone=mozilla7&product=Core Widget: Android RESOLVED FIXED bugs]
*[https://bugzilla.mozilla.org/buglist.cgi?order=Bug%20Number&type0-1-0=equals&field0-1-0=cf_status_firefox7&field0-0-0=cf_blocking_fennec&resolution=---&resolution=FIXED&resolution=INVALID&resolution=WONTFIX&resolution=DUPLICATE&resolution=WORKSFORME&resolution=INCOMPLETE&resolution=SUPPORT&resolution=EXPIRED&resolution=MOVED&query_format=advanced&value0-1-0=fixed&type0-0-0=equals&value0-0-0=7%2B Tracking Firefox 7, FIXED]<br>


=== Virtual Machines ===
'''Issues Found/Reopened Bugs'''
Verify tests against the HTC Incredible 2 and Samsung SGH-T959 Vibrant or Galaxy S  - Smoketests and BFTs
*
{{:QA/Fennec/Milestones/7.0/Beta/Beta_3/VM-results|VM results}}
 
[[QA/Fennec/Milestones/7.0/Beta/Beta_3/VM-results|Detailed VM results]]
=== Exploratory Testing re: Diginotar  ===
 
Spend time testing the release candidate builds on as many devices as possible.
 
[https://docs.google.com/spreadsheet/ccc?pli=1&key=0AtLNtYDDyKsudG1lc2xmRDZRNTBkdXR1M0gzelZ3MkE&hl=en_GB#gid=0 List of vulnerable sites]  


=== Bug Fixes ===
The following should be untrusted
Work includes wrapping up bug verifications from the Aurora channel. There are no specific beta bug fixes in this first release.


* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686267&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&target_milestone=Firefox%207&product=Fennec Fennec resolved fixed bugs]
{| class="fullwidth-table"
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=686277&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Widget%3A%20Android&target_milestone=mozilla7&product=Core Widget: Android bugs]
|- style="background-color: #efefef;"
| site
| result
|-
| https://www.diginotar.nl
| UNTRUSTED
|-
| https://www.diginotar.nl/Portals/0/Extrance.txt
| UNTRUSTED
|-
| https://zga-tag.zorggroep-almere.nl
| UNTRUSTED
|-
| https://www.diginotar.nl/Aanvragen/AanvragenCertificaten/tabid/1139/Default.aspx
| UNTRUSTED
|-
| https://mozilla.org  
| UNTRUSTED cert for *.mozilla.org
|}


'''Issues Found/Reopened Bugs'''
Test a variety of other SSL sites:
*
 
{| class="fullwidth-table"
|- style="background-color: #efefef;"
| site
| result
|-
| https://www.paypal.com
| PASS
|-
| https://bankieren.rabobank.nl/
| PASS
|-
| https://www.freo.nl
| PASS
|-
| https://www.usaa.com
| PASS
|-
| https://www.ebay.com
| PASS
|-
| https://plus.google.com
| PASS
|-
| http://www.google.com
| PASS
|-
| http://facebook.com
| PASS
|-
| http://twitter.com
| PASS
|-
| other ssl sites
| <br>
|}

Latest revision as of 17:48, 31 August 2011

« Fennec 7.0 Beta 2 | Fennec 7.0 Beta 3 | » Fennec 7.0 Beta 4

Fennec 7.0 Beta 3 Test Plan

Smoketests

Assigned Device Completed
Ioana Android 2.3 (Phone) Completed - PASS- August, 31st
Ioana Android 3.1 (Tablet) Completed - PASS- August, 31st
Andreea Maemo (N900) Completed - PASS- August, 31st
Andreea Android 2.2 (Phone) Completed - PASS- August, 31st

Detailed Smoketest results

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 7.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

L10N Spot Checks

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Assigned Device Completed
Naoki Android signoff

Detailed L10N matrix

Bug Fixes

bug 682927 - Dis-trust DigiNotar root certificate
bug 682073 - AndroidBridge uses wrong method for calling setClipboardText

Issues Found/Reopened Bugs

Exploratory Testing re: Diginotar

Spend time testing the release candidate builds on as many devices as possible.

List of vulnerable sites

The following should be untrusted

site result
https://www.diginotar.nl UNTRUSTED
https://www.diginotar.nl/Portals/0/Extrance.txt UNTRUSTED
https://zga-tag.zorggroep-almere.nl UNTRUSTED
https://www.diginotar.nl/Aanvragen/AanvragenCertificaten/tabid/1139/Default.aspx UNTRUSTED
https://mozilla.org UNTRUSTED cert for *.mozilla.org

Test a variety of other SSL sites:

site result
https://www.paypal.com PASS
https://bankieren.rabobank.nl/ PASS
https://www.freo.nl PASS
https://www.usaa.com PASS
https://www.ebay.com PASS
https://plus.google.com PASS
http://www.google.com PASS
http://facebook.com PASS
http://twitter.com PASS
other ssl sites
Retrieved from "https://wiki.allizom.org/index.php?title=QA/Fennec/Milestones/7.0/Beta/Beta_3&oldid=345316"