QA/Fennec/Milestones/7.0/Beta/Beta 4: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 7.0‎ | Beta
Jump to navigation Jump to search
 
(9 intermediate revisions by 2 users not shown)
Line 4: Line 4:
= Fennec 7.0 Beta 4 Test Plan =
= Fennec 7.0 Beta 4 Test Plan =
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_7:_Mobile Firefox Mobile 7.0]
* Current Milestone: [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_7:_Mobile Firefox Mobile 7.0]
* Release: September 1st, 2011
* Release: September 6th, 2011
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]
* IRC: irc://irc.mozilla.org#qa AaronMT
* IRC: irc://irc.mozilla.org#qa AaronMT
Line 17: Line 17:
=== Bug Fixes  ===
=== Bug Fixes  ===


'''7.0b4<br>'''Single changeset (6791db28b82f)'''-- http://hg.mozilla.org/releases/mozilla-beta/rev/6791db28b82f'''
'''7.0 Beta 4 Build 1 to 7.0 Beta 4 Build 2''' [http://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_7_0b4_BUILD1&tochange=FENNEC_7_0b4_BUILD2 pushlog changes]
 
  {{bug|683449}} - DigiNotar patch erroneously blocks one of the two Staat der Nederlanden roots
  {{bug|683449}} - DigiNotar patch erroneously blocks one of the two Staat der Nederlanden roots
 
{{bug|683883}} - Improve DigitNotarGate handling in PSM
*[https://bugzilla.mozilla.org/buglist.cgi?list_id=686267&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&target_milestone=Firefox%207&product=Fennec Fennec RESOLVED FIXED bugs]
{{bug|683261}} - Better coverage for DigiNotarGate in NSS
*[https://bugzilla.mozilla.org/buglist.cgi?list_id=686277&resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Widget%3A%20Android&target_milestone=mozilla7&product=Core Widget: Android RESOLVED FIXED bugs]
{{bug|669792}} - gov.uk is not considered to be a public suffix
*[https://bugzilla.mozilla.org/buglist.cgi?order=Bug%20Number&type0-1-0=equals&field0-1-0=cf_status_firefox7&field0-0-0=cf_blocking_fennec&resolution=---&resolution=FIXED&resolution=INVALID&resolution=WONTFIX&resolution=DUPLICATE&resolution=WORKSFORME&resolution=INCOMPLETE&resolution=SUPPORT&resolution=EXPIRED&resolution=MOVED&query_format=advanced&value0-1-0=fixed&type0-0-0=equals&value0-0-0=7%2B Tracking Firefox 7, FIXED]<br>
 
'''Issues Found/Reopened Bugs'''  
'''Issues Found/Reopened Bugs'''  
*
*


Line 43: Line 39:
|-
|-
| https://www.diginotar.nl  
| https://www.diginotar.nl  
|
| '''UNTRUSTED''': sec_error_revoked_certificate
|-
|-
| https://www.diginotar.nl/Portals/0/Extrance.txt  
| https://www.diginotar.nl/Portals/0/Extrance.txt  
|
| '''UNTRUSTED''': sec_error_revoked_certificate
|-
|-
| https://zga-tag.zorggroep-almere.nl  
| https://www.diginotar.nl/Aanvragen/AanvragenCertificaten/tabid/1139/Default.aspx
|
| '''UNTRUSTED''': sec_error_revoked_certificate
|-
|-
| https://www.diginotar.nl/Aanvragen/AanvragenCertificaten/tabid/1139/Default.aspx
| https://sf.net
|
| '''UNTRUSTED''': ssl_error_bad_cert_domain
|-
|-
| https://mozilla.org  
| https://cacert.org
|
| '''UNTRUSTED''': ssl_error_unknown_issuer
|}
|}


Line 66: Line 62:
|-
|-
| https://www.paypal.com  
| https://www.paypal.com  
|
| '''PASS'''
|-
|-
| https://bankieren.rabobank.nl/
| https://bankieren.rabobank.nl/
|
| '''PASS'''
|-
|-
| https://www.freo.nl  
| https://www.freo.nl  
|
| '''PASS'''
|-
|-
| https://www.usaa.com  
| https://www.usaa.com  
|
| '''PASS'''
|-
|-
| https://www.ebay.com  
| https://www.ebay.com  
|
| '''PASS'''
|-
|-
| https://plus.google.com  
| https://plus.google.com  
|
| '''PASS'''
|-
|-
| http://www.google.com  
| http://www.google.com  
|
| '''PASS'''
|-
|-
| http://facebook.com  
| http://facebook.com  
|
| '''PASS'''
|-
|-
| http://twitter.com  
| http://twitter.com  
|
| '''PASS'''
|-
|-
| Other SSL Sites
| other ssl sites
| <br>
| <br>
|}
|}

Latest revision as of 17:44, 6 September 2011

« Fennec 7.0 Beta 3 | Fennec 7.0 Beta 4 | » Fennec 7.0 Beta 5

Fennec 7.0 Beta 4 Test Plan

Smoketests

Assigned Device Completed
Ioana Android 2.3 (Phone) Completed, September 5th
Ioana Android 3.1 (Tablet) Completed, September 5th

Detailed Smoketest results

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 7.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Bug Fixes

7.0 Beta 4 Build 1 to 7.0 Beta 4 Build 2 pushlog changes

bug 683449 - DigiNotar patch erroneously blocks one of the two Staat der Nederlanden roots
bug 683883 - Improve DigitNotarGate handling in PSM
bug 683261 - Better coverage for DigiNotarGate in NSS
bug 669792 - gov.uk is not considered to be a public suffix

Issues Found/Reopened Bugs

Exploratory Testing re: Diginotar

Spend time testing the release candidate builds on as many devices as possible.

List of vulnerable sites

The following should be untrusted

site result
https://www.diginotar.nl UNTRUSTED: sec_error_revoked_certificate
https://www.diginotar.nl/Portals/0/Extrance.txt UNTRUSTED: sec_error_revoked_certificate
https://www.diginotar.nl/Aanvragen/AanvragenCertificaten/tabid/1139/Default.aspx UNTRUSTED: sec_error_revoked_certificate
https://sf.net UNTRUSTED: ssl_error_bad_cert_domain
https://cacert.org UNTRUSTED: ssl_error_unknown_issuer

Test a variety of other SSL sites:

site result
https://www.paypal.com PASS
https://bankieren.rabobank.nl/ PASS
https://www.freo.nl PASS
https://www.usaa.com PASS
https://www.ebay.com PASS
https://plus.google.com PASS
http://www.google.com PASS
http://facebook.com PASS
http://twitter.com PASS
other ssl sites