QA/Fennec/Milestones/5.0b6: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones
Jump to navigation Jump to search
No edit summary
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
<small>[[QA/Fennec/Milestones/5.0b5|« Fennec:fx5b5]] | [[QA/Fennec/Milestones/5.0b6|Fennec:fx5b6]] | [[QA/Fennec/Milestones/5.0rc| Fennec:fx5rc »]] </small>
<small>[[QA/Fennec/Milestones/5.0b5|« Fennec:fx5b5]] | [[QA/Fennec/Milestones/5.0b6|Fennec:fx5b6]] | [[QA/Fennec/Milestones/5.0b7| Fennec:fx5b7 »]] </small>


= Fennec 5.0 Beta Test Plan =
= Fennec 5.0 Beta Test Plan =
Line 8: Line 8:
* IRC: irc://irc.mozilla.org#qa kbrosnan
* IRC: irc://irc.mozilla.org#qa kbrosnan
* Builds: [ftp://ftp.mozilla.org/pub/mobile/candidates/5.0b6-candidates/ Firefox 5.0b6] | [http://hg.mozilla.org/releases/mozilla-mobile-5.0/rev/FENNEC_5_0b6_BUILD1 changeset] | [http://hg.mozilla.org/releases/mozilla-mobile-5.0/pushloghtml?fromchange=FENNEC_5_0b5_BUILD1&tochange=FENNEC_5_0b6_BUILD1 pushlog]
* Builds: [ftp://ftp.mozilla.org/pub/mobile/candidates/5.0b6-candidates/ Firefox 5.0b6] | [http://hg.mozilla.org/releases/mozilla-mobile-5.0/rev/FENNEC_5_0b6_BUILD1 changeset] | [http://hg.mozilla.org/releases/mozilla-mobile-5.0/pushloghtml?fromchange=FENNEC_5_0b5_BUILD1&tochange=FENNEC_5_0b6_BUILD1 pushlog]
* [[QA/Fennec/Milestones/5.0b6#Smoketests|Firefox mobile smoketests]]
* [[QA/Fennec/Milestones/5.0b6#Smoketests|Firefox mobile basic functional tests (BFT)]]
* [[QA/Fennec/Milestones/5.0b6#Features_Exploratory_Testing|Bug fix exploratory testing]]
* [[QA/Fennec/Milestones/5.0b6#Bug_Fixes|Validating fixes]]
* [[QA/Fennec/Milestones/5.0b6#L10N_Spot_Checks|L10N spot checks]]
* [[QA/Fennec/Milestones/5.0b6#Website_Sign-off|Website signoff]]
* [[QA/Fennec/Milestones/5.0b6#Update_Testing|Update Testing]]


= Current Cycle =
= Current Cycle =
Line 47: Line 39:
Identify the feature, description of the testing you performed, the device you tested on and any bugs filed
Identify the feature, description of the testing you performed, the device you tested on and any bugs filed


; See the L10N section
; SSL testing
* Mozilla public wifi
* Visit https:// page
* Authenticate via the captive portal
* reboot the phone
Tested going to https://mail.google.com, https://touch.facebook.com, https://wiki.mozilla.org, https://paypal.com (ev-ssl) and https://cacert.org (untrusted ca)
 
Verified Larry info was correct for each site and that each favicon was assigned the correct color background.
 
* results - all sites passed


=== Bug Fixes ===
=== Bug Fixes ===
Line 60: Line 61:
=== L10N Spot Checks ===
=== L10N Spot Checks ===
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/Milestones/5.0b6/L10N matrix}}
{{:QA/Fennec/Milestones/5.0rc/L10N matrix}}
[[QA/Fennec/Milestones/5.0b6/L10N matrix|Detailed L10N matrix]]
[[QA/Fennec/Milestones/5.0rc/L10N matrix|Detailed L10N matrix]]


=== Website Sign-off ===
=== Website Sign-off ===
Review website copy for error and suggest items that should make the release notes/known issues
Review website copy for error and suggest items that should make the release notes/known issues
'''No changes planned


=== Update Testing ===
=== Update Testing ===
Once the build is live on the Android market test that updating and installing works on a variety of devices and Android OS versions. Once the update is complete upgrading should preserve the users profile settings.
Once the build is live on the Android market test that updating and installing works on a variety of devices and Android OS versions. Once the update is complete upgrading should preserve the users profile settings.

Latest revision as of 05:17, 16 June 2011

« Fennec:fx5b5 | Fennec:fx5b6 | Fennec:fx5b7 »

Fennec 5.0 Beta Test Plan

Current Cycle

The current cycle for Firefox mobile beta is focused on stabilizing for release and verifying fixes that will ship with Firefox 5.

Sign off

Test results:


Bugs found:

  • Track using [fennec5.0b6] in the whiteboard

Milestone: Firefox mobile 5.0b6

Builds: ftp://ftp.mozilla.org/pub/mobile/candidates/5.0b6-candidates/

Known Issues: The following issues are already known and should not be reported again

  • bug 628269 - Pages are zoomed in at reload
  • bug 639504 - Unable to zoom in/out a webpage on header/footer when a double tap gesture is made

Smoketests

Smoketests cover broad areas of testing for Firefox mobile. These represent core functions of the browser. Any failures during the smoketest should be addressed before continuing with the other testing.

Assigned Device Completed
Ioana Android 2.3 Nexus S June 14th
Ioana N900 June 14th

Detailed Smoketest results

BFT

Basic functional tests cover specific features and ensure continued quality.

Assigned Device Completed
Anna, Andreea & Nicolae Android 2.2 June 14

Detailed BFT results

Features Exploratory Testing

Identify the feature, description of the testing you performed, the device you tested on and any bugs filed

SSL testing
  • Mozilla public wifi
  • Visit https:// page
  • Authenticate via the captive portal
  • reboot the phone

Tested going to https://mail.google.com, https://touch.facebook.com, https://wiki.mozilla.org, https://paypal.com (ev-ssl) and https://cacert.org (untrusted ca)

Verified Larry info was correct for each site and that each favicon was assigned the correct color background.

  • results - all sites passed

Bug Fixes

Verify the bug fixes which landed for this beta cycle.

  • bug 650858 - Instantiating nsICertOverrideService at startup throws NS_ERROR_XPC_GS_RETURNED_FAILURE and makes Firefox unusable
  • bug 619201 - *Backout* nsCertOverrideService needs to initialize on the main thread to use the directory service

Additional changes that are picked up from Core/Toolkit can be found at the mobile pushlog.

Issues Found/Reopened Bugs

  • Placeholder

L10N Spot Checks

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Assigned Device Completed
nhirata Android Done

Detailed L10N matrix

Website Sign-off

Review website copy for error and suggest items that should make the release notes/known issues

No changes planned

Update Testing

Once the build is live on the Android market test that updating and installing works on a variety of devices and Android OS versions. Once the update is complete upgrading should preserve the users profile settings.