Firefox:Download Page:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 131: Line 131:
| '''FAIL'''
| '''FAIL'''
| '''FAIL'''
| '''FAIL'''
| '''PASS''' see detailed results
| '''PASS'''<br>see detailed results
|-
|-



Revision as of 20:54, 30 August 2007

Download Page Test Plan

Description of Release

Marketing wants to increase retention of Firefox downloads, and in order to accomplish this, they have redesigned the "Mozilla Download" pages on the three major platforms: Windows, Mac, and Linux. It is important that users of other browsers--especially IE, Safari, and Opera--are able to successfully:
1) See the custom-tailored, redirect page that lets them know how to download and install Firefox.
2) Download Firefox both with and without JavaScript enabled.

Bugs fixed:

Bug 392362 - Download link on front page does not redirect for Safari and IE
Bug 393265 - Download links on mozilla.com cause problems for Safari 2.0.x on OSX

See http://wiki.mozilla.org/User:Clouserw/DownloadProposal for more information.

Specific Test Plan for this Release

QA will run each browser listed on the "Browser Testing Matrix," below, on the platforms noted, with a careful eye not only for functionality of the webpages, but also their appearance, ensuring that the copy is grammatically correct (once per platform, since the pages served are the same).

Results will be reported in the Test Results section, below, and its report will be the chief deciding factor on whether to push live.

Test this with JavaScript enabled (default setting for all browsers):
1. With the default settings for the particular browser, visit "Download Firefox" URL (https://www.trunk.stage.mozilla.com/en-US/).
2. Click on the "Download Firefox - Free" green button.
3. Ensure that it:

  • Redirects you to a page specific to your operating system, with screenshots appropriate for the given OS, as well as all instructions. Check spelling and grammar of said page.
  • Pops up an "Opening Firefox 2.0.0.6[file extension]" dialog, which allows you to save the binary/package to disk.

4. If the above doesn't work--no auto-propogated downloads dialog comes up--(THIS SHOULD WORK; REPORT THIS IF IT DOESN'T, BUT...) verify that clicking on the link" portion in

"Your download will begin shortly... If your download does not start after a few seconds, use this link."

spawns the "Opening Firefox 2.0.0.6[file extension]" with the latest appropriate build of Firefox for your operating system.

5. Otherwise, verify that it saves successfully, and you can run the installer without errors (you don't have to install).

Test this with JavaScript disabled on only the P1 browsers:
1. Disable JavaScript for your particular browser.
2. Visit the specific "Download Firefox" URL (https://www.trunk.stage.mozilla.com/en-US/) for which OS you signed up.
3. Click on the "Firefox for [specific OS]" link.
4. Verify that the "Opening Firefox 2.0.0.6[file extension]" dialog appears, which allows you to save the binary/package to disk.
5. Verify that it saves successfully, and you can run the installer without errors (you don't have to install).

Browser Testing Matrix

Windows XP SP2 Windows Vista Mac Linux
Firefox 1.5.12 + 2.0.0.6 P1 P1 P1 P1
Internet Explorer 7 P1 P1 N/A N/A
Internet Explorer 6 P1 N/A N/A N/A
Opera 9 P2 P2 P2 P2
Safari 2.0.4 P1 P1 P1 N/A
Flock 0.9 P2 P2 P2 P2

Schedule

Test Results

Make sure to include both "JS-enabled" and "JS-disabled" results in the "Detailed Test Results." section

Windows XP SP2 (stephend) Windows Vista (stephend) Mac (juanb) Linux (ashughes)
Firefox 1.5.x, 2.0.x . PASS . PASS PASS
see detailed results
Internet Explorer 7 . PASS N/A N/A
Internet Explorer 6 . N/A N/A N/A
Opera 9 . FAIL FAIL PASS
see detailed results
Safari 2.0.4 . FAIL . N/A
Flock 0.9 . PASS . .

Detailed Test Results

Vista

  • Internet Explorer 7, Vista, stephend, PASS (I set security to "High," since it seems impossible to disable JavaScript).
  • Flock 0.9.2, Vista, stephend, PASS, both JS enabled and disabled
  • Opera 9.23, Vista, stephend, FAIL, both JS enabled and disabled
  • Firefox 2.0.0.6, Vista, stephend, PASS, both JS enabled and disabled
  • Firefox 1.5.0.12, Vista, stephend, PASS, both JS enabled and disabled
  • Safari 3.0 beta, Vista, stephend, FAIL - "Safari can’t open the page “https://www.trunk.stage.mozilla.com/” because it couldn’t establish a secure connection to the server “www.trunk.stage.mozilla.com”."

Mac

  • Fx 15012, 2006, Javascript/No Javascript, juanb: PASS
  • Opera 9.23, Javascript, juanb: FAIL
    • Steps 1 has an image of a download dialog in Safari, as opposed to Opera. Stephend filing bug.
  • Opera 9.23, No Javascript, juanb: Pass

Linux

Firefox

  • Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.6 - Build: 2007072517 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.5 - Build: 2007071317 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.5 - Build: 2007071317 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.4 - Build: 2007051502 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.4 - Build: 2007051502 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.3 - Build: 2007030916 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.3 - Build: 2007030916 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.2 - Build: 2007022001 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.2 - Build: 2007022001 - Javascript: OFF - Result: PASS
  • Firefox 2.0.0.1 - Build: 2006120814 - Javascript: ON - Result: PASS
  • Firefox 2.0.0.1 - Build: 2006120814 - Javascript: OFF - Result: PASS
  • Firefox 2.0 - Build: 2006101022 - Javascript: ON - Result: PASS
  • Firefox 2.0 - Build: 2006101022 - Javascript: OFF - Result: PASS
  • Firefox 1.5.0.12 - Build: 2007050813 - Javascript: ON - Result: PASS
  • Firefox 1.5.0.12 - Build: 2007050813 - Javascript: OFF - Result: PASS
  • Firefox 1.5 - Build: 2005111116 - Javascript: ON - Result: PASS
  • Firefox 1.5 - Build: 2005111116 - Javascript: OFF - Result: PASS

Opera

  • Version: 9.23 - Javascript: ON - Result: PASS
  • Version: 9.23 - Javascript: OFF - Result: PASS

Associated Documentation

Will Clouser's Download Proposal