Confirmed users
9,511
edits
Firefox:Download Page:Test Plan: Difference between revisions
→Vista
(→Vista) |
|||
| (82 intermediate revisions by 4 users not shown) | |||
| Line 6: | Line 6: | ||
1) See the custom-tailored, redirect page that lets them know how to download and install Firefox.<br> | 1) See the custom-tailored, redirect page that lets them know how to download and install Firefox.<br> | ||
2) Download Firefox both with and without JavaScript enabled. | 2) Download Firefox both with and without JavaScript enabled. | ||
Bugs fixed: | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=393263 Bug 392362] - Download link on front page does not redirect for Safari and IE<br> | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=393265 Bug 393265] - Download links on mozilla.com cause problems for Safari 2.0.x on OSX | |||
See http://wiki.mozilla.org/User:Clouserw/DownloadProposal for more information. | See http://wiki.mozilla.org/User:Clouserw/DownloadProposal for more information. | ||
| Line 11: | Line 16: | ||
== Specific Test Plan for this Release == | == Specific Test Plan for this Release == | ||
QA will run each browser listed on the "Browser Testing Matrix," below, on the platforms noted, with a careful eye not only for functionality of the webpages, but also their appearance, ensuring that the copy is grammatically correct. | QA will run each browser listed on the "Browser Testing Matrix," below, on the platforms noted, with a careful eye not only for functionality of the webpages, but also their appearance, ensuring that the copy is grammatically correct (once per platform, since the pages served are the same). | ||
Results will be reported in the [http://wiki.mozilla.org/Firefox:Download_Page:Test_Plan#Test_Results Test Results] section, below, and its report will be the chief deciding factor on whether to push live. | Results will be reported in the [http://wiki.mozilla.org/Firefox:Download_Page:Test_Plan#Test_Results Test Results] section, below, and its report will be the chief deciding factor on whether to push live. | ||
Test this with '''JavaScript enabled''' (default setting for all browsers):<br> | Test this with '''JavaScript enabled''' (default setting for all browsers):<br> | ||
1. With the default settings for the particular browser, visit | 1. With the default settings for the particular browser, visit "Download Firefox" URL ('''https://www.trunk.stage.mozilla.com/en-US/''').<br> | ||
2. Click on the "Download Firefox - Free" green button.<br> | 2. Click on the "Download Firefox - Free" green button.<br> | ||
3. Ensure that it:<br> | 3. Ensure that it:<br> | ||
* Redirects you to a page specific to your operating system, with screenshots appropriate for the given OS, as well as all instructions. Check spelling and grammar of said page.<br> | * Redirects you to a page specific to your operating system, with screenshots appropriate for the given OS, as well as all instructions. Check spelling and grammar of said page.<br> | ||
* Pops up an "Opening Firefox 2.0.0.6[file extension]" dialog, which allows you to save the binary/package to disk.<br> | * Pops up an "Opening Firefox 2.0.0.6[file extension]" dialog, which allows you to save the binary/package to disk.<br> | ||
4. If the above doesn't work--no auto-propogated downloads dialog comes up--verify that clicking on the link" portion in <blockquote>"Your download will begin shortly... | 4. If the above doesn't work--no auto-propogated downloads dialog comes up--('''THIS SHOULD WORK; REPORT THIS IF IT DOESN'T, BUT...''') verify that clicking on the link" portion in <blockquote>"Your download will begin shortly... | ||
If your download does not start after a few seconds, use this link."</blockquote> spawns the "Opening Firefox 2.0.0.6[file extension]" with the latest appropriate build of Firefox for your operating system. | If your download does not start after a few seconds, use this link."</blockquote> spawns the "Opening Firefox 2.0.0.6[file extension]" with the latest appropriate build of Firefox for your operating system. | ||
5. Otherwise, verify that it saves successfully, and you can run the installer without errors (you don't have to install). | 5. Otherwise, verify that it saves successfully, and you can run the installer without errors (you don't have to install). | ||
| Line 27: | Line 32: | ||
Test this with '''JavaScript disabled''' on only the P1 browsers:<br> | Test this with '''JavaScript disabled''' on only the P1 browsers:<br> | ||
1. Disable JavaScript for your particular browser.<br> | 1. Disable JavaScript for your particular browser.<br> | ||
2. Visit the specific "Download Firefox" URL (''' | 2. Visit the specific "Download Firefox" URL ('''https://www.trunk.stage.mozilla.com/en-US/''') for which OS you signed up.<br> | ||
3. Click on the "Firefox for [specific OS]" link.<br> | 3. Click on the "Firefox for [specific OS]" link.<br> | ||
4. Verify that the "Opening Firefox 2.0.0.6[file extension]" dialog appears, which allows you to save the binary/package to disk.<br> | 4. Verify that the "Opening Firefox 2.0.0.6[file extension]" dialog appears, which allows you to save the binary/package to disk.<br> | ||
| Line 41: | Line 46: | ||
! Linux | ! Linux | ||
|- | |- | ||
| Firefox | | Firefox 1.5.12 + 2.0.0.6 | ||
| P1 | | P1 | ||
| Line 89: | Line 94: | ||
== Test Results == | == Test Results == | ||
'''Make sure to include both "JS-enabled" and "JS-disabled" results.''' | '''Make sure to include both "JS-enabled" and "JS-disabled" results in the "Detailed Test Results." section''' | ||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
! | ! | ||
! Windows XP SP2 | ! Windows XP SP2 (stephend) | ||
! Windows Vista | ! Windows Vista (stephend) | ||
! Mac | ! Mac (juanb) | ||
! Linux | ! Linux (ashughes) | ||
|- | |- | ||
| Firefox | | Firefox 1.5.x, 2.0.x | ||
| | | '''PASS''' | ||
| | | '''PASS''' | ||
| | | '''PASS''' | ||
| | | '''PASS'''<br>see detailed results | ||
|- | |- | ||
|- | |- | ||
| Internet Explorer 7 | | Internet Explorer 7 | ||
| | | '''PASS''' (certificate error) | ||
| | | '''PASS''' (certificate error) | ||
| '''N/A''' | | '''N/A''' | ||
| '''N/A''' | | '''N/A''' | ||
|- | |- | ||
| Internet Explorer 6 | | Internet Explorer 6 | ||
| | | '''PASS''' (certificate error) | ||
| '''N/A''' | | '''N/A''' | ||
| Line 123: | Line 128: | ||
|- | |- | ||
| Opera 9 | | Opera 9 | ||
| | | '''PASS''' | ||
| | | '''PASS''' | ||
| | | '''PASS*''' | ||
| | | '''PASS'''<br>see detailed results | ||
|- | |- | ||
| Safari 2.0.4 | | Safari 2.0.4 / 3.0 beta | ||
| . | | '''FAIL* 3.0''' | ||
| . | | '''FAIL* 3.0''' | ||
| | | '''PASS*''' | ||
| '''N/A''' | | '''N/A''' | ||
|- | |- | ||
| Flock 0.9 | | Flock 0.9 | ||
| | | '''PASS''' | ||
| | | '''PASS''' | ||
| | | '''PASS*''' | ||
| | | '''FAIL'''<br>see detailed results | ||
|} | |} | ||
== | == Detailed Test Results == | ||
Bugs/issues found: | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=394364 Bug 394364] - Missing certificate for *.mozilla.com subdomains<br> | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=394368 Bug 394368] - Linux "thanks for downloading" firefox page still shows old messenger bag<br> | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=394366 Bug 394366] - "Other Languages" link goes to raw 2.0.0.6 FTP directory | |||
[https://bugzilla.mozilla.org/show_bug.cgi?id=394370 Bug 394370] - Opera's download.html page doesn't have screenshots specific to Opera | |||
=== Windows XP SP2 === | |||
* Internet Explorer 7, XP SP2, stephend, '''FAIL''' (I set security to "High," since it seems impossible to disable JavaScript). | |||
* Flock 0.9.2, XP SP2, stephend, '''PASS''', both JS enabled and disabled | |||
* Opera 9.23, XP SP2, stephend, '''PASS''', both JS enabled and disabled | |||
** Screenshots aren't specific to Opera | |||
* Firefox 2.0.0.6, XP SP2, stephend, '''PASS''', both JS enabled and disabled | |||
* Firefox 1.5.0.12, XP SP2, stephend, '''PASS''', both JS enabled and disabled | |||
* Safari 3.0 beta, XP SP2, stephend, '''FAIL''' - "Safari can’t open the page “https://www.trunk.stage.mozilla.com/” because it couldn’t establish a secure connection to the server “www.trunk.stage.mozilla.com”." | |||
=== Vista === | |||
* Internet Explorer 7, Vista, stephend, '''PASS''' (I set security to "High," since it seems impossible to disable JavaScript). | |||
* Flock 0.9.2, Vista, stephend, '''PASS''', both JS enabled and disabled | |||
* Opera 9.23, Vista, stephend, '''PASS''', both JS enabled and disabled | |||
** Screenshots aren't specific to Opera | |||
* Firefox 2.0.0.6, Vista, stephend, '''PASS''', both JS enabled and disabled | |||
* Firefox 1.5.0.12, Vista, stephend, '''PASS''', both JS enabled and disabled | |||
* Safari 3.0 beta, Vista, stephend, '''FAIL''' - "Safari can’t open the page “https://www.trunk.stage.mozilla.com/” because it couldn’t establish a secure connection to the server “www.trunk.stage.mozilla.com”." | |||
=== Mac === | |||
* Fx 15012, 2006, Javascript/No Javascript, juanb: '''PASS''' | |||
* Opera 9.23, Javascript, juanb: '''PASS*''' | |||
** Steps 1 has an image of a download dialog in Safari, as opposed to Opera. Stephend filing bug. | |||
* Opera 9.23, No Javascript, juanb: '''PASS''' | |||
* Safari 2.0.4, Javascript, juanb: '''PASS''' | |||
* Safari 2.0.4, No Javascript, juanb: '''PASS*''' | |||
** I saw a certificate mismatch dialog come up, and if this is no problem for the real page, then the only other issues are cosmetic (Other Languages link takes you to an ftp download page). Stephend filing bugs. | |||
* Flock 0.9.0.2, Javascrip/No Javascript, juanb: '''PASS''' | |||
=== Linux === | |||
'''NOTE: Please see bug [https://bugzilla.mozilla.org/show_bug.cgi?id=394368 394368] for details.''' | |||
'''Firefox''' | |||
* Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.6 (Ubuntu Package) - Build: 2007073113 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.6 - Build: 2007072517 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.6 - Build: 2007072517 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.6 - Build: 2007072517 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.5 - Build: 2007071317 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.5 - Build: 2007071317 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.4 - Build: 2007051502 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.4 - Build: 2007051502 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.3 - Build: 2007030916 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.3 - Build: 2007030916 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.2 - Build: 2007022001 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.2 - Build: 2007022001 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0.0.1 - Build: 2006120814 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0.0.1 - Build: 2006120814 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 2.0 - Build: 2006101022 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 2.0 - Build: 2006101022 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 1.5.0.12 - Build: 2007050813 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 1.5.0.12 - Build: 2007050813 - Javascript: '''OFF''' - Result: '''PASS''' | |||
* Firefox 1.5 - Build: 2005111116 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Firefox 1.5 - Build: 2005111116 - Javascript: '''OFF''' - Result: '''PASS''' | |||
'''Opera''' | |||
* Version: 9.23 - Javascript: '''ON''' - Result: '''PASS''' | |||
* Version: 9.23 - Javascript: '''OFF''' - Result: '''PASS''' | |||
'''Flock''' | |||
* Version: 0.9.0.2 | |||
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/1185930370.13883 Firefox/2.0.0.6 Flock/0.9.0.2 | |||
** Javascript: '''ON''' - Result: '''PASS''' | |||
** Javascript: '''OFF''' - Result: '''PASS''' | |||