Firefox:2.0 QA Activities:SU Results: Difference between revisions
Jump to navigation
Jump to search
m (Reverted edit of Picklesworth Bluxo, changed back to last version by Rflint) |
|||
| (16 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
== Software Update Testing Results == | == Beta2 Software Update Testing Results == | ||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
| Line 14: | Line 14: | ||
| Alpha2 | | Alpha2 | ||
| | | | ||
| en-US fallback | | en-US fallback - marcia - '''PASS''' - see detail below | ||
| | | | ||
|- | |- | ||
| Line 22: | Line 22: | ||
| | | | ||
|- | |- | ||
| Beta1 (digg) | | Beta1 (digg) '''(No build available as of ship time)''' | ||
| One Tier 1 locale | | One Tier 1 locale | ||
| | | | ||
| Line 30: | Line 30: | ||
| | | | ||
| One Tier 1 locale (fr) - jay - PASS (3.1MB partial) | | One Tier 1 locale (fr) - jay - PASS (3.1MB partial) | ||
| One Tier 1 locale fallback | | One Tier 1 locale fallback - marcia - '''PASS''' (see details below) | ||
|- | |- | ||
|} | |} | ||
| Line 46: | Line 46: | ||
PPC Mac en-US [marcia] | PPC Mac en-US [marcia] | ||
Note there were two builds offered for Alpha1 | |||
* full betatest Alpha1 -> Beta2 - ''''''PASS for UB only'''''' | * full betatest Alpha1 -> Beta2 - ''''''PASS for UB only'''''' | ||
*Downloaded UB Build, '''PPC Build did not update''' | *Downloaded UB Build, '''PPC Build did not update''' | ||
* full betatest Alpha1 -> Beta2 - '''FAIL''' | * full betatest using UB Build Alpha1 -> Beta2 - '''FAIL''' | ||
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | **Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ||
| Line 62: | Line 63: | ||
* B1 (en-GB) -> B2 partial failover to full - Pass | * B1 (en-GB) -> B2 partial failover to full - Pass | ||
** Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ** Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ||
Intel mac en-US [marcia] | |||
* partial, betatest 2.0a2 -> 2.0b2 - '''PASS''' | |||
* failover to full, betatest, 2.0a2 -> 2.0b2 - '''PASS''' | |||
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | |||
Intelmac en-US [juanb] | Intelmac en-US [juanb] | ||
* partial, betatest 2.0b1 -> 2.0b2 - '''PASS''' | * partial, betatest 2.0b1 -> 2.0b2 - '''PASS''' | ||
* failover to full, betatest 2.0b1 -> 2.0b2 - '''PASS''' | * failover to full, betatest 2.0b1 -> 2.0b2 - '''PASS''' | ||
* failed failover-to-full, betatest 2.0b1 -> 2.0b2 - '''FAIL''' (bug 350804) | |||
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ||
| Line 75: | Line 82: | ||
* partial, betatest 2.0a1 -> 2.0.b2 - PASS | * partial, betatest 2.0a1 -> 2.0.b2 - PASS | ||
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2 | ||
Fedora Core Linux en-US [rob/marcia] | |||
* partial, betatest 2.0b1 -> 2.0.b2 - PASS | |||
** also tested failing partial and ensuring it got full - PASS | |||
**B | |||
== Notes and Issues Encountered == | == Notes and Issues Encountered == | ||
| Line 92: | Line 104: | ||
*https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1 | *https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1 | ||
*https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update | *https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update | ||
*https://bugzilla.mozilla.org/show_bug.cgi?id=350920 - update doesn't start downloading in the background | |||
** '''turns out to be a non-bug:''' It was explained to me that the file will start downloading in the background at a very slow rate (intended), so that the progress will be noted in the size of the update.mar file for that update. | |||
*https://bugzilla.mozilla.org/show_bug.cgi?id=350938 - updater does not resume update process when you force quit it (test case 2445) | |||
*https://bugzilla.mozilla.org/show_bug.cgi?id=351046 - software update does not resume where it left off after computer shutdown (test case 2463) | |||
== Other Scenarios or Testing Completed == | == Other Scenarios or Testing Completed == | ||
| Line 97: | Line 113: | ||
* Intelmac en-US [juanb] | * Intelmac en-US [juanb] | ||
** Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch. | ** Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch. | ||
* Litmus Software Update test suite completed on Intel Mac [juanb] | |||
** [[http://tinyurl.com/hqaf7 Results]] | |||
** As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected. | |||
Latest revision as of 21:38, 15 January 2007
Beta2 Software Update Testing Results
| Windows | Mac | Linux | |
|---|---|---|---|
| Alpha1 | en-US - marcia - PASS | en-US Fallback - FAIL - see detail below | en-US - jay - PASS (8.6MB partial/full) |
| Alpha2 | en-US fallback - marcia - PASS - see detail below | ||
| Alpha3 | |||
| Beta1 (digg) (No build available as of ship time) | One Tier 1 locale | ||
| Beta1 (official) | One Tier 1 locale (fr) - jay - PASS (3.1MB partial) | One Tier 1 locale fallback - marcia - PASS (see details below) |
Windows en-US [marcia]
- partial betatest Alpha1 -> Beta2 - 'PASS'
- Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
WinXP en-US [timr]
- A1 -> B2 full - Pass
- A2 -> B2 full - Pass
- A3 -> B2 Full - Pass
- B1 -> B2 Partial - Pass
- forgot to grab the version string
PPC Mac en-US [marcia] Note there were two builds offered for Alpha1
- full betatest Alpha1 -> Beta2 - 'PASS for UB only'
- Downloaded UB Build, PPC Build did not update
- full betatest using UB Build Alpha1 -> Beta2 - FAIL
- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
PPC Mac en-US [timr]
- B1 -> B2 partial - pass
- B1 -> B2 partial later - pass
- B1 -> B2 partial failover to full - Pass
- forgot to grab the version string
PPC Mac L10n [timr]
- B1 (fr) -> B2 partial - pass
- B1 (de) -> B2 partial later - pass
- B1 (en-GB) -> B2 partial failover to full - Pass
- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intel mac en-US [marcia]
- partial, betatest 2.0a2 -> 2.0b2 - PASS
- failover to full, betatest, 2.0a2 -> 2.0b2 - PASS
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intelmac en-US [juanb]
- partial, betatest 2.0b1 -> 2.0b2 - PASS
- failover to full, betatest 2.0b1 -> 2.0b2 - PASS
- failed failover-to-full, betatest 2.0b1 -> 2.0b2 - FAIL (bug 350804)
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intel Mac fr [jay]
- partial, betatest 2.0.b1 -> 2.0b2 - PASS
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Ubuntu Linux en-US [jay]
- partial, betatest 2.0a1 -> 2.0.b2 - PASS
- Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Fedora Core Linux en-US [rob/marcia]
- partial, betatest 2.0b1 -> 2.0.b2 - PASS
- also tested failing partial and ensuring it got full - PASS
- B
Notes and Issues Encountered
Windows
- On Windows I saw the following things, but could not reproduce reliably:
- Downloaded the update, installed it. Then went back to Check for Updates manually and Firefox was not hip with the fact I already had the update.
- Several times I downloaded updates, then clicked later and exited the browser. Upon restart the first time Firefox did not apply the downloaded update.
- On two instances when the updater was running I saw the talkback screen flash in the status bar, then it went away. At first I thought I crashed, but it was just the screen flashing.
Mac
- https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1
- https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update
- https://bugzilla.mozilla.org/show_bug.cgi?id=350920 - update doesn't start downloading in the background
- turns out to be a non-bug: It was explained to me that the file will start downloading in the background at a very slow rate (intended), so that the progress will be noted in the size of the update.mar file for that update.
- https://bugzilla.mozilla.org/show_bug.cgi?id=350938 - updater does not resume update process when you force quit it (test case 2445)
- https://bugzilla.mozilla.org/show_bug.cgi?id=351046 - software update does not resume where it left off after computer shutdown (test case 2463)
Other Scenarios or Testing Completed
- Intelmac en-US [juanb]
- Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch.
- Litmus Software Update test suite completed on Intel Mac [juanb]
- [Results]
- As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected.