|
|
| Line 1: |
Line 1: |
| == Beta2 Software Update Testing Results ==
| |
|
| |
|
| {| class="fullwidth-table"
| |
| !
| |
| ! Windows
| |
| ! Mac
| |
| ! Linux
| |
| |-
| |
| | Alpha1
| |
| | en-US - marcia - '''PASS'''
| |
| | en-US Fallback - '''FAIL''' - see detail below
| |
| | en-US - jay - PASS (8.6MB partial/full)
| |
| |-
| |
| | Alpha2
| |
| |
| |
| | en-US fallback - marcia - '''PASS''' - see detail below
| |
| |
| |
| |-
| |
| | Alpha3
| |
| |
| |
| |
| |
| |
| |
| |-
| |
| | Beta1 (digg) '''(No build available as of ship time)'''
| |
| | One Tier 1 locale
| |
| |
| |
| |
| |
| |-
| |
| | Beta1 (official)
| |
| |
| |
| | One Tier 1 locale (fr) - jay - PASS (3.1MB partial)
| |
| | One Tier 1 locale fallback - marcia - '''PASS''' (see details below)
| |
| |-
| |
| |}
| |
|
| |
| Windows en-US [marcia]
| |
| * partial betatest Alpha1 -> Beta2 - ''''''PASS''''''
| |
| **Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| WinXP en-US [timr]
| |
| * A1 -> B2 full - Pass
| |
| * A2 -> B2 full - Pass
| |
| * A3 -> B2 Full - Pass
| |
| * B1 -> B2 Partial - Pass
| |
| ** forgot to grab the version string
| |
|
| |
| PPC Mac en-US [marcia]
| |
| Note there were two builds offered for Alpha1
| |
| * full betatest Alpha1 -> Beta2 - ''''''PASS for UB only''''''
| |
| *Downloaded UB Build, '''PPC Build did not update'''
| |
| * full betatest using UB Build Alpha1 -> Beta2 - '''FAIL'''
| |
| **Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| PPC Mac en-US [timr]
| |
| * B1 -> B2 partial - pass
| |
| * B1 -> B2 partial later - pass
| |
| * B1 -> B2 partial failover to full - Pass
| |
| ** forgot to grab the version string
| |
|
| |
| PPC Mac L10n [timr]
| |
| * B1 (fr) -> B2 partial - pass
| |
| * B1 (de) -> B2 partial later - pass
| |
| * B1 (en-GB) -> B2 partial failover to full - Pass
| |
| ** Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| Intel mac en-US [marcia]
| |
| * partial, betatest 2.0a2 -> 2.0b2 - '''PASS'''
| |
| * failover to full, betatest, 2.0a2 -> 2.0b2 - '''PASS'''
| |
| **Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| Intelmac en-US [juanb]
| |
| * partial, betatest 2.0b1 -> 2.0b2 - '''PASS'''
| |
| * failover to full, betatest 2.0b1 -> 2.0b2 - '''PASS'''
| |
| * failed failover-to-full, betatest 2.0b1 -> 2.0b2 - '''FAIL''' (bug 350804)
| |
| ** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| Intel Mac fr [jay]
| |
| * partial, betatest 2.0.b1 -> 2.0b2 - PASS
| |
| ** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| Ubuntu Linux en-US [jay]
| |
| * partial, betatest 2.0a1 -> 2.0.b2 - PASS
| |
| ** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
| |
|
| |
| Fedora Core Linux en-US [rob/marcia]
| |
| * partial, betatest 2.0b1 -> 2.0.b2 - PASS
| |
| ** also tested failing partial and ensuring it got full - PASS
| |
| **B
| |
|
| |
| == Notes and Issues Encountered ==
| |
|
| |
| = Windows =
| |
|
| |
| *On Windows I saw the following things, but could not reproduce reliably:
| |
|
| |
| **Downloaded the update, installed it. Then went back to Check for Updates manually and Firefox was not hip with the fact I already had the update.
| |
|
| |
| **Several times I downloaded updates, then clicked later and exited the browser. Upon restart the first time Firefox did not apply the downloaded update.
| |
|
| |
| **On two instances when the updater was running I saw the talkback screen flash in the status bar, then it went away. At first I thought I crashed, but it was just the screen flashing.
| |
|
| |
| = Mac =
| |
|
| |
| *https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1
| |
| *https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update
| |
| *https://bugzilla.mozilla.org/show_bug.cgi?id=350920 - update doesn't start downloading in the background
| |
| ** '''turns out to be a non-bug:''' It was explained to me that the file will start downloading in the background at a very slow rate (intended), so that the progress will be noted in the size of the update.mar file for that update.
| |
| *https://bugzilla.mozilla.org/show_bug.cgi?id=350938 - updater does not resume update process when you force quit it (test case 2445)
| |
| *https://bugzilla.mozilla.org/show_bug.cgi?id=351046 - software update does not resume where it left off after computer shutdown (test case 2463)
| |
|
| |
| == Other Scenarios or Testing Completed ==
| |
|
| |
| * Intelmac en-US [juanb]
| |
| ** Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch.
| |
| * Litmus Software Update test suite completed on Intel Mac [juanb]
| |
| ** [[http://tinyurl.com/hqaf7 Results]]
| |
| ** As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected.
| |