Firefox:2.0 QA Activities:SU Results: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
m (Reverted edit of Picklesworth Bluxo, changed back to last version by Rflint)
 
(30 intermediate revisions by 7 users not shown)
Line 1: Line 1:
== Software Update Testing Results ==
== Beta2 Software Update Testing Results ==


{| class="fullwidth-table"
{| class="fullwidth-table"
Line 8: Line 8:
|-
|-
| Alpha1
| Alpha1
| en-US - marcia
| en-US - marcia - '''PASS'''
| en-US Fallback
| en-US Fallback - '''FAIL''' - see detail below
|  
| en-US - jay - PASS (8.6MB partial/full)
|-
|-
| Alpha2
| Alpha2
|  
|  
| en-US fallback
| en-US fallback - marcia - '''PASS''' - see detail below
|  
|  
|-
|-
Line 20: Line 20:
|  
|  
|  
|  
| en-US
|  
|-
|-
| Beta1 (digg)
| Beta1 (digg) '''(No build available as of ship time)'''
| One Tier 1 locale
| One Tier 1 locale
|  
|  
Line 29: Line 29:
| Beta1 (official)
| Beta1 (official)
|  
|  
| One Tier 1 locale
| One Tier 1 locale (fr) - jay - PASS (3.1MB partial)
| One Tier 1 locale fallback
| One Tier 1 locale fallback - marcia - '''PASS''' (see details below)
|-
|-
|}
|}
Windows en-US [marcia]
* partial betatest Alpha1 -> Beta2 - ''''''PASS''''''
**Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
WinXP en-US [timr]
* A1 -> B2 full - Pass
* A2 -> B2 full - Pass
* A3 -> B2 Full - Pass
* B1 -> B2 Partial - Pass
** forgot to grab the version string
PPC Mac en-US [marcia]
Note there were two builds offered for Alpha1
* full betatest Alpha1 -> Beta2 - ''''''PASS for UB only''''''
*Downloaded UB Build, '''PPC Build did not update'''
* full betatest using UB Build Alpha1 -> Beta2 - '''FAIL'''
**Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
PPC Mac en-US [timr]
* B1 -> B2 partial - pass
* B1 -> B2 partial later - pass
* B1 -> B2 partial failover to full - Pass
** forgot to grab the version string
PPC Mac L10n [timr]
* B1 (fr)    -> B2 partial - pass
* B1 (de)    -> B2 partial later - pass
* B1 (en-GB) -> B2 partial failover to full - Pass
** Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intel mac en-US [marcia]
* partial, betatest 2.0a2 -> 2.0b2 - '''PASS'''
* failover to full, betatest, 2.0a2 -> 2.0b2 - '''PASS'''
**Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intelmac en-US [juanb]
* partial, betatest 2.0b1 -> 2.0b2 - '''PASS'''
* failover to full, betatest 2.0b1 -> 2.0b2 - '''PASS'''
* failed failover-to-full, betatest 2.0b1 -> 2.0b2 - '''FAIL''' (bug 350804)
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Intel Mac fr [jay]
* partial, betatest 2.0.b1 -> 2.0b2 - PASS
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Ubuntu Linux en-US [jay]
* partial, betatest 2.0a1 -> 2.0.b2 - PASS
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2
Fedora Core Linux en-US [rob/marcia]
* partial, betatest 2.0b1 -> 2.0.b2 - PASS
** also tested failing partial and ensuring it got full - PASS
**B
== Notes and Issues Encountered ==
= Windows =
*On Windows I saw the following things, but could not reproduce reliably:
**Downloaded the update, installed it.  Then went back to Check for Updates manually and Firefox was not hip with the fact I already had the update.
**Several times I downloaded updates, then clicked later and exited the browser. Upon restart the first time Firefox did not apply the downloaded update.
**On two instances when the updater was running I saw the talkback screen flash in the status bar, then it went away. At first I thought I crashed, but it was just the screen flashing.
= Mac =
*https://bugzilla.mozilla.org/show_bug.cgi?id=350802 - Bon Echo icon hangs around after update from Alpha1
*https://bugzilla.mozilla.org/show_bug.cgi?id=350804 - Unable to restart a full update after failing the update
*https://bugzilla.mozilla.org/show_bug.cgi?id=350920 - update doesn't start downloading in the background
** '''turns out to be a non-bug:''' It was explained to me that the file will start downloading in the background at a very slow rate (intended), so that the progress will be noted in the size of the update.mar file for that update.
*https://bugzilla.mozilla.org/show_bug.cgi?id=350938 - updater does not resume update process when you force quit it (test case 2445)
*https://bugzilla.mozilla.org/show_bug.cgi?id=351046 - software update does not resume where it left off after computer shutdown (test case  2463)


== Other Scenarios or Testing Completed ==
== Other Scenarios or Testing Completed ==
* Intelmac en-US [juanb]
** Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch.
* Litmus Software Update test suite completed on Intel Mac [juanb]
** [[http://tinyurl.com/hqaf7 Results]]
** As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected.

Latest revision as of 21:38, 15 January 2007

Beta2 Software Update Testing Results

Windows Mac Linux
Alpha1 en-US - marcia - PASS en-US Fallback - FAIL - see detail below en-US - jay - PASS (8.6MB partial/full)
Alpha2 en-US fallback - marcia - PASS - see detail below
Alpha3
Beta1 (digg) (No build available as of ship time) One Tier 1 locale
Beta1 (official) One Tier 1 locale (fr) - jay - PASS (3.1MB partial) One Tier 1 locale fallback - marcia - PASS (see details below)

Windows en-US [marcia]

  • partial betatest Alpha1 -> Beta2 - 'PASS'
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

WinXP en-US [timr]

  • A1 -> B2 full - Pass
  • A2 -> B2 full - Pass
  • A3 -> B2 Full - Pass
  • B1 -> B2 Partial - Pass
    • forgot to grab the version string

PPC Mac en-US [marcia] Note there were two builds offered for Alpha1

  • full betatest Alpha1 -> Beta2 - 'PASS for UB only'
  • Downloaded UB Build, PPC Build did not update
  • full betatest using UB Build Alpha1 -> Beta2 - FAIL
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

PPC Mac en-US [timr]

  • B1 -> B2 partial - pass
  • B1 -> B2 partial later - pass
  • B1 -> B2 partial failover to full - Pass
    • forgot to grab the version string

PPC Mac L10n [timr]

  • B1 (fr) -> B2 partial - pass
  • B1 (de) -> B2 partial later - pass
  • B1 (en-GB) -> B2 partial failover to full - Pass
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-GB; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intel mac en-US [marcia]

  • partial, betatest 2.0a2 -> 2.0b2 - PASS
  • failover to full, betatest, 2.0a2 -> 2.0b2 - PASS
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intelmac en-US [juanb]

  • partial, betatest 2.0b1 -> 2.0b2 - PASS
  • failover to full, betatest 2.0b1 -> 2.0b2 - PASS
  • failed failover-to-full, betatest 2.0b1 -> 2.0b2 - FAIL (bug 350804)
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Intel Mac fr [jay]

  • partial, betatest 2.0.b1 -> 2.0b2 - PASS
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; fr; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Ubuntu Linux en-US [jay]

  • partial, betatest 2.0a1 -> 2.0.b2 - PASS
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b2) Gecko/20060821 Firefox/2.0b2

Fedora Core Linux en-US [rob/marcia]

  • partial, betatest 2.0b1 -> 2.0.b2 - PASS
    • also tested failing partial and ensuring it got full - PASS
    • B

Notes and Issues Encountered

Windows

  • On Windows I saw the following things, but could not reproduce reliably:
    • Downloaded the update, installed it. Then went back to Check for Updates manually and Firefox was not hip with the fact I already had the update.
    • Several times I downloaded updates, then clicked later and exited the browser. Upon restart the first time Firefox did not apply the downloaded update.
    • On two instances when the updater was running I saw the talkback screen flash in the status bar, then it went away. At first I thought I crashed, but it was just the screen flashing.

Mac

Other Scenarios or Testing Completed

  • Intelmac en-US [juanb]
    • Tried applying updates "Later" after download for both partial and failover, and both were applied upon relaunch.
  • Litmus Software Update test suite completed on Intel Mac [juanb]
    • [Results]
    • As part of the test suite I also ran some tests on extension/theme compatibility and these behaved as expected.
Retrieved from "https://wiki.allizom.org/index.php?title=Firefox:2.0_QA_Activities:SU_Results&oldid=46617"