Releases/Firefox 2.0.0.19/BuildNotes

Build Engineers

nthomas
Version/config bump bug

Bonsai queries

Build 1: cvsroot
Build 2: cvsroot

Tags

Build 1:

Module	Parent Branch	Created Tag/Branch	Pull date
cvsroot/mozilla	MOZILLA_1_8_BRANCH	GECKO181_20081202_RELBRANCH	2008-11-26 16:01 PST
	GECKO181_20081202_RELBRANCH	FIREFOX_2_0_0_19_RELEASE, FIREFOX_2_0_0_19_BUILD1	2008-12-01 19:11 PST
l10n/l01n	MOZILLA_1_8_BRANCH	GECKO181_20081202_RELBRANCH	2008-11-26 16:01 PST
	GECKO181_20081202_RELBRANCH	FIREFOX_2_0_0_19_RELEASE, FIREFOX_2_0_0_19_BUILD1	2008-12-01 19:29 PST

Build 2:

Module	Parent Branch	Created Tag/Branch	Pull date
cvsroot/mozilla	GECKO181_20081202_RELBRANCH	FIREFOX_2_0_0_19_RELEASE, FIREFOX_2_0_0_19_BUILD2	2008-12-03 15:37 PST
l10n/l01n	GECKO181_20081202_RELBRANCH	FIREFOX_2_0_0_19_RELEASE, FIREFOX_2_0_0_19_BUILD2	2008-12-03 16:01 PST

Build data

Type	Build machine
Windows	production-pacifica-vm
Mac	bm-xserve05
Linux	production-prometheus-vm

Files: Build 1, Build 2

Notes

Build 1

Slave cleanup:

• production-prometheus-vm
  • /builds/verify/firefox-2.0.0.18, /builds/verify/thunderbird-2.0.0.18
  • /builds/updates/firefox-2.0.0.18, /builds/updates/thunderbird-2.0.0.18
  • /build/source/firefox-2.0.0.18, /builds/source/thunderbird-2.0.0.18
  • /data/cltbld/firefox-2.0.0.18, /data/cltbld/thunderbird-2.0.0.18
  • /builds/tags/FIREFOX_2_0_0_18_BUILD1, /builds/tags/THUNDERBIRD_2_0_0_18_BUILD1
• bm-xserve05
  • /builds/verify/firefox-2.0.0.18, /builds/verify/thunderbird-2.0.0.18
• production-pacifica-vm
  • /builds/verify/*, /builds/symbols/*
• production-1.8-master
  • removed /builds/buildbot/Automation/twistd.log.???

Bootstrap tag: RELEASE_AUTOMATION_M11 (unchanged from Fx2.0.0.17 & 18)

Setup before starting:

• Updated /builds/buildbot/Automation/buildbot-configs on production-1.8-master. (No change to deploy)
  • master.cfg is "Locally Modified" to contain passwords. Identical to repository version otherwise.
  • Turned off the nightly builders on production-1.8-master to make sure they don't interfere with the release. (We need to figure out how to avoid this in the future).
    • commented out "c['schedulers'].append(depend_scheduler)"
  • updated mozilla1.8 tinderbox to say "no nightlies right now"
• land change to mozilla/tools/release/configs/fx-moz18-bootstrap.cfg, and move RELEASE_AUTOMATION_M11 tag to new revision (cvs tag -F RELEASE_AUTOMATION_M11 fx-moz18-bootstrap.cfg)
• verify tinderbox checkout on automation tag
  • prometheus-vm, bm-xserve05: cd /builds/tinderbox/mozilla/tools/tinderbox; cvs up -CPd -r RELEASE_AUTOMATION_M11
  • production-pacifica-vm: cd /cygdrive/c/builds/tinderbox/mozilla/tools/tinderbox; cvs up -CPd -r RELEASE_AUTOMATION_M11
• ensure that machines have enough resources
  • production-prometheus-vm - 30G in /
  • production-1.8-master - 30G in /builds, 19G in /data
  • production-pacifica-vm - 33G in c:/
  • bm-xserve05 - 22G in /

Issued sendchange:

buildbot sendchange --username=nthomas --master=localhost:9989 -m"Firefox 2.0.0.19 build 1" release

Tag

Automated, no problems.

Source

Automated, no problems.

Build

Automated, no problems. Checked that symbols were unpacked OK on talkback server.

Repack

Automated, no problems.

Respin declared

Build 2

Setup

• re-enable nightly builds to verify fix
• update fx-moz18-bootstrap.cfg
  • attachment 351232
  • get review, land, move RELEASE_AUTOMATION_M11 tag onto new revision
• don't need to clear any space up since tag box has plenty of space, and we didn't get to l10n verify for mac
• disabled builds on bm-xserve05 by commenting out macosx_dep_build in depend_scheduler, then reconfig master. Added comment to Mozilla1.8 tree
• issued sendchange

buildbot sendchange --username=nthomas --master=localhost:9989 -m"Firefox 2.0.0.19 build 2" release

Tag

Automated, no problems.

Source

Automated, no problems.

Build

Automated, no problems. Checked that symbols were unpacked OK on talkback server. On mac got

Unpacking symbols on remote host...
     2 [main] bzip2 4248 C:\cygwin\bin\bzip2.exe: *** fatal error - C:\cygwin\bin\bzip2.exe: *** CreateFileMapping Global\cygwin1S4.cygpid.5612, Win32 error 0.  Terminating.

so did

# cltbld@bm-xserve05
cd /builds/tinderbox/Fx-Mozilla1.8-release/Darwin_8.7.0_Depend/mozilla/../2008120316
./upload-symbols.sh 

Repack

Automated, no problems.

Sign

• Signing doc

L10nVerify

Automated, no problems on manually checking log.

Generate Updates

Automated, no problems.

Publish Updates to Test Channels (betatest & releasetest)

Automated, no problems.

Push updates to beta channel

Ran the pushsnip commands for both 2.0.0.19 and 3.0.5 at the same time on aus2-staging.

# put snippets on beta
$ sudo su - cltbld
# make sure using latest version of scripts in mozilla/tools/release/bin/
$ cd bin
$ cvs update . 
$ cd /opt/aus2/snippets/staging
# note the required parameter must match what will be used with pushsnip below. 
$ date; time ~/bin/backupsnip 20081204-Firefox-2.0.0.19-beta
Wed Dec 10 14:23:05 PST 2008
Running /bin/tar cfvj /opt/aus2/snippets/backup/20081210-2-pre-20081204-Firefox-2.0.0.19-beta.tar.bz2 .

real    36m28.783s
user    0m29.089s
sys     0m45.750s

$ time ~/bin/pushsnip 20081202-Firefox-3.0.5-beta
real    2m9.993s
user    0m0.151s
sys     0m6.701s

$ time ~/bin/pushsnip 20081204-Firefox-2.0.0.19-beta
real    3m18.406s
user    0m0.199s
sys     0m9.664s

Sign Installers

Done manually using these installer-signing-instructions here

• complete stage-merged:

# on stage
cd /data/cltbld/firefox-2.0.0.19/
rsync -av batch1/mar/ stage-merged/
rsync -av batch1/stage-signed/ stage-merged/

• Create MD5 and SHA1 checksum files

# on stage
cd /data/cltbld/firefox-2.0.0.19/stage-merged/
~/bin/checksum-files .

• Fix permissions & ownership (on the two SUM files, and the detached sigs)

chown -R cltbld:firefox .
chmod 644 *SUMS

Update Bouncer

• Manually added entries to download.mozilla.org
• Note for next release: Do not remove the Check Now bit on the Firefox-2.0.0.18 Products until well after the change to the rsync module (to prevent the likes of bug 464566)

Push to mirrors

• push the stage-merged directory to the releases area:

# on stage
rsync -av /data/cltbld/firefox-2.0.0.19/stage-merged/ /home/ftp/pub/firefox/releases/2.0.0.19/

• edit the exclude file /pub/mozilla.org/zz/rsyncd-mozilla-current.exclude to add the new release (2.0.0.19) and remove the previous release (2.0.0.18). Had to put this back in because it was displaced by 3.1b2, but we have way more 2.0.0.x users than 3.1 pre-releases.

Final Verification

• Verify that releasetest points to valid bouncer links:

# this can be run from anywhere
cvs co mozilla/testing/release
cd mozilla/testing/release/updates
cat moz18-firefox-*.cfg | grep -v major | sed 's/betatest/releasetest/' | grep -v 2.0a | grep -v 2.0b > update.cfg
./verify.sh -t update.cfg 2>&1 | tee quickVerify.log

• Look for any HTTP error codes besides 200 ("OK") and 302 ("Found"):

grep HTTP quickVerify.log | grep -v 200 | grep -v 302

• Before pushing final updates,verify that "release" and "releasetest" channel match:

# on aus2-staging
$ cd 20081204-Firefox-2.0.0.19
time find -type d -iregex '.*release.*' | perl -nle '$a = $_; $a =~ s/release/releasetest/; system("diff -r -u $_ ../20081204-Firefox-2.0.0.19-test/$a");'

Publish Updates to Release Channel

backupsnip was run as part of the Fx3.0.5 prep

# on aus2-staging
$ time ~/bin/pushsnip 20081204-Firefox-2.0.0.19
real    1m39.672s
user    0m0.194s
sys     0m7.530s

Release

• On stage.m.o, do the following:
  • Update "latest" symlinks

$ cd /pub/mozilla.org/firefox/releases/
$ mv latest-2.0 latest-2.0.old
$ ln -s 2.0.0.19 latest-2.0
$ rm latest-2.0.old