Firefox 3.0rc2:BuildNotes

Build Engineers

nthomas

Bonsai queries

Last checkins:

• cvsroot - Build 1, Build2
• l10n - Build 1, No change in build2

Bugs

Tracking bug for Firefox 3.0rc2 - bug 434508

Tags

Module	Tag	Pull date
cvsroot/mozilla	GECKO19_20080529_RELBRANCH	HEAD @ 2008-05-28 17:00 PDT
	FIREFOX_3_0rc2_BUILD1	GECKO19_20080529_RELBRANCH @ 2008-05-29 03:04 PDT
	FIREFOX_3_0rc2_RELEASE	GECKO19b5_20080529_RELBRANCH @2008-05-29 03:04 PDT
l10n/l10n	GECKO19_20080529_RELBRANCH	HEAD @ 2008-05-28 13:37 PDT
	FIREFOX_3_0rc2_BUILD1	GECKO19_20080529_RELBRANCH @ 2008-05-29 03:19 PDT
	FIREFOX_3_0rc2_RELEASE	GECKO19_20080529_RELBRANCH @ 2008-05-29 03:19 PDT

Build data

Type	Build ID	SHA1	Push date	Build machine
[Windows installer]				en-US & l10n:fx-win32-1.9-slave2
[Mac compressed]				en-US & l10n:fx-mac-1.9-slave2
[Linux compressed]				en-US & l10n:fx-linux-1.9-slave2

Notes

We've changed the naming scheme (bug 428063) so this sheet will track

• 3.0 RC2 build 1
• 3.0 RC2 build 2

etc until we publish 3.0 RC2 to the world (see the Tags section above for matching changes). We'll have a extra pages for RC3 and so on if they're required.

Build 1

Bootstrap tag: RELEASE_AUTOMATION_M9_1

NB: Italicized items were not required for this build (reason given for each).

Setup before starting:

• compare nightly and release mozconfig/tinder-config.pl files, merge any desired changes - none this time
• updated the bootstrap tag in master.cfg, and landed after review. Merged the change onto production-1.9-master, commented out the dep builders and reconfig'd the master - no changes
• tagged mozilla/tools/tinderbox with RELEASE_AUTOMATION_M9_1 - we don't need the one change (bug 291167)
• On fx-mac-1.9-slave2, fx-win32-1.9-slave2, fx-linux-1.9-slave2
  • restart linux and windows VMs to sort out any glitches from netapp problems
  • remember to use VNC if restarting mac slave
  • verify that linux has had "DISPLAY=:0 xhost +" since last reboot
  • remove the contents of /builds/verify/*
    • FIXME should be automatically backed up or removed - bug 413178
  • update tinderbox to RELEASE_AUTOMATION_M9_1
    • FIXME update should be automatic - bug 397554
    • on linux & mac
      • cd /builds/tinderbox/mozilla/tools/tinderbox
      • cvs up -r RELEASE_AUTOMATION_M9_1
    • on win32

cd /e/builds/tinderbox/mozilla/tools/tinderbox
cvs up -r RELEASE_AUTOMATION_M9_1
for dir in fx19rel fx19l10nrel xr19rel; do 
  cd /e/$dir; 
  for f in `ls *.pl *.html INSTALL README | grep -v tinder-config.pl`; do 
    cp -pv /e/builds/tinderbox/mozilla/tools/tinderbox/$f .;
  done
  cp -pv post-mozilla-rel.pl post-mozilla.pl
done

• on fx-linux-1.9-slave2
  • cd /data/cltbld/bin && cvs up
  • rm -rf /builds/updates/*
  • rm -rf /builds/source/*
  • rm -rf /data/cltbld/firefox-3.0rc1
  • rm -rf /builds/tags/* (but only if you really need the space)
• update fx-moz19-bootstrap.cfg, get review, land and move the bootstrap tag to your new revision (NB: this changed since bug 415970 - no need to cvs up the bootstrap.cfg on the master any longer but moving the tag is critical). This setup occurred relatively late because RC1 was pushed backed several times, all the other setup was done early.
• kick off buildbot (run as cltbld on production-1.9-master):

buildbot sendchange --username=nthomas --master=localhost:9989 -m "Firefox 3.0 RC2 Build1" release

Tag

• automated, no problems

Source

• automated, no problems

Build

• automated, but problems
• mac builds were automated, no problems
• Linux VM lost connection to the buildbot master when running ar cr libgklayout.a ..., which kills off the build. We tried re-running the build to rule out transient failure, but it was quite consistent. Resolved by IT moving fx-linux-1.9-slave2 to a VM host all of it's own. May be related to bug 435134, at build time netapp-d was handling traffic for netapp-c.
• Windows symbol upload failed because the remote host was down, redid with (on the slave)

export SYMBOL_SERVER_HOST='dm-symbolpush01.mozilla.org'
export SYMBOL_SERVER_USER='ffxbld';
export SYMBOL_SERVER_PATH='/mnt/netapp/breakpad/symbols_ffx'
export SYMBOL_SERVER_SSH_KEY='/c/Documents and Settings/cltbld/.ssh/ffxbld_ds
make -C /e/fx19rel/WINNT_5.2_Depend/mozilla/obj-fx-trunk uploadsymbols

Sign

• Signing doc
• joduinn announced, and also copied over signing log, as per instructions. Automation wont proceed anyway, because of earlier linux VM problems, but doing for completeness.

l10n verify

• automated, no problems
• it reveals
  • changes to ja/ja-JP-mac strings in crashreporter (expected
  • added si and sl locales

Generate Updates

• automated, no problems
• We need to make a one-off change for the RC2 build1. In the <current-update> block of moz19-branch-patcher2.cfg, add "release" to the channel. This is to get updates from 3.0RC1 to 3.0RC2 on release. The patch is here, and was checked in after PatcherConfig ran and before patcher began to create the updates (ie while it was downloading the mar files).

Stopped - respinning.

Build 2

Respinning mac only for bug 434914, solved by backout of bug 357670. Linux and Windows builds and complete mars will be symlinked forward.

• update fx-moz19-bootstrap.cfg, get review, land and move the bootstrap tag to your new revision (NB: this changed since bug 415970 - no need to cvs up the bootstrap.cfg on the master any longer but moving the tag is critical)
• Modify master.cfg with

build_depscheduler = Dependent(
       name="build_dep",
       upstream=tag_scheduler,
-      builderNames=["source", "linux_build", "macosx_build", "win32_build"],
+      # builderNames=["source", "linux_build", "macosx_build", "win32_build"],
+      builderNames=["source", "macosx_build"],
       )

NB: this started builds for linux and windows off, need to figure out why. We stopped them

• On fx-mac-1.9-slave2, fx-win32-1.9-slave2, fx-linux-1.9-slave2
  • remove the contents of /builds/verify/*
• on fx-linux-1.9-slave2
  • cd /data/cltbld/bin && cvs up
  • rm -rf /builds/updates/*
  • rm -rf /builds/source/*
  • rm -rf /data/cltbld/firefox-3.0rc1
  • rm -rf /builds/tags/* (but only if you really need the space)
• kick off buildbot (run as cltbld on production-1.9-master):

buildbot sendchange --username=nthomas --master=localhost:9989 -m "Firefox 3.0 RC2 Build2" release

Tag

• automated, no problems
• did a cvs rdiff to verify changes between FIREFOX_3_0rc2_BUILD1 FIREFOX_3_0rc2_BUILD2

Source

• automated, no problems

Setup symlinks

On stage-old in /pub/mozilla.org/firefox/nightly/3.0rc2-candidates/build2 as cltbld:

for i in `ls ../build1/*win32.installer.exe`; do ln -s $i; done
for i in `ls ../build1/*win32.complete.mar`; do ln -s $i; done
ln -s ../build1/windows-xpi
ln -s ../build1/win32_info.txt
ln -s ../build1/win32_signing_build1.log win32_signing_build2.log
ln -s ../build1/unsigned 
for i in `ls ../build1/*linux-i686.tar.bz2`; do ln -s $i; done
for i in `ls ../build1/*linux-i686.complete.mar`; do ln -s $i; done
ln -s ../build1/linux-xpi
ln -s ../build1/linux_info.txt

Build

• linux and windows started off but were interrupted
• mac finished OK

Sign

• N/A

l10n Verify

• Same as build1, no problems

Update Generation

• automated, nothing to do

Update Verify

• linux verified all green.
• all platforms failed for ga-IE (b3,b4) because it didn't ship for b5 (bug 384065)
• mac verify failed as expected for gu-IN since we're not shipping it for RC1
• mac verify failed as expected for all locales with:

 ...
 diff -r source/Firefox.app/Contents/MacOS/removed-files target/Firefox.app/Contents/MacOS/removed-files
 569,570d568
 < dictionaries/PL.dic
 < dictionaries/PL.aff
  ...

• win32 also has bug 404340, a long standing bug about how checksums show up different in updatedinstall-vs-cleaninstall. Not a blocker, we've shipped with this for a while now.

Stage

• Failed out with:

 ...
 log: Changed group of /data/cltbld/firefox-3.0rc2/batch1/stage-unsigned/firefox-3.0.nb-NO.mac.complete.mar to firefox
 Step Stage died: ASSERT: IsValidLocaleDeliverable(): Unknown file type in tree: /data/cltbld/firefox-3.0rc2/batch1/stage-unsigned/NOTE at Bootstrap/Step/Stage.pm line 660.
 program finished with exit code 1

Moved file up to firefox-3.0rc2 directory and restarted stage step