Build:Release Automation:Trunk

Release Automation on Trunk

General Notes

• Currently (as of November 6, 2007) the Tag step has been modified to work around the lack of a 'shipped-locales' file on trunk. There is a script in /builds/buildbot/staging-trunk-master called 'create_shipped-locales.sh'. It is run during on the Tag Builder right after creating the cvsmirror, and right before running the Bootstrap Tag step.
• CVS on windows requires '-z3' or it will not work correctly. (OR follow the "msys package upgrade" steps below)
• Commented out the SYMBOL_SERVER_* variables in mozilla/tools/tinderbox-configs/firefox/*/tinder-config.pl on the 'release' tag.
• Bootstrap has it's own special cvsmirror in /builds/cvsmirror.bootstrap/cvsroot. master.cfg was updated to reflect this.
• Some msys packages were upgraded on trunk. Here's how to do it:

1. Run this script:
#!/bin/sh files="http://easynews.dl.sourceforge.net/sourceforge/mingw/zlib-1.2.3-MSYS-1.0.11.tar.bz2 http://easynews.dl.sourceforge.net/sourceforge/mingw/openssl-0.9.8e-3-MSYS1.0.11.tar.bz2 http://easynews.dl.sourceforge.net/sourceforge/mingw/openssh-4.6p1-MSYS-1.0.11.tar.bz2 http://easynews.dl.sourceforge.net/sourceforge/mingw/minires-1.01-1-MSYS-1.0.11.tar.bz2" for file in $files; do wget $file done for file in *.tar.bz2; do tar -jvxf $file done
2. When that's done, make a backup of your existing msys insntallation, just in case.
3. Copy usr/bin/* to your existing msys bin directory. You will have to overwrite some files.

• Make sure all the tinder-config.pl's (release and l10n_release branches) have ReleaseToNightly=0 and ReleaseToDated=1 set.

Problems & Solutions

• 'Tag substep Bump died: None of ^WIN32_MODULE_PRODUCTVERSION_STRING=3.0a9pre$ found in file /builds/tags/FIREFOX_3_0_A9_RC1/cvsroot/mozilla/browser/app/module.ver: at Bootstrap/Step/Tag/Bump.pm line 149.'
  • Your cvsmirror is out-of-date. Run the Tag Builder with the cvsmirror steps enabled to resolve this. (double check this)
• Python errors on OS X (cannot import os module, etc)
  • configure seems to be finding the wrong version of Python. Worked around by moving /usr/bin/python symlink to point to /tools/python/bin/python
• CVS sometimes hangs on windows
  • Wait until cvs appears to be done (usually, cpu usage is 0%), then kill ssh.exe in Task Manager.
• Build fails on an nsinstall of scriptaculous unit tests
  • This is caused by bug 396187. Workaround it like this (make sure not to use trailing slashes on the directory names):

ln -s /e/builds/tinderbox/Fx-Mozilla1.9-Release /e/fx19rel
ln -s /e/builds/tinderbox/Fx-Mozilla1.0-l10n-Release /e/fx19l10nrel

• Make sure to change bootstrap.cfg to use these new directories.

• pushDir not found at end of Build
  • last-built is not being removed at the start of a new build. remove it manually before doing a Build.