Releases/Firefox 3.6.13/BuildNotes

From MozillaWiki
Jump to navigation Jump to search

Build Engineers

bhearsum
Tracking bug

Signed-off Revision(s)

Build1: 5d2cbf9c9669

Tags

Build # Tag Changeset
1 FIREFOX_3_6_13_BUILD1 FIREFOX_3_6_13_RELEASE af7a49ca89b2

Build data

Build # Type Build ID Build machine Time to build
1 Linux
Mac
Windows

Build 1

Done on pm03. Setup notes:

  • No clobberer necessary because this is the first 0.8.0 release on this branch.
  • landed config updates, including l10n-changesets
  • tagged buildbot-configs, buildbotcustom, compare-locales, and tools with FIREFOX_3_6_12_BUILD1 and FIREFOX_3_6_12_RELEASE
  • updated /tools/buildbotcustom/buildbotcustom, /builds/buildbot/configs, and /builds/buildbot/builder_master/tools to latest
  • reconfiged master
  • Left tree open, 0.8.0 automation doesn't require that it closes
  • kicked off automation with:
buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=releases/mozilla-1.9.2 --revision=FIREFOX_3_6_13_RELEASE -p release_config:mozilla/release-firefox-mozilla-1.9.2.py gogogo

Tag

'pl' locale failed when 'hg out' got a bad response from the HG server. (FIXME we should be retrying when any hg operation fails).

Fixed manually by running the following on mv-moz2-linux-ix-slave11, as cltbld:

cd /builds/slave/release-mozilla-1.9.2-tag/build/pl
hg push --new-branch -e 'ssh -l ffxbld -i ~/.ssh/ffxbld_dsa' ssh://hg.mozilla.org/releases/l10n-mozilla-1.9.2/pl

Manually started source, xulrunner_source, _build and _xulrunner_build for all platforms, filling in the form as follows:

  • Branch: releases/mozilla-1.9.2
  • Revision: FIREFOX_3_6_13_RELEASE
  • Property 1 Name: release_config
  • Property 1 Value: mozilla/release-firefox-mozilla-1.9.2.py

Source / XULRunner Source

No Problems

Build

No problems. Removed en-US.xpi from stage

L10n Repack

Triggered manually, see Tag section for form details.

Failed a few times because the scripts were trying to use staging-only variables. Landed a few bustage fixes before it got working again. Patches are in bug 613944.

Lots of individual repacks failed when uploading. Found them by searching for "ssh_exchange_identification: Connection closed by remote host" in the logs. To fix, did the following for each failed locale (on the machine that tried to build it):

export UPLOAD_USER=ffxbld
export MOZ_OBJDIR=obj-l10n
export UPLOAD_SSH_KEY="~/.ssh/ffxbld_dsa"
export UPLOAD_HOST=stage.mozilla.org
export POST_UPLOAD_CMD="post_upload.py -p firefox -n 1 -v 3.6.13 --release-to-candidates-dir"
export UPLOAD_TO_TEMP=1
export MOZ_PKG_PRETTYNAMES=1
cd /builds/moz2_slave/release-mozilla-1.9.2-$platform_repack_$n/build/mozilla-1.9.2/obj-l10n/browser/locales
export AB_CD=$locale
make l10n-upload-$locale

Did the following on stage to make sure we had all of the locales:

cd /home/ftp/pub/firefox/nightly/3.6.13-candidates/build1
ls unsigned/win32 | grep -v xpi | wc -l
ls mac | grep -v xpi | wc -l
ls linux-i686 | grep -v xpi | wc -l

Output for each should be 76, which it was.

Partner Repack

No problems. Signing happened at the same time as other builds.

XULRunner Build

No problems

Unittests

  • Mac: All green
  • Linux: All green
  • Win32: All green except for mochitests, which ran all test successfully and then hung at shutdown. Retriggered it, went green.

Signing

Removed en-US.xpi from candidates directory. No problems, followed CombinedSigning doc.

Got "Signature verification succeeded" mail.

L10n Verify

Many string changes across many platforms/locales. All seemed legitimate, didn't dig further.

Updates

3.6* -> 3.6.13

Generation
  • First attempt failed when the Linux 'id' MAR failed to download. Dug in a bit more and found that all locales I had recovered manually were missing MARs because I forgot to set MOZ_MAKE_COMPLETE_MAR=1 when uploading. To fix
  • re-did the l10n uploads w/ MOZ_MAKE_COMPLETE_MAR
  • resigned everything.
  • clobbered updates builddir
  • restarted updates from the beginning
  • No other issues
Update Verify
  • Linux: PASS
  • Windows: PASS
  • Mac: Complained that there was no partial update for 3.6.4's 'ca' locale. Manually checking of the link did not reproduce, likely a fluke. Re-run update verify for confirmation.
    • No issues on the re-run

Socorro product data updates

Added '3.6.13' and '3.6.14pre' to crash-stats with this admin page.

Update Bouncer

Used "Force Build" to start the "release-mozilla-1.9.2-bouncer_submitter" builder.

  • First attempt failed with the error: "Cannot retrieve credentials file: BuildSlaves.py"
    • Noticed that tuxedoUsername/tuxedoPassword were missing from BuildSlaves.py on pm01/pm03.
  • After adding the entries I used "Force Build" again. No problems this time.

Stage EU Ballot Builds

  • Using the EU Ballot builds generated by the build machines
  • No signing necessary as these were signed earlier
  • Kev looked over them before staging

Once Kev verified them, ran the following to get them ready for the mirror push:

# ffxbld@stage
cd /home/ftp/pub/firefox/nightly/3.6.13-candidates/build1
mv -v partner-repacks/euballot/win32 win32-EUballot

Ideally, the partner repack scripts or signing would upload this to this location from the git go. Filed bug 614227 to track this.

Push to Beta Channel

As cltbld@aus2-staging:

~/bin/backupsnip 20101122-Firefox-3.6.13-beta
~/bin/pushsnip 20101122-Firefox-3.6.13-beta

Build 2

Done on pm03. Setup notes:

  • Set a clobber for pm03, 'Any release', 'Any builder' with clobberer.
    • Noticed that after clobbering, all of the release builders showed up in the table. Filed bug 615192 on the issue.
  • Tagged buildbot-configs, buildbotcustom, and tools with FIREFOX_3_6_13_RELEASE and FIREFOX_3_6_13_BUILD2. compare-locales will be tagged by the tagging step this time.
  • Updated /tools/buildbotcustom/buildbotcustom, /builds/buildbot/buildbot-configs, and /builds/buildbot/builder_master/tools to latest
  • reconfiged master
  • Ran release_sanity.py with --dryrun:
PYTHONPATH=.:tools/lib/python python tools/buildbot-helpers/release_sanity.py -u bhearsum -V 3.6.13 --branch mozilla-1.9.2 --build-number 2 --dryrun localhost:9010
  • After it passed, ran it for real:
PYTHONPATH=.:tools/lib/python python tools/buildbot-helpers/release_sanity.py -u bhearsum -V 3.6.13 --branch mozilla-1.9.2 --build-number 2 --dryrun localhost:9010

Tag

  • Cancelled the first run because it merged other changesets, and had revision set wrong (FIXME)
  • Re-ran release_sanity.py, revision was set correctly this time. No further issues.

Source/XULRunner Source

Build

L10n Repack

Partner Repack

XULRunner Build