Releases/Firefox 3.6.13/BuildNotes
Build Engineers
bhearsum
Tracking bug
Signed-off Revision(s)
Build1: 5d2cbf9c9669
Tags
Build # | Tag | Changeset |
1 | FIREFOX_3_6_13_BUILD1 FIREFOX_3_6_13_RELEASE | af7a49ca89b2 |
Build data
Build # | Type | Build ID | Build machine | Time to build |
1 | Linux | |||
Mac | ||||
Windows |
Build 1
Done on pm03. Setup notes:
- No clobberer necessary because this is the first 0.8.0 release on this branch.
- landed config updates, including l10n-changesets
- tagged buildbot-configs, buildbotcustom, compare-locales, and tools with FIREFOX_3_6_12_BUILD1 and FIREFOX_3_6_12_RELEASE
- updated /tools/buildbotcustom/buildbotcustom, /builds/buildbot/configs, and /builds/buildbot/builder_master/tools to latest
- reconfiged master
- Left tree open, 0.8.0 automation doesn't require that it closes
- kicked off automation with:
buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=releases/mozilla-1.9.2 --revision=FIREFOX_3_6_13_RELEASE -p release_config:mozilla/release-firefox-mozilla-1.9.2.py gogogo
Tag
'pl' locale failed when 'hg out' got a bad response from the HG server. (FIXME we should be retrying when any hg operation fails).
Fixed manually by running the following on mv-moz2-linux-ix-slave11, as cltbld:
cd /builds/slave/release-mozilla-1.9.2-tag/build/pl hg push --new-branch -e 'ssh -l ffxbld -i ~/.ssh/ffxbld_dsa' ssh://hg.mozilla.org/releases/l10n-mozilla-1.9.2/pl
Manually started source, xulrunner_source, _build and _xulrunner_build for all platforms, filling in the form as follows:
- Branch: releases/mozilla-1.9.2
- Revision: FIREFOX_3_6_13_RELEASE
- Property 1 Name: release_config
- Property 1 Value: mozilla/release-firefox-mozilla-1.9.2.py
Source / XULRunner Source
No Problems
Build
No problems. Removed en-US.xpi from stage
L10n Repack
Triggered manually, see Tag section for form details.
Failed a few times because the scripts were trying to use staging-only variables. Landed a few bustage fixes before it got working again. Patches are in bug 613944.
Lots of individual repacks failed when uploading. Found them by searching for "ssh_exchange_identification: Connection closed by remote host" in the logs. To fix, did the following for each failed locale (on the machine that tried to build it):
export UPLOAD_USER=ffxbld export MOZ_OBJDIR=obj-l10n export UPLOAD_SSH_KEY="~/.ssh/ffxbld_dsa" export UPLOAD_HOST=stage.mozilla.org export POST_UPLOAD_CMD="post_upload.py -p firefox -n 1 -v 3.6.13 --release-to-candidates-dir" export UPLOAD_TO_TEMP=1 export MOZ_PKG_PRETTYNAMES=1 cd /builds/moz2_slave/release-mozilla-1.9.2-$platform_repack_$n/build/mozilla-1.9.2/obj-l10n/browser/locales export AB_CD=$locale make l10n-upload-$locale
Did the following on stage to make sure we had all of the locales:
cd /home/ftp/pub/firefox/nightly/3.6.13-candidates/build1 ls unsigned/win32 | grep -v xpi | wc -l ls mac | grep -v xpi | wc -l ls linux-i686 | grep -v xpi | wc -l
Output for each should be 76, which it was.
Partner Repack
No problems. Signing happened at the same time as other builds.
XULRunner Build
No problems
Unittests
- Mac: All green
- Linux: All green
- Win32: All green except for mochitests, which ran all test successfully and then hung at shutdown. Retriggered it, went green.
Signing
Removed en-US.xpi from candidates directory. No problems, followed CombinedSigning doc.
Got "Signature verification succeeded" mail.
L10n Verify
Many string changes across many platforms/locales. All seemed legitimate, didn't dig further.
Updates
3.6* -> 3.6.13
Generation
- First attempt failed when the Linux 'id' MAR failed to download. Dug in a bit more and found that all locales I had recovered manually were missing MARs because I forgot to set MOZ_MAKE_COMPLETE_MAR=1 when uploading. To fix
- re-did the l10n uploads w/ MOZ_MAKE_COMPLETE_MAR
- resigned everything.
- clobbered updates builddir
- restarted updates from the beginning
- No other issues
Update Verify
- Linux: PASS
- Windows: PASS
- Mac: Complained that there was no partial update for 3.6.4's 'ca' locale. Manually checking of the link did not reproduce, likely a fluke. Re-run update verify for confirmation.
- No issues on the re-run
Socorro product data updates
Added '3.6.13' and '3.6.14pre' to crash-stats with this admin page.
Update Bouncer
Used "Force Build" to start the "release-mozilla-1.9.2-bouncer_submitter" builder.
- First attempt failed with the error: "Cannot retrieve credentials file: BuildSlaves.py"
- Noticed that tuxedoUsername/tuxedoPassword were missing from BuildSlaves.py on pm01/pm03.
- After adding the entries I used "Force Build" again. No problems this time.
Stage EU Ballot Builds
- Using the EU Ballot builds generated by the build machines
- No signing necessary as these were signed earlier
- Kev looked over them before staging
Once Kev verified them, ran the following to get them ready for the mirror push:
# ffxbld@stage cd /home/ftp/pub/firefox/nightly/3.6.13-candidates/build1 mv -v partner-repacks/euballot/win32 win32-EUballot
Ideally, the partner repack scripts or signing would upload this to this location from the git go. Filed bug 614227 to track this.
Push to Beta Channel
As cltbld@aus2-staging:
~/bin/backupsnip 20101122-Firefox-3.6.13-beta ~/bin/pushsnip 20101122-Firefox-3.6.13-beta
Build 2
Done on pm03. Setup notes:
- Set a clobber for pm03, 'Any release', 'Any builder' with clobberer.
- Noticed that after clobbering, all of the release builders showed up in the table. Filed bug 615192 on the issue.
- Tagged buildbot-configs, buildbotcustom, and tools with FIREFOX_3_6_13_RELEASE and FIREFOX_3_6_13_BUILD2. compare-locales will be tagged by the tagging step this time.
- Updated /tools/buildbotcustom/buildbotcustom, /builds/buildbot/buildbot-configs, and /builds/buildbot/builder_master/tools to latest
- reconfiged master
- Ran release_sanity.py with --dryrun:
PYTHONPATH=.:tools/lib/python python tools/buildbot-helpers/release_sanity.py -u bhearsum -V 3.6.13 --branch mozilla-1.9.2 --build-number 2 --dryrun localhost:9010
- After it passed, ran it for real:
PYTHONPATH=.:tools/lib/python python tools/buildbot-helpers/release_sanity.py -u bhearsum -V 3.6.13 --branch mozilla-1.9.2 --build-number 2 --dryrun localhost:9010
Tag
- Cancelled the first run because it merged other changesets, and had revision set wrong (FIXME)
- Re-ran release_sanity.py, revision was set correctly this time. No further issues.