Releases/Firefox 3.1b1:BuildNotes: Difference between revisions

m
 
(19 intermediate revisions by 2 users not shown)
Line 17: Line 17:
|-
|-
| mozilla-central
| mozilla-central
|
| FIREFOX_3_1b1_BUILD1 FIREFOX_3_1b2_RELEASE
| http://hg.mozilla.org/mozilla-central/rev/197f83ad7678
| http://hg.mozilla.org/mozilla-central/rev/197f83ad7678
|}
|}
Line 32: Line 32:
|-
|-
| [Windows installer/zip]
| [Windows installer/zip]
|  
| 20081007144708
| moz2-win32-slave11
| moz2-win32-slave11
|-
|-
| [Mac compressed]
| [Mac compressed]
|  
| 20081007125523
| bm-xserve19
| bm-xserve19
|-
|-
Line 115: Line 115:


* Two action items:
* Two action items:
** Dependent scheduler did not fire '''TODO'''
** Dependent scheduler did not fire '''TODO''' {{bug|459213}}
** Check-in comments say 'cltbld' when they should say 'ffxbld' '''TODO'''
** Check-in comments say 'cltbld' when they should say 'ffxbld' '''TODO''' {{bug|459214}}


==== Source ====
==== Source ====
Line 190: Line 190:
[https://intranet.mozilla.org/Build:CombinedSigning instructions]
[https://intranet.mozilla.org/Build:CombinedSigning instructions]
* Had to locally patch sign-release.pl to support betas. {{bug|408958}}
* Had to locally patch sign-release.pl to support betas. {{bug|408958}}
* Noticed that checksum-files also generates hashes for unsigned things '''FIXME'''
* Noticed that checksum-files also generates hashes for unsigned things '''FIXME''' {{bug|459215}}
** Manually removed all 'unsigned' entries from the *SUMS files (because they will be trimmed before we release)
** Manually removed all 'unsigned' entries from the *SUMS files (because they will be trimmed before we release)


Line 198: Line 198:
====Generate Updates====
====Generate Updates====
* '''FIXME''' - hg tools repo should be tagged with UPDATE_PACKAGING tag
* '''FIXME''' - hg tools repo should be tagged with UPDATE_PACKAGING tag
* '''FIXME''' - ReleaseUpdatesFactory needs to properly handle the '-u' flag to bumping script
** Tagged hg.m.o/build/tools with UPDATE_PACKAGING_R6 for future use
* '''FIXME''' - ReleaseUpdatesFactory needs to properly handle the '-u' flag to bumping script {{bug|459216}}
* '''FIXME''' - make_incremental_updates.py patch in {{bug|454261}} needs to be landed in m-c
* '''FIXME''' - make_incremental_updates.py patch in {{bug|454261}} needs to be landed in m-c
  export CVSROOT=:ext:cltbld@cvs.mozilla.org:/cvsroot
  export CVSROOT=:ext:cltbld@cvs.mozilla.org:/cvsroot
Line 237: Line 238:


====Update Verify====
====Update Verify====
Note that update verify only tests old versions, so only en-US was tested:
bm-xserve01:/builds/releases/3.1b1/update_verify/updates cltbld$ ./verify.sh -c moz191-firefox-mac.cfg     
Using config file moz191-firefox-mac.cfg
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829065003/Darwin_Universal-gcc3/en-US/betatest/update.xml
07:29:15 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/mac/en-US/firefox-3.1b1.complete.mar [16903884/16903884] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829065003/Darwin_Universal-gcc3/en-US/betatest/update.xml
07:29:16 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/mac/en-US/firefox-3.1b1.complete.mar [16903884/16903884] -> "update/complete.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072510/Darwin_Universal-gcc3/en-US/betatest/update.xml
07:29:17 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/mac/en-US/firefox-3.1b1.complete.mar [16903884/16903884] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072510/Darwin_Universal-gcc3/en-US/betatest/update.xml
07:29:18 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/mac/en-US/firefox-3.1b1.complete.mar [16903884/16903884] -> "update/complete.mar" [1]
bm-xserve01:/builds/releases/3.1b1/update_verify/updates cltbld$ ./verify.sh -c moz191-firefox-win32.cfg
Using config file moz191-firefox-win32.cfg
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829082037/WINNT_x86-msvc/en-US/betatest/update.xml
07:29:30 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/win32/en-US/firefox-3.1b1.complete.mar [10307200/10307200] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829082037/WINNT_x86-msvc/en-US/betatest/update.xml
07:29:31 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/win32/en-US/firefox-3.1b1.complete.mar [10307200/10307200] -> "update/complete.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072308/WINNT_x86-msvc/en-US/betatest/update.xml
07:29:34 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/win32/en-US/firefox-3.1b1.complete.mar [10307200/10307200] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072308/WINNT_x86-msvc/en-US/betatest/update.xml
07:29:35 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/win32/en-US/firefox-3.1b1.complete.mar [10307200/10307200] -> "update/complete.mar" [1]
bm-xserve01:/builds/releases/3.1b1/update_verify/updates cltbld$ ./verify.sh -c moz191-firefox-linux.cfg
Using config file moz191-firefox-linux.cfg
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829071937/Linux_x86-gcc3/en-US/betatest/update.xml
07:29:40 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/linux-i686/en-US/firefox-3.1b1.complete.mar [9610314/9610314] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a2/20080829071937/Linux_x86-gcc3/en-US/betatest/update.xml
07:29:41 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/linux-i686/en-US/firefox-3.1b1.complete.mar [9610314/9610314] -> "update/complete.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072306/Linux_x86-gcc3/en-US/betatest/update.xml
07:29:43 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/linux-i686/en-US/firefox-3.1b1.complete.mar [9610314/9610314] -> "update/partial.mar" [1]
Using  https://aus2.mozilla.org/update/1/Firefox/3.1a1/2008072306/Linux_x86-gcc3/en-US/betatest/update.xml
07:29:44 URL:http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.1b1-candidates/build1/update/linux-i686/en-US/firefox-3.1b1.complete.mar [9610314/9610314] -> "update/complete.mar" [1]


====Stage====
====Update Bouncer====
Manually added entries to download.mozilla.org
 
====zh-CN build2====
* Localizer landed fix on the release branch: http://hg.mozilla.org/l10n-central/zh-CN
* Tagged that changeset as FIREFOX_3_1b1_BUILD2 and FIREFOX_3_1b1_RELEASE
* re-generated zh-CN builds on all platforms (no logs, sorry).
* Pushed them to cltbld@stage.mozilla.org:/home/.../3.1b1-candidates/build2
* Symlinked everything but signed win32 builds in (those will be done post zh-CN build2 signing):
1087  for i in `ls ../../build1/linux-i686`; do ln -s ../../build1/linux-i686/$i; done
for i in `ls ../../../build1/linux-i686`; do ln -s ../../../build1/linux-i686/$i; done
for i in `ls ../../build1/mac`; do ln -s ../../build1/mac/$i; done
for i in `ls ../../../build1/mac`; do ln -s ../../../build1/mac/$i; done
for i in `ls ../../../../build1/unsigned/update/win32`; do ln -s ../../../../build1/unsigned/update/win32/$i; done
for i in `ls ../../../build1/unsigned/win32`; do ln -s ../../../build1/unsigned/win32/$i; done
for i in `ls ../../../../build1/unsigned/win32/xpi`; do ln -s ../../../../build1/unsigned/win32/xpi/$i; done
history | grep for
 
===== sign zh-CN build2 =====
* Followed [https://intranet.mozilla.org/Build:CombinedSigning instructions] with these tweaks:
* Only pulled win32 en-US (build1) and linux/mac/win32 zh-CN (build2) into unsigned-build2:
rsync -av -e ssh  --include=linux-i686/ --include=mac/ --include=unsigned/ --include=*irefox* --include=win32  --include=*zh-CN* --include=update/ --exclude=* cltbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ unsigned-build${BUILD}
rsync -av -e ssh --include=unsigned/ --include=*irefox* --include=win32  --include=*en-US* --include=update/ --exclude=* cltbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build1/ unsigned-build${BUILD}
* Ran sign-release.pl in previously signed mode (-p)
* After running sign-release.pl trimmed out en-US builds from signed-build2 before generating detached sigs and pushing back (because there's no need to do either of these for en-US on build2)
* Pushed builds back
* Regenrated MD5SUMS and SHA1SUMS (as per instructions)
** Had to add '-follow' to ~/bin/checksum-files:sub gather_files() to make sure non-zh-CN files got sums generated - reverted that change afterwards


==== Push to beta channel ====
==== Push to mirrors ====
This is a bit more complicated than usual because we did a respin for zh-CN. Did the following before pushing live:
# cltbld@stage
cd /data/cltbld
# copy everything from build1
rsync -av --exclude=*.log --exclude=*.txt --exclude=*unsigned* /home/ftp/pub/firefox/nightly/3.1b1-candidates/build1/ firefox-3.1b1/
# copy only zh-CN from build2
rsync -av --include=win32 --include=mac --include=linux-i686 --include=[Ff]irefox* --include=*zh-CN* --exclude=* /home/ftp/pub/firefox/nightly/3.1b1-candidates/build2/ firefox-3.1b1/
cd firefox-3.1b1
-bash-3.00$ md5sum mac/ga-IE/Firefox\ 3.1\ Beta\ 1.dmg
610cb5adb38d76fa251eda8a777a5d49  mac/ga-IE/Firefox 3.1 Beta 1.dmg
-bash-3.00$ md5sum /home/ftp/pub/firefox/nightly/3.1b1-candidates/build1/mac/ga-IE/Firefox\ 3.1\ Beta\ 1.dmg
610cb5adb38d76fa251eda8a777a5d49  /home/ftp/pub/firefox/nightly/3.1b1-candidates/build1/mac/ga-IE/Firefox 3.1 Beta 1.dmg


-bash-3.00$ for i in linux-i686 mac win32; do md5sum $i/zh-CN/[Ff]irefox* | grep -v asc; md5sum /home/ftp/pub/firefox/nightly/3.1b1-candidates/build2/$i/zh-CN/[Ff]irefox* | grep -v asc; done
c7f357cc3c43e4310fba7381f565a593  linux-i686/zh-CN/firefox-3.1b1.tar.bz2
c7f357cc3c43e4310fba7381f565a593  /home/ftp/pub/firefox/nightly/3.1b1-candidates/build2/linux-i686/zh-CN/firefox-3.1b1.tar.bz2
5d41dea708e0a9d85990e85f84a4958a  mac/zh-CN/Firefox 3.1 Beta 1.dmg
5d41dea708e0a9d85990e85f84a4958a  /home/ftp/pub/firefox/nightly/3.1b1-candidates/build2/mac/zh-CN/Firefox 3.1 Beta 1.dmg
58b6c8f5bcf83c4cb80e5b7d727f8930  win32/zh-CN/Firefox Setup 3.1 Beta 1.exe
58b6c8f5bcf83c4cb80e5b7d727f8930  /home/ftp/pub/firefox/nightly/3.1b1-candidates/build2/win32/zh-CN/Firefox Setup 3.1 Beta 1.exe


====Update Bouncer====
And to actually push to mirrors:
rsync -av /data/cltbld/firefox-3.1b1/ /home/ftp/pub/firefox/releases/3.1b1/
# copy the KEY file
 
Updated /pub/mozilla.org/zz/rsyncd-mozilla-current.exclude with 3.1b1


==== Push to mirrors ====
==== Create and push releasetest channel snippets ====
We needed to manually create releasetest channel snippets in order for QA to be able to test bouncer links. This was done with the following commands:
# cltbld@aus2-staging.mozilla.org
cd ~
rsync -av /opt/aus2/snippets/staging/20081008-Firefox-3.1b1/ 20081008-Firefox-3.1b1-releasetest/
cd 20081008-Firefox-3.1b1-releasetest
for i in `find . | grep 'en-US$'`; do cd $i; mv beta releasetest; cd ../../../../../; done
cd ~
rsync -av 20081008-Firefox-3.1b1-releasetest/ /opt/aus2/snippets/staging/20081008-Firefox-3.1b1-releasestest/
# push the test snippets
~/bin/pushsnip 20081008-Firefox-3.1b1-releasetest


====Final Verification====
====Final Verification====
* Verify that releasetest points to valid bouncer links:
# this can be run from anywhere
cvs co mozilla/testing/release
cd mozilla/testing/release/updates
cat moz191-firefox-*.cfg | grep -v major | sed 's/betatest/releasetest/' > update.cfg
./verify.sh -t update.cfg 2>&1 | tee quickVerify.log
* Before pushing final updates,verify that "release" and "releasetest" channel match:
# on aus2-staging
$ cd 20081008-Firefox-3.1b1
$ find -type d -iregex '.*release.*' | perl -nle '$a = $_; $a =~ s/beta/releasetest/; system("diff -r -u $_ ../20081008-Firefox-3.1b1-releasetest/$a");'
$


==== Publish Updates to Beta Channel ====
==== Publish Updates to Beta Channel ====
# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip 20081008-Firefox-3.1b1
~/bin/pushsnip 20081008-Firefox-3.1b1
QA found a problem with Mac 3.1a1 updates. When I generated the 'releasetest' snippets I accidentally renamed the mac 3.1a1 'beta' dir to 'releasetest'. Fixed in the '20081008-Firefox-3.1b1' dir, and pushed again:
cd /opt/aus2/snippets/staging/Firefox/3.1a1/Darwin*/200810*
mv releasetest beta
cd /opt/aus2/snippets/staging
~/bin/pushsnip 20081008-Firefox-3.1b1


====Release====
====Release====
* FIXME Need to create contrib/ and contrib-localized/ dirs in release structure,
cd /pub/mozilla.org/pub/firefox/releases/3.1b1/
mkdir contrib{,-localized}
chown cltbld:firefox contrib*
chmod 2775 contrib*
* FIXME Ownership on release tree not all set to cltbld:firefox
chown -R cltbld:firefox *
* FIXME permissions not set uniformly to 644 on files, and 755 on dirs (except contrib*)
find . ! -perm 644 -type f -exec chmod -v 644 {} \;
find . ! -perm 755 -type d ! -name '*contrib*' -ls -exec chmod -v 755 {} \;
* checks
find . ! -user cltbld
find . ! -group firefox
find . -type f ! -perm 644
find . -type d ! -perm 755
  ./contrib
  ./contrib-localized
[[Category:Shiretoko beta|1]]
96

edits