Software Update:Nightly update infrastructure: Difference between revisions
Jump to navigation
Jump to search
mNo edit summary |
(more is less) |
||
| Line 3: | Line 3: | ||
Updates are available for nightly builds of Firefox & Thunderbird on multiple branches. This requires the coordination of tinderbox configuration, partial update generation, and the AUS server that provides update information the client applications. | Updates are available for nightly builds of Firefox & Thunderbird on multiple branches. This requires the coordination of tinderbox configuration, partial update generation, and the AUS server that provides update information the client applications. | ||
This document describes how that all works, to the extent that | This document describes how that all works, to the extent that publicly available information allows. Hopefully the build crew and Mike Morgan can fill out the details to make this page more complete. | ||
=Tinderbox= | =Tinderbox= | ||
The tinderbox produces the nightly build | The tinderbox produces the nightly build & MAR for a complete update, and publishes them to the FTP. It also creates a complete-update snippet and scp's that to AUS. | ||
==mozconfig== | ==mozconfig== | ||
| Line 13: | Line 13: | ||
The update channel is set to "default" (no updates) unless this line is in the mozconfig: | The update channel is set to "default" (no updates) unless this line is in the mozconfig: | ||
ac_add_options --enable-update-channel=nightly | ac_add_options --enable-update-channel=nightly | ||
For 1.5, beta releases shipped with "beta", the release candidates and final shipped with "release". | |||
To pull and compile the code for complete update generation you need: | To pull and compile the code for complete update generation you need (**CHECK**): | ||
mk_add_options MOZ_CO_MODULE="mozilla/tools/update-packaging" | mk_add_options MOZ_CO_MODULE="mozilla/tools/update-packaging" | ||
ac_add_options --enable-update-packaging | ac_add_options --enable-update-packaging | ||
==Snippet configuration== | ==Snippet configuration== | ||
A handful of variables in tinder-config.pl control the update and snippet generation on the tinderbox. The code is [http://lxr.mozilla.org/mozilla/source/tools/tinderbox/post-mozilla-rel.pl#464 mozilla/tools/post-mozilla-rel.pl::update_create_package] and runs after the successful completion of the build and any tests. | |||
{| border=1 | |||
|- | |||
| Variable || Example value || Use | |||
|- | |||
| $update_package || 1? || Master switch ? | |||
|- | |||
| $update_product || "Firefox" || | |||
|- | |||
| $update_version || "trunk" || | |||
|- | |||
| $update_platform || "WINNT_x86-msvc" || | |||
|- | |||
| $update_hash || "md5" || | |||
|- | |||
| $update_filehost || "ftp.mozilla.org" || | |||
|- | |||
| $update_appv || "1.0+" || | |||
|- | |||
| $update_extv || "1.0+" || | |||
|- | |||
| $update_pushinfo || 1 || | |||
|} | |||
The snippet is scp'ed to | |||
/opt/aus2/incoming/0/$update_product/$update_version/$update_platform/$buildid/$locale | |||
Here is some sample output from a trunk build: | |||
Gathering complete update info... | |||
Got build ID 2006051005. | |||
Not pushing first-gen update info... | |||
Pushing third-gen update info... | |||
ssh -i /home/cltbld/.ssh/aus cltbld@aus-staging.mozilla.org mkdir -p /opt/aus2/build/0/Firefox/2.0/WINNT_x86-msvc/2006051005/en-US | |||
scp -i /home/cltbld/.ssh/aus /cygdrive/c/builds/tinderbox/Fx-Mozilla1.8/WINNT_5.2_Depend/mozilla/dist/update/update.snippet.1 cltbld@aus-staging.mozilla.org:/opt/aus2/build/0/Firefox/2.0/WINNT_x86-msvc/2006051005/en-US/complete.txt | |||
Completed pushing update info... | |||
Update build completed. | |||
=Partial Update Generation= | =Partial Update Generation= | ||
Not much information is | Not much information is available, apart from | ||
* the work is done on | * the work is done on Prometheus, using some sort of cron job | ||
* it pushes partial updates to the FTP server, and presumably a partial snippet to AUS | * it pushes partial updates to the FTP server, and presumably a partial snippet to AUS | ||
* the code for partial generation lives in [http://lxr.mozilla.org/mozilla/source/tools/update-packaging/ mozilla/tools/update-packaging] | * the code for partial generation lives in [http://lxr.mozilla.org/mozilla/source/tools/update-packaging/ mozilla/tools/update-packaging] but also uses mbsdiff and mar. | ||
* Chase wrote the code | * Chase Phillips wrote the code; Paul Reed is a current build engineer who knows how to drive it | ||
=AUS= | =AUS= | ||
This server returns update information to the client, based on the snippets it has from the build systems. It was written in PHP by Mike Morgan. | This server returns update information to the client, based on the snippets it has from the build systems. It was written in PHP by Mike Morgan. | ||
AUS maps client versions to $update_version. The current mapping is: | |||
something | |||
Revision as of 00:46, 11 May 2006
Overview
Updates are available for nightly builds of Firefox & Thunderbird on multiple branches. This requires the coordination of tinderbox configuration, partial update generation, and the AUS server that provides update information the client applications.
This document describes how that all works, to the extent that publicly available information allows. Hopefully the build crew and Mike Morgan can fill out the details to make this page more complete.
Tinderbox
The tinderbox produces the nightly build & MAR for a complete update, and publishes them to the FTP. It also creates a complete-update snippet and scp's that to AUS.
mozconfig
The update channel is set to "default" (no updates) unless this line is in the mozconfig:
ac_add_options --enable-update-channel=nightly
For 1.5, beta releases shipped with "beta", the release candidates and final shipped with "release".
To pull and compile the code for complete update generation you need (**CHECK**):
mk_add_options MOZ_CO_MODULE="mozilla/tools/update-packaging" ac_add_options --enable-update-packaging
Snippet configuration
A handful of variables in tinder-config.pl control the update and snippet generation on the tinderbox. The code is mozilla/tools/post-mozilla-rel.pl::update_create_package and runs after the successful completion of the build and any tests.
| Variable | Example value | Use |
| $update_package | 1? | Master switch ? |
| $update_product | "Firefox" | |
| $update_version | "trunk" | |
| $update_platform | "WINNT_x86-msvc" | |
| $update_hash | "md5" | |
| $update_filehost | "ftp.mozilla.org" | |
| $update_appv | "1.0+" | |
| $update_extv | "1.0+" | |
| $update_pushinfo | 1 |
The snippet is scp'ed to
/opt/aus2/incoming/0/$update_product/$update_version/$update_platform/$buildid/$locale
Here is some sample output from a trunk build:
Gathering complete update info... Got build ID 2006051005. Not pushing first-gen update info... Pushing third-gen update info... ssh -i /home/cltbld/.ssh/aus cltbld@aus-staging.mozilla.org mkdir -p /opt/aus2/build/0/Firefox/2.0/WINNT_x86-msvc/2006051005/en-US scp -i /home/cltbld/.ssh/aus /cygdrive/c/builds/tinderbox/Fx-Mozilla1.8/WINNT_5.2_Depend/mozilla/dist/update/update.snippet.1 cltbld@aus-staging.mozilla.org:/opt/aus2/build/0/Firefox/2.0/WINNT_x86-msvc/2006051005/en-US/complete.txt Completed pushing update info... Update build completed.
Partial Update Generation
Not much information is available, apart from
- the work is done on Prometheus, using some sort of cron job
- it pushes partial updates to the FTP server, and presumably a partial snippet to AUS
- the code for partial generation lives in mozilla/tools/update-packaging but also uses mbsdiff and mar.
- Chase Phillips wrote the code; Paul Reed is a current build engineer who knows how to drive it
AUS
This server returns update information to the client, based on the snippets it has from the build systems. It was written in PHP by Mike Morgan.
AUS maps client versions to $update_version. The current mapping is:
something