Releases/Firefox 38.0.5/BuildNotes: Difference between revisions

(Add build4)
(release done)
 
(8 intermediate revisions by 3 users not shown)
Line 35: Line 35:
== Build 4 ==
== Build 4 ==
* <s>(RelMan) [[Release:Release_Automation_on_Mercurial:Preparation#L10N_Changesets | Ship the l10n milestone]]
* <s>(RelMan) [[Release:Release_Automation_on_Mercurial:Preparation#L10N_Changesets | Ship the l10n milestone]]
* (RelMan) [[Release:Release_Automation_on_Mercurial:Starting_a_Release#Submit_to_Ship_It | Submit to Ship It]]</s>
* (RelMan) [[Release:Release_Automation_on_Mercurial:Starting_a_Release#Submit_to_Ship_It | Submit to Ship It]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Set-up_whatsnew_page | Set up whatsnew page]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Set-up_whatsnew_page | Set up whatsnew page]] '''see below'''
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Publish_in_Balrog | Publish RC to Beta channel]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Publish_in_Balrog | Publish RC to Beta channel]]
* [[Release:Release_Automation_on_Mercurial:Updates#Push_to_mirrors | Push to mirrors]]
* [[Release:Release_Automation_on_Mercurial:Updates#Push_to_mirrors | Push to mirrors]]
Line 42: Line 42:
* [[Release:Release_Automation_on_Mercurial:Updates#Verifying_Throttling | Verify throttling ]]
* [[Release:Release_Automation_on_Mercurial:Updates#Verifying_Throttling | Verify throttling ]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Publish_in_Balrog | Publish in Balrog ]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Publish_in_Balrog | Publish in Balrog ]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Post-release_tasks | Post-release tasks]]
* [[Release:Release_Automation_on_Mercurial:Updates_through_Shipping#Post-release_tasks | Post-release tasks]]</s>


=== Deal with missing beta channel updates ===
=== Deal with missing beta channel updates and failures ===
Similar to build3.
Similar to build3.
* relanded {{attachment|8609368}} on production with retag, to enable all the necessary builders
* relanded {{attachment|8609368}} on production with retag, to enable all the necessary builders
Line 53: Line 53:
  release.updates.patcher.PatcherConfigError: Found multiple past-updates with duplicate to/from versions: ['38.0.5b3', '39.0b1', ['betatest', 'releasetest', 'beta']]
  release.updates.patcher.PatcherConfigError: Found multiple past-updates with duplicate to/from versions: ['38.0.5b3', '39.0b1', ['betatest', 'releasetest', 'beta']]
Fixed with [https://hg.mozilla.org/build/tools/rev/73652067bcdc 73652067bcdc] and rebuilt.
Fixed with [https://hg.mozilla.org/build/tools/rev/73652067bcdc 73652067bcdc] and rebuilt.
The beta final_verification failed, because the uptake check returned quickly and Balrog was still serving content from before the beta_updates job changes. Similar for mac update verify 3 and 4 for beta. Rerunning all three of those returned green results.
=== What's New Pages ===
* there is special handling on what's new needed for '''both''' Release (38.0.5) & Developer Edition (40.0). See {{bug|1143875}} & {{bug|1135820}}.
** work for 38.0.5 cdn-test done in blob & balrog ({{bug|1135820}}). NB: ja-jp request turns into ja,ja-JP-mac
=== Funnelcake ===
{{bug|1157556}} requests three funnelcake builds to track effectiveness of firstrun variations. They were built as part of partner repack jobs.
Push to mirrors
# ffxbld@stage
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake37/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake37/
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake38/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake38/
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake39/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake39/
for fc in 37 38 39; do
  for d in '/' '/win32/' '/win32/en-US/'; do
    cp -v /pub/mozilla.org/firefox/releases/38.0.5/index.html /pub/mozilla.org/firefox/releases/38.0.5-funnelcake${fc}${d}
  done
done
Set up bouncer links per [https://bugzilla.mozilla.org/show_bug.cgi?id=1157556#c13 bug comment], making sure to enable SSL on the product, and limit it to en-US.

Latest revision as of 13:36, 2 June 2015

Checklist

Build 1

Failed before it started because the production-0.8 branch of buildbotcustom was busted for non-release reasons. bhearsum backed out the bustage and started build2.

Build 2

Issues starting because the release-runner reconfig conflicted with the hourly reconfig, so that the two schedulers on bm81 as well as bm71 and bm74 were not reconfiged by release runner. eg

[FAIL] lockfile (reconfig.lock) found in buildbot-master81.bb.releng.scl3.mozilla.com:/builds/buildbot/build_scheduler

When the sendchange was sent we got this in the build_scheduler:

 2015-05-21 14:01:41-0700 [Broker,46296,10.26.68.33] FIREFOX_38_0_1_RELEASE revision does not match script_repo_revision FIREFOX_38_0_5_RELEASE

bug 1167467 for these issues. Recovered by reconfiging the 4 affected masters, and re-doing the sendchange.

Cancelled in tagging, because the branding and update config was not set up properly. We need to backout 27bacb9dff64 for build3. Done in 79f9cd31b4b1.

Build 3

Deal with missing beta channel updates

KaiRo noticed that 38.0.5 didn't become available on beta-cdntest. This is because we only enable the beta channel for "final" releases (http://mxr.mozilla.org/build/source/tools/buildfarm/release/release-runner.py#145), which means "two digit version number".

Our assumption was broken by 38.0.5, so this never happened. I _think_ the best way to fix this up is to tweak the release config by hand, retag, reconfig, and then kick the beta updates builder. I landed https://bugzilla.mozilla.org/attachment.cgi?id=8609368&action=edit to enable all the necessary builders and reconfiged the build and scheduler masters for it. After that was done, I:

  • Reran bouncer submitter to add necessary bouncer entries with force bulid
  • Ran beta updates builder with force build

After the updates builder ran the downstreams (update verify, ready for cdntest, etc.) seemed to fire correctly.

Build 4

Deal with missing beta channel updates and failures

Similar to build3.

  • relanded attachment 8609368 [edit] on production with retag, to enable all the necessary builders
  • reconfiged the build and scheduler masters
  • reran bouncer submitter to add necessary bouncer entries with force build

This was done before the builds were all done, so the beta updates builder ran automatically. They failed with

release.updates.patcher.PatcherConfigError: Found multiple past-updates with duplicate to/from versions: ['38.0.5b3', '39.0b1', ['betatest', 'releasetest', 'beta']]

Fixed with 73652067bcdc and rebuilt.

The beta final_verification failed, because the uptake check returned quickly and Balrog was still serving content from before the beta_updates job changes. Similar for mac update verify 3 and 4 for beta. Rerunning all three of those returned green results.

What's New Pages

  • there is special handling on what's new needed for both Release (38.0.5) & Developer Edition (40.0). See bug 1143875 & bug 1135820.
    • work for 38.0.5 cdn-test done in blob & balrog (bug 1135820). NB: ja-jp request turns into ja,ja-JP-mac

Funnelcake

bug 1157556 requests three funnelcake builds to track effectiveness of firstrun variations. They were built as part of partner repack jobs.

Push to mirrors

# ffxbld@stage
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake37/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake37/
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake38/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake38/
rsync -av /pub/mozilla.org/firefox/candidates/38.0.5-candidates/build4/partner-repacks/funnelcake39/ \
          /pub/mozilla.org/firefox/releases/38.0.5-funnelcake39/
for fc in 37 38 39; do
  for d in '/' '/win32/' '/win32/en-US/'; do
    cp -v /pub/mozilla.org/firefox/releases/38.0.5/index.html /pub/mozilla.org/firefox/releases/38.0.5-funnelcake${fc}${d}
  done
done 

Set up bouncer links per bug comment, making sure to enable SSL on the product, and limit it to en-US.