ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://mxr.mozilla.org/mozilla/source/testing/performance/talos/ talos]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/puppet/ puppet]


'''Are you changing the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
= Non-releng repositories involved in the CI =
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
 
= Mozharness deployments =
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/mozharness/graph the mozharness repository] are live immediately.  Please see that repo for push history.
 
= Puppet deployments =
 
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
 
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
 
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.


= Reconfigs / Deployments =
= Reconfigs / Deployments =
This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems.
This page is updated by the person who does a [[ReleaseEngineering:Buildduty:Reconfigs|reconfig]] on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as <i>mozharness</i> changes.)


'''Did you change the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 25: Line 40:
|-
|-
| in production
| in production
| 2012-05-17 0750 PDT
| 2017-09-21 07:51 PT
|
* {{bug|755434}} - l10n repacks should not execute config.py
* {{bug|753132}} - Do 32-bit PGO builds on win64
* {{bug|751158}} - Create tcheckboard3 to measure checkerboard with low res off
* {{bug|755989}} - setup-master.py doesn't set up staging symlinks properly
* {{bug|743304}} - After SSH failure, Android XUL mozilla-central nightly builder spams a bunch of "SyntaxError: invalid syntax" when running retry.py / balrog-client.py
* {{bug|753501}} - Add empty tooltool manifests to some platforms
|-
| in production
| 2012-05-14 1118 PDT
|
* {{bug|753488}} - Android native on Aurora -> multilocale.
|-
| in production
| 2012-05-14 0830 PDT
|
* {{bug|750837}} - 13.0b2 build 2 configs. r=hwine
* {{bug|754517}} - disable larch and enable pine rentable branches, r=bear
* {{bug|747500}} - setup-master.py refers to files which have been removed. r=catlee
* {{bug|753132}} - Use win64 machines for 32-bit pgo builds on build-system branch. r=rail
* {{bug|754373}} - Use firefox-tuxedo.ini for Thunderbird builds. r=standard8
* {{bug|754397}} - Disable signing at build time for Thunderbird. r=nthomas
* {{bug|754430}} - Missing mozilla/ dir in Thunderbird beta build. p=standard8,r=jhopkins
* {{bug|701783}} - remove scratchbox references from buildbotcustom. r=catlee
* {{bug|753132}} - Support 'pgo_platform' key for deciding which machines do PGO builds. r=rail
* {{bug|750744}} - Test and deploy SUT agent 1.08. r=bear
|-
| in production
| 2012-05-11 0930 PDT
|
* {{Bug|754297}} - add sys.stdout.flush() to sut_tools' scripts
|-
| in production
| 2012-05-11 0800 PDT
|
* {{Bug|746260}} - disable the screen resolution changing on android for jsreftest and crashtest, leave it on for reftest.
* {{Bug|753868}} - use aus3-staging for Thunderbird release builds, r=jhopkins
* {{Bug|744601}} - tracking bug for build and release of Thunderbird 13.0b2. r=standard8
* {{Bug|752531}} - migrate dev-stage01 to scl3. r=rail
|-
| in production
| 2012-05-10 1801 PDT
|
* {{bug|753488}} - make FN multi on m-c only, reenable nightly updates.
* {{Bug|753625}} - Move all Thunderbird branches onto Firefox infra
* {{bug|749748}} - kill l10n verify.
* {{Bug|753868}} - Use aus3-staging.mozilla.org for Thunderbird release builds.
* {{Bug|753865}} - Email thunderbird-drivers for Thunderbird release builds.
* {{bug|748157}} - Load thunderbird_release_branches from master_config.json
|-
| in production
| 2012-05-09 0800 PDT
|
* {{bug|752373}} - Stop running Android crashtest-1 until someone's ready to fix it
* {{bug|751070}} - retire sjc1 VMs
* {{bug|750031}} - moz2-darwin10-slave02 problem tracking
* {{bug|746201}} - Remove unresolved machines from buildbot-configs
* {{bug|752430}} - Swap comm-aurora over to Firefox infra
* {{bug|749051}} - TryChooser: could -n be the default?
* {{bug|751878}} - OSError: [Errno 13] Permission denied: '/home/ftp' for pvtbuilds2.dmz.scl3.mozilla.com
|-
| in production
| 2012-05-03 1325 PDT
|
* {{Bug|744067}} - add them back
|-
| backed out
| 2012-05-03 1200 PDT
|
* Backout 4ab5af03cce1 (new scl3 slaves). r=backout
|-
| in production
| 2012-05-03 1000 PDT
|
* {{Bug|751165}} - revert higher priority for m-i. r=philor,ehsan
* {{Bug|744067}} - new scl3 slaves; r=coop
* {{Bug|744067}} - new scl3 slaves (must be in staging); r=aki
* Add ACTIVE_THUNDERBIRD_RELEASE_BRANCHES. r=armenzg
* {{Bug|751895}} - Preproduction release master fails trying to checkconfig. r=jhopkins
* {{Bug|750973}} - copy in-tree m-a linux32 mozconfig into mozilla2 to fix aurora source release. r=catlee
|-
| in production
| 2012-05-03 08:00 PDT
|
* {{bug|751506}} - No 10.7 32-bit debug builders on Thunderbird trees. r=coop
* {{bug|748628}} - Switch Thunderbird builds to use OS X 10.7 build machines. Add in the 'TB ' prefix to match the other Thunderbird builders. r=jhopkins
* {{bug|744864}} - Update list of l10n modules that trigger changes. r=Pike
* {{bug|751560}} - Temporarily disable uploading symbols on Windows 32 bit try-comm-central builds. r=jhopkins
* {{bug|751514}} - Thunderbird bloat test builders should warn and halt on failure, not error on failure. r=jhopkins
|-
| in production
| 2012-05-02 12:00 PDT
|
* {{Bug|750635}} - Swap try-comm-central over to pushing to the thunderbird product directory, and get it running unit tests.
* Follow-up to {{bug|748628}}, fix some more issues with the Thunderbird lion builders - the names and the ccache settings.
* {{Bug|739994}} - Remove references to 10.5 platform and associated slaves in configs - r=jhford
|-
| in production
| 2012-05-02 08:00 PDT
|
* {{Bug|748628}} - Switch Thunderbird builds to use OS X 10.7 build machines. r=coop
* {{Bug|743304}} - After SSH failure, Android XUL mozilla-central nightly builder spams a bunch of "SyntaxError: invalid syntax" when running retry.py / balrog-client.py. r=catlee
* {{Bug|751165}} - Bump priority of mozilla-inbound to help open the tree earlier. r=catlee
|-
| in production
| 2012-05-01 19:00 PDT
|
* {{Bug|554343}} - Release builders should always clobber
* {{Bug|750514}} - Disable codesighs on Thunderbird try
* {{Bug|750013}} - Revert Birch customizations from {{bug|746159}}
|-
| in production
| 2012-04-30 13:30 PDT
|
* {{Bug|750305}} - Use comm-central as reference branch for try-comm-central builds
* {{Bug|749596}} - Enable aurora nightly updates (April 27th, 2012 edition)
|-
| in production
| 2012-04-30 11:30 PDT
|
* {{Bug|749867}} - Don't try to build SpiderMonkey --enable-shark builds on 10.7 where there is no Shark, r=coop
* buildbot-configs patch to reflect new all-locales locations (Bug 711534 - Configure Thunderbird release builders) r=standard8
* {{Bug|669428}} - Run Jetpack tests on mozilla-inbound, r=armenzg
* {{Bug|748633}} - Thunderbird try logs failing to upload. r=rail
|-
| in production
| 2012-04-27 11:30 PDT
|
* {{Bug|749524}} - Upload comm-aurora snippets to comm-aurora-test channel
* {{Bug|711534}} - Configure Thunderbird release builders
* {{Bug|749288}} - linux comm-central builds use wrong python when calling balrog client
* {{Bug|749494}} - Re-enable graph server for staging/preproduction
* {{Bug|729392}} - Install toolchain needed for SPDY testing onto test machines
* {{Bug|745300}} - Do Mac spidermonkey builds on 10.7
 
|-
| in production
| 2012-04-26 11:00 PDT
|
* {{Bug|749076}} - tooltool should be invoked with -o (--overwrite) option
* {{Bug|739802}} - disable b2g on aurora, beta, release
|-
| '''backed-out'''
| 2012-04-26 09:00 PDT
|
* {{Bug|742131}} - deploy node.exe to fedora slaves
|-
| in production
| 2012-04-26 07:00 PDT
|
* {{Bug|742131}} - deploy node.exe to fedora slaves
|-
| in production
| 2012-04-25 22:26 PDT
|
|
* {{Bug|742131}} - fix upload host for windows try symbols
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| in production
| in production
| 2012-04-25 12:00 PDT
| 2017-09-14 03:55 PT
|
|
* {{Bug|743977}} - turn off balrog client for staging and preproduction builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|723340}} - move dm-pvtbuild01 to a new datacenter
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|747821}} - Need to run tpr_responsiveness on Try until it's not run anywhere anymore
</div>
* {{Bug|729667}} - re-create the services on dm-wwwbuild01 in scl3
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| in production
| in production
| 2012-04-24 6:30 PDT
| 2017-09-06 10:14 PT
|
|
* {{Bug|747966}} - comm-central builds not firing automatically
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|747862}} - Disable shark nightly builds on Thunderbird builders
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
|-
|-
| in production
| in production
| 2012-04-23 15:30 PDT
| 2017-08-31 06:50 PT
|
|
* {{Bug|746708}} - Updates builder fails running backupsnip and pushsnip
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|747756}} - Bump "'make hg-bundle" timeout
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|747892}} - mozilla-release's releasetestUptake value should be set to 1
</div>
* {{bug|747460}} - consolidate windows peptest config files
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| in production
| in production
| 2012-04-18 0645 PDT
| 2017-08-06 22:46 PT
|
|
* {{bug|745545}} - Handle Thunderbird revisions in NightlyRepackFactory.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|745547}} - Move talosCmd into SUITES loop (generateTalosBranchObjects).
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|745299}} - Add hg-internal as a mirror.
</div>
* {{bug|745500}} - Turn on robocop testCheck2 on tinderbox builds.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|735390}} - 12.0b6 configs + fix test-masters.sh + move l10n-changesets_mobile-aurora.json into mozilla/.
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* {{bug|746537}} - Increase priority for Birch, drop Maple back down
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
|-
|-
| in production
| in production
| 2012-04-17 1211 PDT
| 2017-08-04 03:42 PT
|
|
* {{bug|746159}} - make birch be like inbound
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|739994}} - turn off spidermonkey builds on 10.5
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|744098}} - switch xulrunner osx builds to upload tarballs
</div>
* {{bug|732976}} - singlesourcefactory should generate checksums
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
|-
|-
| in production
| in production
| 2012-04-17 0630 PDT
| 2017-08-02 00:27 PT
|
|
* {{bug|739778}} - preproduction in scl3
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|744119}} - decommission osx builder
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|744958}} - updateSUT.py fixes
</div>
* {{bug|741751}} - partner repack signing fixes
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|745538}} - TB mozmill test steps
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|745469}} - Turn off tinderbox mail for spidermonkey builds
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2012-04-12 1830-45 PDT
| 2017-07-31 04:12 PT
|
|
* {{bug|722759}} - switch non-try symbols to symbols1.dmz.phx1.mozilla.com
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|741657}} - Switch to aus3-staging
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|730325}} - Pass product name to reallyShort()
</div>
* {{bug|744495}} - xulrunner pulse messages
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| in production
| in production
| 2012-04-10 various times
| 2017-06-12 03:31 PT
|
|
* {{bug|720027}} - enable lion builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|-
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| in production
</div>
| 2012-04-10 1100 PST
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
|
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
* {{bug|744049}} - tcheckerboard always reports 1.0 (tegra talos web server updated to talos tip)
|-
|-
| in production
| in production
| 2012-04-09 0700 PDT
| 2017-06-05 06:32 PT
|
|
* {{bug|607392}} - split tagging into en-US and other
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|721885}} - shut off unused branch
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|400296}} - Have release automation support signing OSX builds (up to 10.7 support)
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
|-
|-
| in production
| in production
| 2012-04-04 11:00 PDT
| 2017-06-05 02:12 PT
|
|
* {{bug|690311}} - deploy newer version of cleanup.py to the foopies
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 2012-03-30 6:15 PDT
| 2017-05-11 06:12 PT
|
|
* {{bug|738588}} - add ts_paint to the android tests.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|737458}} - replace tpr_responsiveness for tp5row.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|737458}} - add tpr_responsiveness temporarily for mozilla-central and larch.
</div>
* {{bug|740599}} - update staging release config files;
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
|-
|-
| in production
| in production
| 2012-03-29 6:55 PDT
| 2017-03-16 07:25 PT
|
|
* {{Bug|715193}} - If a branch does not use talos_from_source_code we should fallback to talos.mobile.old.zip (fixes esr10).
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 2012-03-28 16:35 PDT
| 2017-03-10 15:02 PT
|
|
* {{Bug|740196}} - ts_paint on Android doesn't actually work
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| in production
| in production
| 2012-03-28 11:55 PDT
| 2017-03-10 10:11 PT
|
|
* {{Bug|737632}} - Remove jaegermonkey, graphics and pine to reduce builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|723667}} - fix Android trobocheck and ts_paint tests.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|739486}} - test-masters.sh should run ./setup_master.py -t
</div>
* add option to setup_master.py to print error logs when hit
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|723667}} - enable trobopan and tcheckerboard by default (not for m-a/m-b/m-r/1.9.2)
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
* {{Bug|627182}} - Automate signing and publishing of XULRunner builds. r=bhearsum
|-
|-
| in production
| in production
| 2012-03-27 12:30 PDT
| 2017-03-09 13:18 PT
|
|
* {{Bug|723667}} - Add trobopan and trobocheck to m-c/m-i. r=jmaher
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 2012-03-23 11:30 PDT
| 2017-03-06 11:57 PT
|
|
*{{bug|627182}}
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
*{{bug|738685}}
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
*{{bug|734223}}
</div>
*{{bug|738286}}
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
*{{bug|719491}}
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
*{{bug|737656}}
*{{bug|715193}}
*{{bug|702595}}
*{{bug|735383}}
|-
|-
| in production
| in production
| 2012-03-27 01:35 PDT
| 2017-03-06 11:49 PT
|
|
* {{Bug|739505}} - [http://hg.mozilla.org/build/buildbot-configs/rev/3c424821358a Fix talos] on beta
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| in production
| in production
| 2012-03-23 7:00 PDT
| 2017-03-03 13:50 PT
|
* {{Bug|737864}} - Tweak release category for Thunderbird.
* {{Bug|737458}} - add tp5row side by side and cleanup config.py.
* {{Bug|737581}} - enable peptest on m-c and m-i.
* {{Bug|713846}} - Treat 'fennec' builds as having product 'mobile' for the purposes of uploading logs.
|-
| backout
| 2012-03-21 11:45 PDT
|
|
* {{Bug|737427}}. Use 1024x768 as the screen resolution for the tegras.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
|-
|-
| in production
| in production
| 2012-03-21 9:30 PDT
| 2017-03-03 12:53 PT
|
|
* {{Bug|737427}}. Use 1024x768 as the screen resolution for the tegras.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|697150}}. (Bv1) Remove 'ac_add_options --disable-installer' for XulRunner current branches.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|733394}}. Add leak test logic to mozilla-beta.
</div>
* {{Bug|736587}}. Enable Android for pine.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| in production
| in production
| 2012-03-20 8:30 PDT
| 2017-03-01 11:50 PT
|
|
* {{bug|723667}} - enable talos robocop for pine and only for native tests
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|737077}} - re-enable aurora updates
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|713846}} - unified log handling
</div>
* {{bug|734320}} - fix jetpack log parsing
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|737049}} - run reftest-no-accel correctly
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
* {{bug|723386}} - fix reserved slaves handling
|-
|-
| in production
| in production
| 2012-03-19 10:30 PDT
| 2017-02-27 19:34 PT
|
|
* {{bug|736284}} - re-enable aurora updates
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
|-
|-
| in production
| in production
| 2012-03-16 8:45 PDT
| 2017-02-27 18:50 PT
|
|
* {{bug|734996}} - fennec beta release update channel -> beta.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|734221}} - deploy updateSUT.py and upgrade the boards to SUT Agent version 1.07.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|734996}} - source: get a nonce earlier
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| in production
| in production
| 2012-03-13 17:00 PDT
| 2017-02-27 13:40 PT
|
|
* {{bug|735201}} - Remove leading ../ from symbols path for tegras
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|735421}} - Disable Aurora updates until the Aurora 13 has stabilized
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| in production
| in production
| 2012-03-12 16:00 PDT
| 2017-02-27 11:56 PT
|
|
* {{bug|734417}} - enable mobile builds on the profiling branch
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|731617}} - No nightly builds on maple branch since 27 Feb
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|732285}} - Set MINIDUMP_STACKWALK for Android
</div>
* {{bug|733668}} - Include "ERROR: We tried to download the talos.json file but something failed" and "ERROR 500: Internal Server Error" for Talos hgweb operations to RETRY
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|630518}} - l10n verify, update verify, and final verification builders need to set "branch" when reporting to clobberer
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
|-
|-
| in production
| in production
| 2012-03-08 09:00 PT
| 2017-02-24 13:02 PT
|
|
* {{Bug|731814}} - Add checks that we're not exceeding max # of builders per slave.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|731617}} - Remove win64 for now in maple.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|731339}} - Remove slaves that are not production
</div>
* {{Bug|732730}} - Remove non-functional and unwanted pgo_platforms overrides
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|732110}} - remove buildbot-configs/mozilla2/mobile
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
* {{Bug|728271}} - Post to graphs.m.o instead of graphs-old.m.o
* {{Bug|729144}} - Post to graphs.allizom.org.
* {{Bug|723667}} - Add robocop disabled.
* {{bug|730050}} - TryBuildFactory looks in the wrong place for malloc.log
* {{Bug|712538}} - leaktest parity on try
* {{Bug|723667}} - Use talos.zip for tegras and prep work for talos robocop
|-
|-
| in production
| in production
| 2012-03-06 06:30 PT
| 2017-02-23 06:27 PT
|
|
* {{bug|732500}} - Enable nightly updates on maple
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|732699}} - ESR release automation should push to mirrors automatically
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|730918}} - Android on esr10 is busted, no doubt by branding since that always seems to be the problem
</div>
* {{bug|561754}} - Don't download symbols for test runs, pass symbol zip URL as symbols path
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|732516}} - l10n verification shouldn't rsync zip files
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
* {{bug|732468}} - Add the ridiculous "abort: error:" to the list of hg errors that trigger RETRY
|-
|-
| in production
| in production
| 2012-03-01 7:30 PT
| 2017-02-17 09:50 PT
|
|
* {{Bug|721360}} - Do what changeset 9a0c428bdb69 really wanted to do.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|561754}} - Disable symbol download on demand for mozilla-1.9.2 branch.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|660480}} - mark as RETRY for common tegra errors
</div>
* {{Bug|729918}} - start_uptake_monitoring builder uses wrong script_repo_revision property.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|561754}} - Download symbols on demand by default for desktop unittests.
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
| in production
| in production
| 2012-02-27 7:45 PT
| 2017-02-16 13:27 PT
|
|
* {{bug|729077}} - recycle talos-r4-lion-083 and talos-r3-snow-081 as mac-signing[12]
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Fix up staging and preproduction test slave lists.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|729426}} - Do periodic PGO on services-central
</div>
* {{bug|727580}} - linux-android for esr10, without merging 11.0 to m-r.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
|-
|-
| in production
| in production
| 2012-02-21 9:30 PT
| 2017-02-15 12:50 PT
|
|
* {{bug|719511}} - add optional reboot command to ScriptFactory
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|725292}} - some repacks failed in 11.0b2 because of missing tokens
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|728104}} - AggregatingScheduler resets its state on reconfig
</div>
* {{Bug|722608}} - Remove android signature verification
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|719260}} - Investigate why updates builder triggered twice for 10.0b5
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* {{bug|719511}} - Reenable peptest + add reboot_command
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
* {{bug|712678}} - android-xul different update channel from android
 
|-
|-
| in production
| in production
| 20120217 1148 PST
| 2017-02-08 13:10 PT
|
|
* {{bug|721822}} - remove talos_from_code.py from the tools repo
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| in production
| in production
| 20120214 1245 PST
| 2017-02-08 12:19 PT
|
|
* {{bug|726901}} - adjust resolution for reftests to 1600x1200
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|689989}} - restore /system/etc/hosts on testing tegras
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| in production
| in production
| 20120213 1200 PST
| 2017-01-23 03:51 PT
|
|
* {{bug|725727}} - reduce # of chunks for update_verify.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|607392}} - split tagging into en-US and other.  
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
|-
|-
| in production
| in production
| 20120208 01:20 PST
| 2017-01-05 04:33 PT
|
|
* {{bug|723954}} - 11.0b2 configs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|718385}} - android single locale updates
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|717106}} - Release automation for ESR
</div>
|-
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| in production
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
| 20120207 13:00 PST
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|
* {{bug|719443}} - add robocop unitttest testtype
* {{bug|715715}} - download & install robocop for robocop test suites
* {{Bug|725046}} - Re-enable mobile aurora updates
* {{Bug|554324}} - Only set MOZ_PKG_VERSION when appVersion != version
* [BACKED OUT] - <strike>{{bug|719511}} - optional ScriptFactory reboot().</strike>
|-
| in production
| 20120202 15:50 PST
|
* {{bug|723743}} - android native to en-US (no multilocale); disable android-xul single locale repacks.
* {{bug|719697}} - --disable-tests on android* l10n-mozconfigs.
* {{Bug|723277}} - don't enable remot
|}
 
=Android Testing=
== Web Server Cluster ==
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Revision'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
| 488bc187a3ef
| {{bug|753822}}
| 20120510 1045 AM PDT
| armenzg
|}
|}
Find [[ReleaseEngineering:Buildduty#Update_mobile_talos_webhosts|here]] instructions to see how to update this.
== clientproxy servers ==
Production
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
| 2a995b4ed124
| 31249cbe4f19
| bfc910cd8dd3
| ae5d6911905a
| talos: {{bug|629503}}
| 20110202 23:00 PDT
| bear
|}
Pending
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
|
|
|
|
|
|
|
|}
Servers:
* bm-foopy01.build.mozilla.org
* bm-foopy02.build.mozilla.org
/builds/cp
/builds/talos-data/talos
/builds/talos-data/talos/pageloader@mozilla.org
/builds/talos-data/talos/bench@taras.glek
/builds/sut_tools

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.allizom.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"