ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://mxr.mozilla.org/mozilla/source/testing/performance/talos/ talos]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/puppet/ puppet]


'''Are you changing the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
= Non-releng repositories involved in the CI =
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
 
= Mozharness deployments =
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/mozharness/graph the mozharness repository] are live immediately.  Please see that repo for push history.
 
= Puppet deployments =
 
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
 
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
 
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.


= Reconfigs / Deployments =
= Reconfigs / Deployments =
This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems.
This page is updated by the person who does a [[ReleaseEngineering:Buildduty:Reconfigs|reconfig]] on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as <i>mozharness</i> changes.)


'''Did you change the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 25: Line 40:
|-
|-
| in production
| in production
| 20120131 2100 PST
| 2017-09-21 07:51 PT
|
* {{bug|718777}} - updating configs for mozilla-beta so we can get native builds going
* {{bug|722719}} - change to SDK 14
* {{bug|722951}} - (temporarily) redirect aurora updates to test channel
* {{bug|722940}} - codesize upload broken for SeaMonkey [and Thunderbird] due to tools dir being incorrect
* {{bug|718777}} - Tracking bug for build and release of Firefox/Fennec 11.0b1. Poll signed Fennec APKs for all signed
* {{bug|708656}} - Use signing on demand for releases. Use AggregatingScheduler for repack_complete
* {{bug|719260}} - Investigate why updates builder triggered twice for 10.0b5
* {{bug|660480}} - RETRY on common tegra errors
|-
| in production
| 20120127 1130 PST
|
* {{bug|719697}} - robocop isn't signed properly from buildbot builds
|-
| in production
| 20120127 1040 PST
|
* {{bug|721488}} - deployed new pageloader.xpi
|-
| in production
| 20120127 0730 PST
|
* {{Bug|719544}}. talos_from_source.py - Make the pine branch to allow downloading talos.zip from any place like on 'try'
* {{bug|717662}} - Please disable debug builds and tests on the profiling branch
* {{bug|720782}} - If we dont_build a platform on project_branches we should not add testers for it
* {{bug|721360}} - Bug 698827 - Run 10.5 leak builds on 10.6 machines for aurora
* {{bug|721573}} - Sign the profile branch nightlies using the m-c nightly key
* {{bug|717106}} - Release automation for ESR
* {{bug|698827}} - Bug 698827 - Run 10.5 leak builds on 10.6 machines for aurora
* {{bug|715966}} - branch 1.9.2 confusingly set on talos tbpl logs
* {{bug|718828}} - Don't wait for NFS cache at the end of the updates builder
* {{bug|705403}} - <strike>Sendchanges [on windows] from build steps are being done from old buildbot version</strike> - backed out
* {{bug|683417}} - retry.py didn't actually kill process tree for a timed-out pushsnip
* {{bug|673834}} - Obsolete ReleaseRepackFactory, fold logic into CCReleaseRepackFactory
|-
| in production
| 20120123 1435 PST
|
* {{bug|719859}} - remove double posting ts_paint and tpaint. p=armenzg
* {{bug|718445}} - stage-old should be referenced as stage in scripts/configs. p=bhearsum
|-
| in production
| 20120123 1405 PST
|
* {{Bug|649641}} - use ntpd on linux32/linux64 ix slaves
|-
| in production
| 20120123 1140 PST
|
* {{Bug|711619}} - Add Android builds+tests and periodic PGO on the Fx-Team branch, p=philor
* {{Bug|719859}} - Side by side on mozilla-central for ignore_first changes. p=jmaher
|-
| in production
| 20120123 0730 PST
|
* {{bug|705403}} - Sendchanges [on windows] from build steps are being done from old buildbot version
* {{bug|719772}} - Sign Callek up for the full release process e-mails
* {{bug|716561}} - reevaluate which release mail gets sent to release-drivers
* {{bug|561198}} - compress leak test / codesighs logs prior to uploading
* {{bug|699219}} - Add automated clean up of hg-shared directory
* {{bug|714284}} - L10n mac dep builds busted on central and aurora
* {{bug|719261}} - Add more logging to AggregatingScheduler
|-
| in production
| 20120119 1200 PST
|
* {{bug|719504}} - disable peptest.
* {{bug|715219}} - off-by-one bustage fix for tegra android range
|-
| in production
| 20120119 1100 PST
|
* {{bug|699219}} - purge shared hg repos
|-
| in production
| 20120117 1230 PST
|
* {{bug|695351}} - android mochitests to use in-tree manifest
* {{bug|700415}} - peptest on try
* {{bug|712750}} - print more data for screenresolution in buildbot factories
|-
| in production
| 20120117 0800 PST
|
|
* {{Bug|698827}} - Run 10.5 leak builds on 10.6 machines for try. p=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| in production
| in production
| 20120116 1325 PST
| 2017-09-14 03:55 PT
|
|
* Require branch parameter to clobberer HTML interface
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| in production
| in production
| 20120113 07:00 PST
| 2017-09-06 10:14 PT
|
|
* {{bug|714490}} - make hgtool handle mirror/master hg outages better
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
|-
|-
| in production
| in production
| 20120112 16:40 PST
| 2017-08-31 06:50 PT
|
|
* {{bug|712422}} - add a --bootstrap cli flag to reftest/crashtest/jsreftest for android
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|698425}} - enable android and android-xul l10n repacks
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* Bustage fix. Changeset fa1c76238b7c
</div>
* {{bug|713442}} - point 1.9.2 release configs to the compare-locales RELEASE_0_8_2 tag
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|717621}} - Remove decomissioned slaves
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
* {{bug|698425}} - android and android-xul l10n mozconfig
* {{bug|567274}} - Talos should halt on download or unzip failure
|-
|-
| in production
| in production
| 20120109 1806 PST
| 2017-08-06 22:46 PT
|
|
* stage rather than masters
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|712008}} - Always trim revision to 12 chars
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|716431}} - Block asc files for partial mars in latest-<branch> dirs (stage
</div>
|-
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
|-
|-
| in production
| in production
| 20120106 1300 PST
| 2017-08-04 03:42 PT
|
|
* {{bug|715623}} - add --cachedir support to signtool.py
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
|-
|-
| in production
| in production
| 20120104 1315 PDT
| 2017-08-02 00:27 PT
|
|
* Back out 7a7847f7fc05 ({{bug|711275}}: Make sure appVersion changes with every Firefox 10 beta)
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|712008}} - Pass platform to post_upload.py for shark
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|681948}} - Automatically retry after a devicemanager.DMError
</div>
* {{bug|715119}} - [signing-server] Bump token TTL
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|713161}} - new high tegra added
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|711221}} - turn on create_snippet and create_partial for profiling branch
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
* {{bug|712150}} - bustage fix for linux,m-r and xulrunner in-tree mozconfig path
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 20111222 0800 PDT
| 2017-07-31 04:12 PT
|
|
* {{Bug|710350}} - Don't hard-code 'firefox' and 'fennec' in misc.py.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|707152}} - enable leaktest for 10.6 everywhere except some release branches.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|711367}} - enable android-xul tests
</div>
* {{Bug|673131}} - Enable talos_from_source_code.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|712094}} - re-enable aurora updates.  
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* {{bug|711275}} - Make sure appVersion changes with every Firefox 10 beta. r=rail
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| in production
| in production
| 20111221
| 2017-06-12 03:31 PT
|
|
* {{bug|683734}} - added a bunch of talos-r3 slaves to production
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
|-
|-
| in production
| in production
| 20111221 1300 PST
| 2017-06-05 06:32 PT
|
|
* {{bug|558180}} - use in-tree mozconfigs for releases
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|709114}} - add locales to aurora
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|710842}} - re-enable symbols for nightly fennec xul builds
</div>
* {{bug|711221}} - rename private-browsing branch to 'profiling'
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|712133}} - firefox 10.0b1 release configs
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
|-
|-
| in production
| in production
| 20111221 1100 PST
| 2017-06-05 02:12 PT
|
|
* {{bug|712208}} - update binutils to 2.22
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 20111220 0610 PST
| 2017-05-11 06:12 PT
|
|
* <strike>{{bug|673131}} - when minor talos changes land, the a-team should be able to deploy with minimal releng time required</strike> - backed-out
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|704582}} - [tracking bug] deploy 83 tegras
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|712115}} - L10n mac nightlies busted on central and aurora
</div>
* {{bug|710453}} - Release Engineering changes for the Firefox 11 merge to Aurora on Dec 20
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|712094}} - push mozilla-aurora updates to auroratest channel until merge stabilizes
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
* {{bug|712068}} - Adjust default releasetestUptake value
|-
| in production
| 20111219 1000 PST
|
* {{bug|707941}} - Improve token generation step
* {{bug|711179}} - fix for missing symbols for non-mobile tests
* {{bug|710453}} - android-xul mozilla-release mozconfigs
* {{bug|711978}} - Refresh staging release configs
|-
|-
| in production
| in production
| 20111217 0800 PST
| 2017-03-16 07:25 PT
|
|
* {{bug|509158}} - enable signing on all branches
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|-
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| backed out
</div>
| 20111216 1700 PST
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
|
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|705403}} - Sendchanges [on windows] from build steps are being done from old buildbot version
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 20111215 0830 PST
| 2017-03-10 15:02 PT
|
|
* {{bug|711064}} Fix puppet dependencies
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| in production
| in production
| 20111214 0800 PST
| 2017-03-10 10:11 PT
|
|
* {{bug|509158}} Reduce default token time to 2 hours; fix last-complete-mar detection
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|683734}} Add new rev3 machines.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|708475}} accept 'mochitest' and 'reftests' as synonyms for 'mochitests' and 'reftest' (with tests)
</div>
* {{bug|708859}} android signature verification should look for android-arm.apk
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|709233}} reenable android and android-xul multilocale for m-c nightlies
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
* {{bug|709383}} Turn off win64 signing on m-c
* {{bug|709979}} Set the branch property for projects/addon-sdk jobs to just addon-sdk
* {{bug|710048}} decrease interval between mozilla-inbound pgo builds
* {{bug|710050}} never merge pgo builds
* {{bug|710085}} Pass mozillaDir argument to NightlyBuildFactory
* {{bug|710221}} Implement AggregatingScheduler
|-
|-
| in production
| in production
| 20111208 0920 PST
| 2017-03-09 13:18 PT
|
|
* {{bug|509158}} Fix nightly snippet generation, reduce default token time, and enable signing on inbound
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|707666}} Enable win64 signing on elm
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|708341}} Turn off android-xul talos tests
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 20111206 1300 PST ish
| 2017-03-06 11:57 PT
|
|
* {{bug|509158}} Don't enable signing for l10n check steps.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|509158}} Sign builds as part of the build process: enable signing server for debug builds; disable pre-signed updater on elm.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|671450}} Try different sources for revision in log_uploader
</div>
* {{bug|706832}} Implement master side token generation for signing on demand.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|509158}} Enable signing for mozilla-central windows builds.
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
* {{bug|704549}} reenable android native on m-c.
* {{bug|703772}} disable android-xul updates + uploadsymbols.
|-
|-
| in production
| in production
| 20111205 0800 PST
| 2017-03-06 11:49 PT
|
|
* {{bug|509158}} - signing builds (elm/oak only, hopefully)
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|706832}} - Implement master side token generation for signing on demand. r=catlee,bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|671450}} - Try different sources for revision in log_uploader - r=nthomas
</div>
* {{bug|707152}} - enable leaktests for m-i, try and m-c on macos64-debug. r=rail.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|706720}} - Post to graphs-old. r=catlee
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| in production
| in production
| 20111202 1600 PST
| 2017-03-03 13:50 PT
|
|
* {{bug|509158}} - tools for signing builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
|-
|-
| in production
| in production
| 20111201 1100 PST
| 2017-03-03 12:53 PT
|
|
* {{bug|694332}} - Use make tier_nspr when building for l10n - r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|693352}} r=aki add minidump_stackwalk and symbols to the android automation
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|705936}} - reconfigs should re-generate master_config.json a=aki
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| in production
| in production
| 20111201 0900 PST
| 2017-03-01 11:50 PT
|
* {{bug|704555}} - deploy rss for tp4m on android (required android talos update)
|-
| in production
| 20111128 1448 PST
|
|
* {{bug|701684}} - remove mozilla-1.9.1 from config.py. r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* add r4 slaves 080-085 to configs r=catlee
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|705040}} - reenable native android builds on try. r=bhearsum
</div>
* {{bug|691483}} - update MU to 3.6.24 -> 8.0.1, r=lsblakk
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
|-
| in production
| in production
| 20111124 0815 PST
| 2017-02-27 19:34 PT
|
|
* {{bug|703010}} - backfill unresponsive tegras
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|702390}} - reimage buildbot-master2 and buildbot-master5 as w32-ix-slave43 and w32-ix-slave44
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|702351}} - deploy talos.zip which includes responsiveness
</div>
* {{bug|699838}} - Set up a project branch to allow us to run several iterations for metrics
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|700534}} - make local buildbot-config modification on test-master01 permanent
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
* {{bug|700860}} - Put mw32-ix-slave26 into the production pool
* {{bug|676155}} - install r3 mini 02456 as talos-r3-w7-065
* {{bug|704028}} - xulrunner release bundles often timeout
* {{bug|697802}} - https://bugzilla.mozilla.org/show_bug.cgi?id=697802
|-
|-
| in production
| in production
| 20111121 1300 PST
| 2017-02-27 18:50 PT
|
|
* {{bug|702351}} - enable tp_responsiveness on m-c
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|700705}} - remove more slaves
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* add talos-r4-snow-060 to 080 back to the pool
</div>
* {{bug|692692}} - re-enable PGO for Win64
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|701766}} - Remove tegra slaves that had not taken any jobs and are not coming back to production any time soon
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
* {{bug|704200}} - android dep builds permared after bug 701864; sometimes causing nightlies not to trigger - disable native android builders everywhere except birch
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| in production
| in production
| 20111118 0700 PST
| 2017-02-27 13:40 PT
|
|
* {{bug|700513}} - set BINSCOPE for win32 on try
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|702631}} - linux, linux64 and mac partner repacks aren't triggered
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|703280}} - Use dev-stage01 as SYMBOL_SERVER_HOST for staging try builds
</div>
* {{bug|702351}} - deploy talos.zip which includes responsiveness
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| in production
| in production
| 20111117 0600 PST
| 2017-02-27 11:56 PT
|
|
* {{bug|702834}} - Pass mozillaDir to dep factory.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|701864}} - support mobile builds+repacks out of mobile/, mobile/xul/, and mobile/android/.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|701766}} - remove staging tegras.
</div>
* {{bug|700513}} - Add BINSCOPE env var to win32, win32-debug, and win32-mobile
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|701476}} - split android reftests from 2 chunks to 3 chunks.
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
* {{bug|702357}} - enable new tegras for production
* {{bug|702368}} - add hangmonitor.timeout=0 pref to dirty jobs.
* {{bug|702645}} - win32_repack_beta broken due to "LINK : fatal error LNK1104: cannot open file 'mozcrt.lib'".
* {{bug|548551}} - Turn off arm nanojit builds.
* {{bug|700705}} - Remove a bunch of decomissioned slaves.
* {{bug|683734}} - remove talos-r3-snow machines, remove snowleopard-r4 platform, move talos-r4-snow to snowleopard platform
|-
|-
| in production
| in production
| 20111116 0700 PST
| 2017-02-24 13:02 PT
|
|
* {{Bug|702351}} - deploy talos.zip which includes responsiveness
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
|-
|-
| in production
| in production
| 20111111 1712 PST
| 2017-02-23 06:27 PT
|
|
* {{bug|697389}} - multilocale birch android nightlies, against l10n-central.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|697404}} - disable tp4m for birch
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
|-
| in production
| in production
| 20111110 1200 PST
| 2017-02-17 09:50 PT
|
|
* {{bug|700901}} - reorder mozconfig to get past mozconfig diff. p=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|700901}} - fix l10n relbranch. p=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|701116}} - Mobile desktop builds should be nightly-only. p=rail
</div>
* {{bug|701113}} - maemo tier 3 (removing all maemo references except mobile/) p=aki
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|672132}} - Run beta and release releases in preproduction. p=rail
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|698946}} - further setup-masters.py improvements p=jhford
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
| in production
| in production
| 20111108 1630 PST
| 2017-02-16 13:27 PT
|
|
* {{Bug|699407}} - Set mirror / bundle URLs. p=catlee
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|700721}} - update buildbot-configs for merge of nightly->aurora and aurora->beta p=lsblakk
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|700453}} - make test-master01 tegra specific. p=aki
</div>
* {{Bug|700794}} - Disable aurora daily updates until merge to mozilla-aurora is good. p=armenzg
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|700737}} - Remove slaves given to Thunderbird. p=armenzg
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
|-
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
| in production
| 20111108 1100 PST
| {{bug|687064}} - hgtool work. p=catlee
|-
| in production
| 20111107 0930 PDT
| {{bug|660124}} - remove "paint" set. p=armenzg
|-
|-
| in production
| in production
| 20111107 0845 PDT
| 2017-02-15 12:50 PT
|
|
* {{bug|692812}} - add ability to have pgo strategies p=jhford
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|693771}} - add 10.7 test slaves to buildbot configs p=jhford
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|698837}} - use signed updater.exe for elm and oak branches. p=bhearsum
</div>
* {{Bug|695921}} - removing duplicated entry for ftp_url on jetpack p=lsblakk
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|698837}} - use signed updater.exe for elm and oak project branches. p=bhearsum
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* {{Bug|660124}} - replace ts/twinopen for ts_paint/tpain and some cleanup. p=armenzg
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
* {{Bug|699802}} - enable_leaktests for m-i and try. p=armenzg
|-
|-
| in production
| in production
| 20111028 1205 PDT
| 2017-02-08 13:10 PT
|
|
* {{bug|695707}} - mozharness should be tagged automatically for 8.0+ releases
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|695921}} - test per checkin addons-sdk against opt & debug across mozilla-{beta,central,aurora,release} latest tinderbox builds
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| in production
| in production
| 20111025 1200 PDT
| 2017-02-08 12:19 PT
|
|
* {{bug|681855}} - Frequent Tegra "Cleanup Device exception" or "Configure Device exception" from "Remote Device Error: devRoot from devicemanager [None] is not correct"
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|697112}} - add more twigs
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|689649}} - update buildbot config.py to adjust side by side talos staging for mozafterpaint
</div>
* {{bug|695707}} - mozharness should be tagged automatically for 8.0+ releases
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| in production
| in production
| 20111021 0932 PDT
| 2017-01-23 03:51 PT
|
|
* {{bug|683448}} - Permission check and virus scan tests shouldn't fail if files pushed to the releases directory
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|689649}} - disable old_suites for mozilla-beta
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|692504}} - push betas to internal mirrors automatically
</div>
* {{bug|693015}} - disable android debug tests
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|694077}} - add aus2_mobile_* to the "update branch vars loop" in config.py
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* {{bug|694893}} - Bump disk space requirement for codecoverage to 7G
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* {{bug|695161}} - backout 1318d1bbc15a to re-enable Win64 updates
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
* {{bug|695429}} - FF8 beta4 config changes
* {{bug|696165}} - enable tegras 129 - 153
|-
|-
| in production
| in production
| 20111019 1100 PDT
| 2017-01-05 04:33 PT
| {{bug|695525}} Pulse enabled on test-master01
|-
| in production (build only)
| 20111017 1728 PDT
|
|
* {{bug|695161}} Disable updates to broken Win x64 builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|-
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| in production
</div>
| 20111017 1100 PDT
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
|
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* {{bug|690860}} enable android debug nightly on m-c
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
* {{bug|694235}} config tests shouldn't fail if there are no try slaves
* {{bug|694106}} remove tegra try pool
* {{bug|676879}} Config changes required to run valgrind as a nightly builder
* {{bug|694716}} patch by joel to fix broken mochitests due to bug 691411
* {{bug|694077}} Enable nightlies builds and updates for birch branch
|-
| in production
| 20111017 0900 PDT
|
* {{bug|694579}} deployed newer talos.zip
|-
| in production
| 20111012 0735 PDT
|
* backout {{bug|692928}}.jhford
* {{Bug|693903}} Update slaves for staging and preproduction configs. rail
* {{Bug|692823}} Reduce PGO sets to 6 hours until bug 691675 is fixed. armenzg
* {{Bug|693686}} PGO talos is submitting to the Firefox-Non-PGO tree. armenzg
|-
| in production
| 20111011 1515 PDT (for build masters, others later
|
* {{bug|693350}} - Don't try to add bouncer entries in preproduction
* {{bug|692388}} - mozharness MercurialVCS with HG_SHARE_BASE_DIR set completely ignores specified revision
* No Bug, do compare_attrs better for DependentL10n, so we don't throw in dump_masters. Will followup later to get compare_attrs better for all of buildbotcustom. Not used for Firefox builds, so NPOTB
* {{bug|693686}} - PGO talos builds reporting to Non-PGO branches
* {{bug|693794}} - remove unneeded usebuildbot=1 from tbpl links in try emails
|-
| in production
| 20111007 1550 PDT
|
* {{bug|692928}} turn off rev4 on try
* {{bug|692910}} Update preproduction test slave list
* {{bug|688296}} python module conflict with xcode module
* {{bug|692646}} enable PGO on release builds again
* {{bug|692388}} mozharness MercurialVCS with HG_SHARE_BASE_DIR set completely ignores specified revision
|-
| in production
| 20111006 1230 PDT
|
* {{bug|681834}} Insert finished jobs in the statusdb more frequently
* {{bug|686578}} SpiderMonkey builds on IonMonkey TBPL - enable all debug spidermonkey builds on ionmonkey
* {{bug|687832}} create generic RETRY signifier, and make retry.py print it when it fails to successfully run * * {{bug|692358}} Fix log uploading for PGO builds and tests
* {{bug|692370}} Add branch name to PGO scheduler so that it shows up on self-serve
|-
| in production
| 20111005 1050 PDT
|
* {{bug|558180}} - use in tree mozconfigs for win64
* {{bug|658313}} - disable PGO for per-checkin builds
* {{bug|683721}} - add rev4 testers to buildbot-configs
* {{bug|668724}} - ensure branch is not None when needed
|-
| in production
| 20111005 1821 PDT
|
* Backed out: {{bug|671450}} - Use buildid and rev to create tinderbox-builds path (post_upload.py part)
|-
| in production
| 20111005 1632 PDT
|
* {{bug|671450}} - Backout log_uploader.py change, as got_revision doesn't exist on test jobs
|-
| in production
| 20111005 1546 PDT
|
* {{bug|671450}} - Use buildid and rev to create tinderbox-builds path (buildbot part)
* {{bug|686831}} - Stop TinderboxPrint-ing the rev early for try
* {{bug|691483}} - Do 3.6.23 -> 7.0.1 advertised major update
* {{bug|689750}} - stop sending sendchanges to jhfords personal master
|-
| in production
| 20111005 1526 PDT
|
* {{bug|671450}} - Use buildid and rev to create tinderbox-builds path (post_upload.py part)
|}
|}
==Archive==
[[ReleaseEngineering:BuildbotMasterChanges:Archive | Older Changes]]
=Android Testing=
== Web Server Cluster ==
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Revision'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
| 3efbac1f685a
| unknown
| unknown
| unknown
|}
Update Procedure:
ssh to bm-remote-talos-webhost-01
cd /var/www/html/talos
hg pull && hg up
rsync -azf --delete . bm-remote-talos-webhost-02:/var/www/html/.
rsync -azf --delete . bm-remote-talos-webhost-02:/var/www/html/.
Servers:
* bm-remote-talos-webhost-01.build.mozilla.org
* bm-remote-talos-webhost-02.build.mozilla.org
* bm-remote-talos-webhost-03.build.mozilla.org
== clientproxy servers ==
Production
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
| 2a995b4ed124
| 31249cbe4f19
| bfc910cd8dd3
| ae5d6911905a
| talos: {{bug|629503}}
| 20110202 23:00 PDT
| bear
|}
Pending
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
|
|
|
|
|
|
|
|}
Servers:
* bm-foopy01.build.mozilla.org
* bm-foopy02.build.mozilla.org
/builds/cp
/builds/talos-data/talos
/builds/talos-data/talos/pageloader@mozilla.org
/builds/talos-data/talos/bench@taras.glek
/builds/sut_tools

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.allizom.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"