ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://mxr.mozilla.org/mozilla/source/testing/performance/talos/ talos]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/puppet/ puppet]


'''Are you changing the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
= Non-releng repositories involved in the CI =
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
 
= Mozharness deployments =
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/mozharness/graph the mozharness repository] are live immediately.  Please see that repo for push history.
 
= Puppet deployments =
 
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
 
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
 
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.


= Reconfigs / Deployments =
= Reconfigs / Deployments =
This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems.
This page is updated by the person who does a [[ReleaseEngineering:Buildduty:Reconfigs|reconfig]] on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as <i>mozharness</i> changes.)


'''Did you change the tool chain on a master?  If so, let auto-tools know so they can update their masters'''
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 25: Line 40:
|-
|-
| in production
| in production
| 2012-04-17 0630 PDT
| 2017-09-21 07:51 PT
|
|
* {{bug|739778}} - preproduction in scl3
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|744119}} - decommission osx builder
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|744958}} - updateSUT.py fixes
</div>
* {{bug|741751}} - partner repack signing fixes
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|745538}} - TB mozmill test steps
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
* {{bug|745469}} - Turn off tinderbox mail for spidermonkey builds
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| in production
| in production
| 2012-04-12 1830-45 PDT
| 2017-09-14 03:55 PT
|
|
* {{bug|722759}} - switch non-try symbols to symbols1.dmz.phx1.mozilla.com
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|741657}} - Switch to aus3-staging
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|730325}} - Pass product name to reallyShort()
</div>
* {{bug|744495}} - xulrunner pulse messages
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| in production
| in production
| 2012-04-10 various times
| 2017-09-06 10:14 PT
|
|
* {{bug|720027}} - enable lion builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
|-
|-
| in production
| in production
| 2012-04-10 1100 PST
| 2017-08-31 06:50 PT
|  
|
* {{bug|744049}} - tcheckerboard always reports 1.0 (tegra talos web server updated to talos tip)
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| in production
| in production
| 2012-04-09 0700 PDT
| 2017-08-06 22:46 PT
|
|
* {{bug|607392}} - split tagging into en-US and other
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|721885}} - shut off unused branch
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|400296}} - Have release automation support signing OSX builds (up to 10.7 support)
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
|-
|-
| in production
| in production
| 2012-04-04 11:00 PDT
| 2017-08-04 03:42 PT
|
|
* {{bug|690311}} - deploy newer version of cleanup.py to the foopies
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
|-
|-
| in production
| in production
| 2012-03-30 6:15 PDT
| 2017-08-02 00:27 PT
|
|
* {{bug|738588}} - add ts_paint to the android tests.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|737458}} - replace tpr_responsiveness for tp5row.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|737458}} - add tpr_responsiveness temporarily for mozilla-central and larch.
</div>
* {{bug|740599}} - update staging release config files;
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2012-03-29 6:55 PDT
| 2017-07-31 04:12 PT
|
|
* {{Bug|715193}} - If a branch does not use talos_from_source_code we should fallback to talos.mobile.old.zip (fixes esr10).
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| in production
| in production
| 2012-03-28 16:35 PDT
| 2017-06-12 03:31 PT
|
|
* {{Bug|740196}} - ts_paint on Android doesn't actually work
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
|-
|-
| in production
| in production
| 2012-03-28 11:55 PDT
| 2017-06-05 06:32 PT
|
|
* {{Bug|737632}} - Remove jaegermonkey, graphics and pine to reduce builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|723667}} - fix Android trobocheck and ts_paint tests.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|739486}} - test-masters.sh should run ./setup_master.py -t
</div>
* add option to setup_master.py to print error logs when hit
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|723667}} - enable trobopan and tcheckerboard by default (not for m-a/m-b/m-r/1.9.2)
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
* {{Bug|627182}} - Automate signing and publishing of XULRunner builds. r=bhearsum
|-
|-
| in production
| in production
| 2012-03-27 12:30 PDT
| 2017-06-05 02:12 PT
|
|
* {{Bug|723667}} - Add trobopan and trobocheck to m-c/m-i. r=jmaher
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 2012-03-23 11:30 PDT
| 2017-05-11 06:12 PT
|
|
*{{bug|627182}}
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
*{{bug|738685}}
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
*{{bug|734223}}
</div>
*{{bug|738286}}
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
*{{bug|719491}}
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
*{{bug|737656}}
*{{bug|715193}}
*{{bug|702595}}
*{{bug|735383}}
|-
|-
| in production
| in production
| 2012-03-27 01:35 PDT
| 2017-03-16 07:25 PT
|
|
* {{Bug|739505}} - [http://hg.mozilla.org/build/buildbot-configs/rev/3c424821358a Fix talos] on beta
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 2012-03-23 7:00 PDT
| 2017-03-10 15:02 PT
|
|
* {{Bug|737864}} - Tweak release category for Thunderbird.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|737458}} - add tp5row side by side and cleanup config.py.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|737581}} - enable peptest on m-c and m-i.
</div>
* {{Bug|713846}} - Treat 'fennec' builds as having product 'mobile' for the purposes of uploading logs.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| backout
| in production
| 2012-03-21 11:45 PDT
| 2017-03-10 10:11 PT
|
|
* {{Bug|737427}}. Use 1024x768 as the screen resolution for the tegras.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
|-
|-
| in production
| in production
| 2012-03-21 9:30 PDT
| 2017-03-09 13:18 PT
|
|
* {{Bug|737427}}. Use 1024x768 as the screen resolution for the tegras.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|697150}}. (Bv1) Remove 'ac_add_options --disable-installer' for XulRunner current branches.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|733394}}. Add leak test logic to mozilla-beta.
</div>
* {{Bug|736587}}. Enable Android for pine.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 2012-03-20 8:30 PDT
| 2017-03-06 11:57 PT
|
|
* {{bug|723667}} - enable talos robocop for pine and only for native tests
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|737077}} - re-enable aurora updates
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|713846}} - unified log handling
</div>
* {{bug|734320}} - fix jetpack log parsing
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|737049}} - run reftest-no-accel correctly
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
* {{bug|723386}} - fix reserved slaves handling
|-
|-
| in production
| in production
| 2012-03-19 10:30 PDT
| 2017-03-06 11:49 PT
|
|
* {{bug|736284}} - re-enable aurora updates
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| in production
| in production
| 2012-03-16 8:45 PDT
| 2017-03-03 13:50 PT
|
|
* {{bug|734996}} - fennec beta release update channel -> beta.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|734221}} - deploy updateSUT.py and upgrade the boards to SUT Agent version 1.07.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|734996}} - source: get a nonce earlier
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
|-
|-
| in production
| in production
| 2012-03-13 17:00 PDT
| 2017-03-03 12:53 PT
|
|
* {{bug|735201}} - Remove leading ../ from symbols path for tegras
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|735421}} - Disable Aurora updates until the Aurora 13 has stabilized
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| in production
| in production
| 2012-03-12 16:00 PDT
| 2017-03-01 11:50 PT
|
|
* {{bug|734417}} - enable mobile builds on the profiling branch
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|731617}} - No nightly builds on maple branch since 27 Feb
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|732285}} - Set MINIDUMP_STACKWALK for Android
</div>
* {{bug|733668}} - Include "ERROR: We tried to download the talos.json file but something failed" and "ERROR 500: Internal Server Error" for Talos hgweb operations to RETRY
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|630518}} - l10n verify, update verify, and final verification builders need to set "branch" when reporting to clobberer
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
|-
| in production
| in production
| 2012-03-08 09:00 PT
| 2017-02-27 19:34 PT
|
|
* {{Bug|731814}} - Add checks that we're not exceeding max # of builders per slave.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|731617}} - Remove win64 for now in maple.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|731339}} - Remove slaves that are not production
</div>
* {{Bug|732730}} - Remove non-functional and unwanted pgo_platforms overrides
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|732110}} - remove buildbot-configs/mozilla2/mobile
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
* {{Bug|728271}} - Post to graphs.m.o instead of graphs-old.m.o
* {{Bug|729144}} - Post to graphs.allizom.org.
* {{Bug|723667}} - Add robocop disabled.
* {{bug|730050}} - TryBuildFactory looks in the wrong place for malloc.log
* {{Bug|712538}} - leaktest parity on try
* {{Bug|723667}} - Use talos.zip for tegras and prep work for talos robocop
|-
|-
| in production
| in production
| 2012-03-06 06:30 PT
| 2017-02-27 18:50 PT
|
|
* {{bug|732500}} - Enable nightly updates on maple
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|732699}} - ESR release automation should push to mirrors automatically
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|730918}} - Android on esr10 is busted, no doubt by branding since that always seems to be the problem
</div>
* {{bug|561754}} - Don't download symbols for test runs, pass symbol zip URL as symbols path
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|732516}} - l10n verification shouldn't rsync zip files
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
* {{bug|732468}} - Add the ridiculous "abort: error:" to the list of hg errors that trigger RETRY
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| in production
| in production
| 2012-03-01 7:30 PT
| 2017-02-27 13:40 PT
|
|
* {{Bug|721360}} - Do what changeset 9a0c428bdb69 really wanted to do.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|561754}} - Disable symbol download on demand for mozilla-1.9.2 branch.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|660480}} - mark as RETRY for common tegra errors
</div>
* {{Bug|729918}} - start_uptake_monitoring builder uses wrong script_repo_revision property.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|561754}} - Download symbols on demand by default for desktop unittests.
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| in production
| in production
| 2012-02-27 7:45 PT
| 2017-02-27 11:56 PT
|
|
* {{bug|729077}} - recycle talos-r4-lion-083 and talos-r3-snow-081 as mac-signing[12]
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Fix up staging and preproduction test slave lists.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|729426}} - Do periodic PGO on services-central
</div>
* {{bug|727580}} - linux-android for esr10, without merging 11.0 to m-r.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
|-
|-
| in production
| in production
| 2012-02-21 9:30 PT
| 2017-02-24 13:02 PT
|
|
* {{bug|719511}} - add optional reboot command to ScriptFactory
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|725292}} - some repacks failed in 11.0b2 because of missing tokens
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|728104}} - AggregatingScheduler resets its state on reconfig
</div>
* {{Bug|722608}} - Remove android signature verification
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{Bug|719260}} - Investigate why updates builder triggered twice for 10.0b5
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
* {{bug|719511}} - Reenable peptest + add reboot_command
* {{bug|712678}} - android-xul different update channel from android
 
|-
|-
| in production
| in production
| 20120217 1148 PST
| 2017-02-23 06:27 PT
|
|
* {{bug|721822}} - remove talos_from_code.py from the tools repo
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
|-
| in production
| in production
| 20120214 1245 PST
| 2017-02-17 09:50 PT
|
|
* {{bug|726901}} - adjust resolution for reftests to 1600x1200
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|689989}} - restore /system/etc/hosts on testing tegras
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
| in production
| in production
| 20120213 1200 PST
| 2017-02-16 13:27 PT
|
|
* {{bug|725727}} - reduce # of chunks for update_verify.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|607392}} - split tagging into en-US and other.  
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
|-
|-
| in production
| in production
| 20120208 01:20 PST
| 2017-02-15 12:50 PT
|
|
* {{bug|723954}} - 11.0b2 configs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|718385}} - android single locale updates
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|717106}} - Release automation for ESR
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
|-
| in production
| in production
| 20120207 13:00 PST
| 2017-02-08 13:10 PT
|
|
* {{bug|719443}} - add robocop unitttest testtype
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|715715}} - download & install robocop for robocop test suites
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|725046}} - Re-enable mobile aurora updates
</div>
* {{Bug|554324}} - Only set MOZ_PKG_VERSION when appVersion != version
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* [BACKED OUT] - <strike>{{bug|719511}} - optional ScriptFactory reboot().</strike>
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| in production
| in production
| 20120202 15:50 PST
| 2017-02-08 12:19 PT
|
|
* {{bug|723743}} - android native to en-US (no multilocale); disable android-xul single locale repacks.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|719697}} - --disable-tests on android* l10n-mozconfigs.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|723277}} - don't enable remot
</div>
|}
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
 
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
=Android Testing=
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
== Web Server Cluster ==
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
{| class="fullwidth-table sortable"
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
| style="background:#cccccc" | '''Revision'''
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
| style="background:#cccccc" | '''Bug #'''
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
|-
| 3efbac1f685a
| in production
| unknown
| 2017-01-23 03:51 PT
| unknown
|
| unknown
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|}
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
 
</div>
Update Procedure:
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
ssh to bm-remote-talos-webhost-01
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
cd /var/www/html/talos
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
hg pull && hg up
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
rsync -azf --delete . bm-remote-talos-webhost-02:/var/www/html/.
rsync -azf --delete . bm-remote-talos-webhost-02:/var/www/html/.
 
Servers:
* bm-remote-talos-webhost-01.build.mozilla.org
* bm-remote-talos-webhost-02.build.mozilla.org
* bm-remote-talos-webhost-03.build.mozilla.org
 
== clientproxy servers ==
 
Production
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
|-
| 2a995b4ed124
| in production
| 31249cbe4f19
| 2017-01-05 04:33 PT
| bfc910cd8dd3
|
| ae5d6911905a
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| talos: {{bug|629503}}
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| 20110202 23:00 PDT
</div>
| bear
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|}
|}
Pending
{| class="fullwidth-table sortable"
| style="background:#cccccc" | '''Talos Rev'''
| style="background:#cccccc" | '''Pageloader Rev'''
| style="background:#cccccc" | '''Taras Bench Rev'''
| style="background:#cccccc" | '''sut_tools'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Who'''
|-
|
|
|
|
|
|
|
|}
Servers:
* bm-foopy01.build.mozilla.org
* bm-foopy02.build.mozilla.org
/builds/cp
/builds/talos-data/talos
/builds/talos-data/talos/pageloader@mozilla.org
/builds/talos-data/talos/bench@taras.glek
/builds/sut_tools

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.allizom.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"