ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/puppet/ puppet]


= Ready to rollout =
= Non-releng repositories involved in the CI =
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)


{| class="fullwidth-table sortable"
= Mozharness deployments =
| style="background:#cccccc" | '''Bug #'''
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/mozharness/graph the mozharness repository] are live immediately.  Please see that repo for push history.
| style="background:#cccccc" | '''Description'''
 
| style="background:#cccccc" | '''machine name(s)'''
= Puppet deployments =
| style="background:#cccccc" | '''Urgency'''
| style="background:#cccccc" | '''Status'''
| style="background:#cccccc" | '''Need downtime?'''
| style="background:#cccccc" | '''Owner'''
|-
| {{bug|459269}}
| setup places project branch  
| production-master and staging-master
| medium
| ready to land, tested on staging
| no - but downtime would be better
| lsblakk
|-
|{{bug|473821}}
| add tp4 test to moz-central only (first step in full rollout of tp4)
| qm-rhel02, talos-master
| high
| ready to land
| YES
| alice
|-
| {{bug|486614}}
| Puppet on Linux (moz2-* machines)
| moz2-linux-*
| medium (q2 goal)
| ready to go
| no
| bhearsum
|-
| {{bug|496712}}
| rename try build dirs / Corrupt file system on WINCE & Windows hg builder? Requires some buildbot upgrade (per bhearsum in irc)
| try master
| low
| ready for landing
| yes
| bhearsum
|-
| {{bug|500076}}
| wince mozconfig update
| try master (update only)
| low
| ready for landing
| no
| aki
|}


= Upcoming changes =
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.


{| class="fullwidth-table sortable"
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''Description'''
| style="background:#cccccc" | '''Master'''
| style="background:#cccccc" | '''Urgency'''
| style="background:#cccccc" | '''Status'''
| style="background:#cccccc" | '''Need downtime?'''
|-
| {{bug|480081}}
| buildbotcustom changes for l10n nightly updates, toggled on for m-c and off for 1.9.1
| production-master
| low
| backed out due to errors
| no
|-
| {{bug|487329}}
| graph server migration (switch from using graphs.m.o to graphs-new.m.o full time)
| qm-rhel02, talos-master, production-master
| medium
| ready to land, waiting on blog post/IT assistance for fixing links broken with the migration
| yes
|-
| {{bug|498715}}
| Release builder prioritization
| production-master
| low
| ready to land, tested in staging.  requires buildbot master upgrade
| yes
|-
| {{bug|499506}} unpack.sh fails DMG unpacking when machine has slow I/O
| use an unmount script based on catlee's work
| anything running releases
| low
| ready for landing on tools
| none
|-
| {{bug|493752}}
| Reduce buildbot logging
| production-master
| low
| ready to land, tested in staging
| yes
|-
| {{bug|500246}}
| reset TryServer repo
| try-master
| low
|
| yes
|-
| unknown
| netapp firmware update (joint goal w/IT)
| unknown
| unknown
| unknown
| no
|-
| {{bug|463262}} automate nonsse unittest, being done manually for now
| unknown
| unknown
| unknown
| unknown
| unknown
|-
| unknown
| move to new faster keymaster ({{bug|496571}} required first)
| unknown
| unknown
| unknown
| unknown
|-
| {{bug|383136}} splitting out build-from-unittest
| Requires {{bug|493755}} (new installdmg.sh), and {{bug|448047}}
| unknown
| unknown
| unknown
| unknown
|-
| unknown
| roll out ability to get crash drumps from frozen browser on winxp/vista
| unknown
| unknown
| unknown
| unknown
|-
| unknown
| adding dirty profile test to talos
| unknown
| unknown
| unknown
| unknown
|-
| unknown
| install sshd on all windows talos slaves
| unknown
| unknown
| unknown
| unknown


|}
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.


= Previous changes =
= Reconfigs / Deployments =
This page is updated by the person who does a [[ReleaseEngineering:Buildduty:Reconfigs|reconfig]] on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as <i>mozharness</i> changes.)


Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


{| class="fullwidth-table sortable"
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]
 
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Bug #'''
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
| style="background:#cccccc" | '''Description'''
| style="background:#cccccc" | '''Master'''
| style="background:#cccccc" | '''Urgency'''
| style="background:#cccccc" | '''Status'''
| style="background:#cccccc" | '''reconfig/restart required'''
|-
| buildbotcustom portion backed out (because it was temporary)
| 20090629 0845 PDT
| {{bug|500422}}
| config bumps for 3.5 final tagging & source
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090626
| {{bug|483968}} talos should be able to get a stack trace from browser hangs
| fix for getting stack traces for frozen browsers on linux only
| cvs talos check-in
| low
| landed
| check-in
|-
| In production
| 20090626 0744 PDT
| {{bug|488732}}
| Do multiple unittest runs on a single build
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090626 0744 PDT
| {{bug|494622}}
| Vista machines not rebooting reliably
| talos-master
| low
| landed
| reconfig
|-
| In production
| 20090626 0744 PDT
| {{bug|488367}}
| Running JSS in talos pool, migrating JSS slaves over.
| talos master
| low
| landed
| reconfig
|-
| In production
| 20090626 0744 PDT
| {{bug|445611}}
|  Try server environment variables being set uniformly from env.py (2 patches, touches buildbotcustom so will affect production)
| try master
| low
| landed
| reconfig
|-
| In production
| 20090626 0744 PDT
| {{bug|473259}} /buildbotcustom/unittest/steps.py : update the rest of the code after bug 468023
| re-re-land Serge's patch to tinderbox
| production-master, etc
| low-medium
| landed
| reconfig
|-
| In production
| 20090626 0744 PDT
| {{bug|499398}}
| Fix off-by-one error when grabbing changeset ID
| try master
| low
| landed
| reconfig
|-
| In production
| 20090624 0037 PDT
| {{bug|499687}}
| relauto config & l10n-changesets for Fx 3.5rc3 build2
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090623 1608 PDT
| {{bug|499687}}
| relauto config & l10n-changesets for Fx 3.5rc3 build1
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090619 1300 PDT
| {{bug|498671}}
| Fix start time reporting
| production-master, talos-master
| medium
| ready to land
| reconfig
|-
| In production, then backed out.
| 20090617 1000 PDT
| {{bug|498701}}
| comment out config file bumps for ReleaseUpdatesFactory so we can re-run
| production-master
| high
| landed
| reconfig
|-
| In production
| 20091616 2034 PDT
| {{bug|498701}}
| relauto config for Fx 3.5rc2 build2
| production-master
| high
| landed
| reconfig
|-
| rowspan="2" | In production
| rowspan="2" | 20091616 1809 PDT
| {{bug|498701}}
| relauto config for Fx 3.5rc2 build1
| production-master
| high
| landed
| reconfig
|-
| {{bug|498757}}
| update l10n-changesets for Fx 3.5rc2 build1
| production-master
| high
| landed
| reconfig
|-
| In production
| 20091616 0830 PDT
| {{bug|495008}}
| linux desktop fennec builds/l10n repacks
| production-master
| medium
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|496509}}
| Step name cleanup for build database
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|495008}}
| Desktop Maemo builds/repacks
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|498188}}
| mozconfig-wince should contain --enable-jemalloc
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|471318}}
| Remove index.cgi from tinderbox urls
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|498468}}
| Reduce l10n polling interval
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090616 0830 PDT
| {{bug|488368}}
| Fetch symbols for nochrome talos tests on pool
| talos-master
| low
| landed
| reconfig
|-
| In production
| 20090615 1500 PDT
| {{bug|497721}}
| release automation config for fx3.5rc1 build2
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090612 1100 PDT
| {{bug|492808}}
| Improve clobber messages
| production-master
| low
| ready to land
| reconfig
|-
| In production
| 20090612 1100 PDT
| {{bug|497691}}
| Fix quoting on Tinderboxprint statements
| production-master
| low
| ready to land
| reconfig
|-
| In production
| 20090612 1100 PDT
| {{bug|448047}}
| Fix symbol unpacking, and have talos print out which slave is running
| talos-master
| low
| ready to land
| reconfig
|-
| In production
| 20090612 1100 PDT
| {{bug|496510}}
| Sendchange to Talos should include revision
| production-master
| low
| ready to land
| reconfig
|-
| In production
| 20090612 0515 PDT
| {{bug|497721}}
| config bumps for 3.5rc1
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090612 0515 PDT
| {{bug|493637}}
| updated l10n-changesets for 3.5rc1
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090612 0515 PDT
| {{bug|497778}}
| use L10N_SLAVES for release builds
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090610 1000 PDT
| {{bug|495533}}
| add leak threshold (for crashtest, this time) after java upgrade tripped small leak
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090610 0700 PDT
| {{bug|493755}}
| installdmg fixes
| production-master, talos-master
| medium
| ready to land
| reconfig
|-
| In production
| 20090609 11:45pm PDT
| {{bug|495533}}
| add leak threshold after java upgrade tripped small leak
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090609 9:40am PDT
| {{bug|495610}}
| Clean up whitespace in factory.py
| production-master (already on staging)
| low
| landed
| reconfig
|-
| rowspan=2 | In production
| rowspan=2 | 20090607 1955 PDT
| {{bug|493957}}
| fix references to 3.1b4 in automation config for 3.5b99
| production-master
| high
| landed
| reconfig
|-
| {{bug|494325}}
| setup bm-xserve11 for production
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090605 13:30 PDT
| {{bug|493957}}
| Backout dummy tag patch and bump for 3.5b99build2
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090605 0449 PDT
| {{bug|493957}}
| Dummy tag, source, en-US builds for 3.5 Preview (b99)
| production-master
| high
| landed
| reconfig
|-
| rowspan=2 | In production
| rowspan=2 | 20090604 2309 PDT
| {{bug|493957}}
| automation config for 3.5 Preview (b99)
| production-master
| high
| landed
| reconfig
|-
| {{bug|493637}}
| l10n-changesets for 3.5 Preview (b99)
| production-master
| high
| landed
| reconfig
|-
| In production
| 20090601 1051 PDT
| {{bug|495778}}
| all-locales logic change
| l10n-server
| low
| landed
| reconfig
|-
| In production
| 20090601 1051 PDT
| {{bug|494376}}
| set l10n_revision to actual revision
| production
| medium
| landed
| reconfig
|-
| In production
| 20090601 1045 PDT
| {{bug|465039}}
| Fix mobile try mail/upload dirs
| try-master
| low
| landed
| reconfig
|-
| In production
| 20090529 1420 PDT
| {{bug|478436}}
|  Integrate compare-locales with l10n mercurial repack builds
| production-master
| medium
| landed
| reconfig
|-
| In production
| 20090529 0947 PDT
| {{bug|465039}}
| reenable tinderbox changeset links for mobile builds
| production-master, try master
| low
| landed
| reconfig
|-
|-
| In production
| in production
| 20090528 1632 PDT
| 2017-09-21 07:51 PT
| {{bug|465039}}
|
| add wince, maemo try builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master, try master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| ''Backed out''
| in production
| Backed out: 20090527 2057 PDT<br>Landed: 20090527 1434 PDT
| 2017-09-14 03:55 PT
| {{bug|473259}} /buildbotcustom/unittest/steps.py : update the rest of the code after bug 468023
|
| (Ev1a) Sync' Mochitest and Reftest: summarizeLog() and evaluateCommand()
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master, etc
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low-medium
</div>
| re-landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| In production
| in production
| 20090525 1400 PDT
| 2017-09-06 10:14 PT
| {{bug|471318}}
|
| removes unnecessary 'index.cgi' from tinderbox changeset urls
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
|-
|-
| In production
| in production
| 20090525 1320 PDT
| 2017-08-31 06:50 PT
| {{bug|488099}}
|
| l10n/maemo repacks hang on 'echo None'
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| major
</div>
| landed
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
| reconfig
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| In production
| in production
| 20090524 1946 PDT
| 2017-08-06 22:46 PT
| {{bug|494582}}
|
| release repacks hang on 'echo None'
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| major
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
|-
|-
| In production
| in production
| 20090522 1723 PDT
| 2017-08-04 03:42 PT
| {{bug|494434}}
|
| Maemo l10n repacks busted with linux-arm instead of linux-gnueabi-arm
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| major
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
|-
|-
| In production
| in production
| 20090522 1010 PDT
| 2017-08-02 00:27 PT
| {{bug|494367}}
|
| Maemo l10n repacks busted with echo None
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| '''blocker'''
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| In production
| in production
| 20090522 0810 PDT
| 2017-07-31 04:12 PT
| {{bug|494257}}
|
| talos try broken for mac/win32 cvs builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| sm-try-master, qm-rhel02/tryperfmaster
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| In production
| in production
| 20090522 0800 PDT
| 2017-06-12 03:31 PT
| {{bug|494055}}
|
| add xulrunner builders to post-stage dep scheduler
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| {staging,production}-1.9-master}
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
|-
|-
| In production
| in production
| 20090522 0111 PDT
| 2017-06-05 06:32 PT
| {{bug|494313}}
|
| stop hiding Fx3.0 shark builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-1.9-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
|-
|-
| In production
| in production
| 20090521 2051 PDT
| 2017-06-05 02:12 PT
| {{bug|486454}} [http://hg.mozilla.org/build/buildbot-configs/rev/d7cd3e71df36 bb-c:d7cd3e71df36] [http://hg.mozilla.org/build/buildbotcustom/rev/3901a3e9cd6e bbc:3901a3e9cd6e]
|
| Move update verify bumping to Updates step
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| In production
| in production
| 20090521 0810 PDT
| 2017-05-11 06:12 PT
| {{bug|488099}}
|
| Expose build properties via TinderboxPrint
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
|-
|-
| Backed out
| in production
| 20090521 0810 PDT
| 2017-03-16 07:25 PT
| {{bug|473259}} /buildbotcustom/unittest/steps.py : update the rest of the code after bug 468023
|
| (Ev1a) Sync' Mochitest and Reftest: summarizeLog() and evaluateCommand()
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master, etc
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low-medium
</div>
| backed out
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
|-  
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
| In production
| 20090521 0810 PDT
| {{bug|491884}}
| Remove create profile build step from unittest factory
| production-master
| low
| landed
| reconfig
|-
|-
| In production
| in production
| 20090521 0810 PDT
| 2017-03-10 15:02 PT
| {{bug|383136}}
|
| Fix reboot step for unittest on packaged builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master, staging-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low (production machines don't reboot)
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| In production
| in production
| 20090521 0600 PDT
| 2017-03-10 10:11 PT
| {{bug|435472}}
|
| fix tinderbox link in try server e-mails
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| try-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
|-
|-
| In production
| in production
| 20090520 1000 PDT
| 2017-03-09 13:18 PT
| {{bug|481886}}
|
| MozillaTryServerHgClone fixes for 0.7.10p1 + bustage fix in buildbot-configs (remove CreateProfile step from unittest runs)
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| try-master + slaves
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| restart
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| In production
| in production
| 20090519 0930 PDT
| 2017-03-06 11:57 PT
| {{bug|435472}}
|
| try server e-mail notification
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| try-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| restart
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
|-
|-
| In production
| in production
| 20090519 0500 PDT
| 2017-03-06 11:49 PT
| {{bug|490581}}
|
| all builders should TinderboxPrint their slavenames
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| In production
| in production
| 20090515 0640 PDT
| 2017-03-03 13:50 PT
| {{bug|383136}}
|
| Unittests on packaged builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
|-
|-
| In production
| in production
| 20090515 0640 PDT
| 2017-03-03 12:53 PT
| {{bug|492852}}  
|
| Allow branchName to be passed to factory
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| In production
| in production
| 20090515 0640 PDT
| 2017-03-01 11:50 PT
| {{bug|492985}}
|
| fix buildbotcustom.steps.l10n.setBuild usage of setProperty
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| no firefox ones
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| high
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| n/a
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
|-
| In production
| in production
| 20090515 0640 PDT
| 2017-02-27 19:34 PT
| {{bug|491884}}
|
| remove CreateProfile step from unittest factory
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
| reconfig
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
|-
|-
| In production
| in production
| 20090515 0640 PDT
| 2017-02-27 18:50 PT
| {{bug|486567}}
|
| unify try server code with other factories
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| try-master, production-master, try-talos
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| In production
| in production
| 20090514 1953 PDT
| 2017-02-27 13:40 PT
| {{bug|489954}} [http://hg.mozilla.org/build/buildbotcustom/rev/3d4c6dde70a9 rev:3d4c6dde70a9]
|
| Missing complete mars for localised 3.5b4
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| Backed out after outage
| in production
| 20090512 1742 PDT / 20090513 0045 PDT
| 2017-02-27 11:56 PT
| No bug
|
| Set idle timers to 6 hours for EqualLogic outage
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
|-
|-
| In production
| in production
| 20090512 0915 PDT
| 2017-02-24 13:02 PT
| {{bug|486540}}
|
| more factory abstraction for comm-central
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
| reconfig
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
|-
|-
| In production
| in production
| 20090512 0915 PDT
| 2017-02-23 06:27 PT
| {{bug|492221}}
|
| optional graph server posting
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-mastre
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
|-
|In production
| in production
|20090511 12:40 PDT
| 2017-02-17 09:50 PT
|{{bug|383136}}
|
|Fix reftest parser
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|production-master, sm-try-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
|high
</div>
|landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
|reconfig
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
|In production
| in production
|20090511 12:40 PDT
| 2017-02-16 13:27 PT
|{{bug|383136}}
|
|Minor fixes for unittests on packaged builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
|production-master, staging-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
|low
</div>
|landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
|reconfig
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
|-
|-
| In production
| in production
| 20090511 1156 PDT
| 2017-02-15 12:50 PT
| {{bug|462889}}
|
| Enable maemo unittest packages
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
|-
| In production
| in production
| 20090511 0645 PDT
| 2017-02-08 13:10 PT
| {{bug|383136}}
|
| Fix for new unittest steps that broke after buildbot upgrade.  Listing here so that the next person to reconfig production-master doesn't freak out. This code isn't live on production-master, so should be safe.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| staging-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| In production
| in production
| 20090511 0645 PDT
| 2017-02-08 12:19 PT
| {{bug|482598}}
|
| enable mac a11y tests on m-c and tracemonkey
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| In production
| in production
| 20090506 1205 PDT
| 2017-01-23 03:51 PT
| {{bug|489472}}
|
| enable 1.9.1 mobile builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| medium
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
|-
|-
| In production
| in production
| 20090504 0630 PDT
| 2017-01-05 04:33 PT
| {{bug|487496}}
|
| fix MozillaMochitest kwarg digging
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
| production-master/try-master
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
| low
</div>
| landed
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
| reconfig
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
|-
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
| In production
| 20090504 0630 PDT
| {{bug|469518}}
| enable reftest leak threshold
| production-master/try-master
| low
| landed
| reconfig
|-
| In production
| 20090504 0630 PDT
| {{bug|480145}}
| BuildStepStatus.setColor shouldn't be called from custom steps
| production-master/try-master
| low
| landed
| reconfig
|-
| In production
| 20090429 morning PDT
| (no bug)
| de7529bb1396 - try server env fix, 87500f280ecf - try server arg fix
| try-master/staging-try-master
| high
| landed
| reconfig
|-
| In production
| 20090429 0730 PDT
| {{bug|487496}}
| original buildbot-configs patch for talos + bustage fix
| perfmaster/tryperfmaster/perfmaster-staging
| high
| landed
| reconfig
|-
| In production
| 20090428 16:11 PDT
| {{bug|490369}}
| Add hg revisions to mobile build waterfall
| production-master
| Low
| landed
| reconfig
|-
| In production
| 20090425 19:30 PDT
| {{bug|383136}}
| unittests on packaged builds (enabled on staging only)
| production-master, staging-master
| medium
| landed
| reconfig
|-
| In production
| 20090424 9:30 PDT
| {{bug|448047}}
| Integrate perfrunner code into buildbotcustom
| talos-master
| low
| landed
| reconfig
|-
| In production
| 20090423 12:30 PDT
| {{bug|488372}}
| Notify new talos masters of builds
| production-master
| low
| ready to land
| reconfig
|-
| In production
| 20090422 13:30 PDT
| {{bug|488411}}
| Simplify slave listings
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090422 13:30 PDT
| {{bug|480524}}
| Fennec l10n
| production-master
| medium
| landed
| reconfig
|-
| In production
| 20090422 13:30 PDT
| {{bug|488349}}
| Remove WinCE installer hacks
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090421 10:45 PDT
| {{bug|487496}}
| buildstep parameter fixups
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090420 17:05 PDT
| {{bug|477792}}
| hgpoller.py cleanup
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090416 10:30 PDT
| {{bug|488770}}
| fix description in a couple of ShellCommands
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090416 10:30 PDT
| {{bug|487496}}
| custom BuildStep's need to explicitly name arguments and call self.addFactoryArguments - buildbotcustom patch
| production-master, try-master
| low
| landed
| reconfig
|-
| In production
| 20090416 12:30 PDT
| {{bug|488737}}
| re-enable shark builds for 3.0.x
| production-1.9-master
| high
| landed
| reconfig
|-
| In production
| 20090416 12:30 pdt
| no bug
| bustage fix: use correct mac slave in production-1.9/master.cfg
| production-1.9-master
| high
| landed
| reconfig
|-
| In production
| 20090415 1648 PDT
| {{bug|474544}}
| Add bm-xserve12 to production roster
| production-master
| Low
| landed
| reconfig
|-
| In production
| 20090415 0745 PDT
| {{bug|484203}}
| Clobberer clobbered builds need to clearly identify themselves
| production-master
| Low
| landed
| reconfig
|-
| In production
| 20090414 0545 PDT
| {{bug|487636}}
| Create 6 new win32 buildbot slaves for Moz2/3.next pool - staging version
| staging-master
| Low
| landed
| reconfig
|-
| In production
| 20090414 01:55 PDT
| {{bug|487636}}
| Create 6 new win32 buildbot slaves for Moz2/3.next pool
| production-master
| Low
| landed
| reconfig
|-
| rowspan="2"| In production
| rowspan="2"| 20090413 15:05 PDT
| {{bug|486513}}
| move XULRunner builds to their own waterfall
| production-master
| Medium
| landed
| reconfig
|-
| {{bug|476733}} fix installer target
| fix installer target
| production-master
| Medium
| landed
| reconfig
|-
| In production
| 20090413 13:45 PDT
| {{bug|485736}} Add (TUnit) 'xpcshell-tests' make target, using runxpcshelltests.py new '--manifest' option
| (Ev1) Call the new target on tryserver
| production-master
| Medium (wanted on the road to stop double execution, which this creates :->)
| landed
| reconfig
|-
| In production
| 20090409 1130 PDT
| {{bug|474666}}
| Have code coverage builds report to tinderbox
| production-master
| low
| landed
| reconfig
|-
| In production
| 20090407 1315 PDT
| n/a
| Typo fix
| production-master
| low
| landed (190b3af0a786)
| reconfig
|-
| In production
| 20090407 1315 PDT
| {{bug|485736}} Add (TUnit) 'xpcshell-tests' make target, using runxpcshelltests.py new '--manifest' option
| (Cv1a-FF) Call the new target
| production-master
| Medium (wanted on the road to run tests on packaged builds)
| ready to land (on top of bug 479225 patches)
| reconfig
|-
| In production
| 20090407 1315 PDT
| {{bug|479225}}
| (Ev1b) factory.py: Av4 leftovers after bug 445611 and bug 474666
| production-master
| Low
| ready to land
| reconfig
|-
| In production
| 20090407 1315 PDT
| {{bug|479225}}
| (Dv1a) steps.py: Av4 leftovers after bug 445611
| production-master
| Medium (wanted to remove workaround in SeaMonkey config)
| ready to land
| reconfig
|-
| In production
| 20090407 1315 PDT
| {{bug|486111}}
| use defaultdict for tree properties in l10n builds
| production-master
| Low (needed for l10n master v2, sync buildbotcustom)
| ready to land, attachment 370873
|-
| rowspan="2" | In production
| rowspan="2" | 20090406 1908
| {{bug|464014}}
| Support rc's in hg relauto
| production-master
| Medium (ahead of 3.5b4)
| landed in hg:buildbot-configs, hg:buildbotcustom
| reconfig
|-
| {{bug|486444}}
| Broken win32_info.txt for releases
| production-master
| Medium (ahead of 3.5b4)
| landed in hg:buildbotcustom
| reconfig
|-
| In production
| 20090402 0943 PDT
| {{bug|484542}}
| prepare to merge buildrequests for l10n builds on 0.7.10+
| production-master
| Medium (wanted for l10n)
| landed
| reconfig
|-
| In production
| 20090401 1330 PDT
| {{bug|486192}}
| Don't try and match the end of line
| production-master
| Medium-High (fixes a regression)
| hg:buildbotcustom
| reconfig
|}
|}
[[ReleaseEngineering:BuildbotMasterChanges:Archive | Older Changes]]

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.allizom.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"