Confirmed users
1,989
edits
CIDuty/How To/High Pending Counts: Difference between revisions
Jump to navigation
Jump to search
CIDuty/How To/High Pending Counts (view source)
Revision as of 14:11, 10 September 2015
, 10 September 2015→Dealing with high pending counts
ChrisCooper (talk | contribs) No edit summary |
|||
| Line 4: | Line 4: | ||
Demand will sometimes outstrip supply in the slave pool. A high number of pending build can indicate a problem with the scheduler, (a set of) buildbot-masters, or a particular pool of slaves (and hence possibly puppet). | Demand will sometimes outstrip supply in the slave pool. A high number of pending build can indicate a problem with the scheduler, (a set of) buildbot-masters, or a particular pool of slaves (and hence possibly puppet). | ||
The number of pending builds is available in [http://builddata.pub.build.mozilla.org/reports/pending/pending.html graphs] and is also displayed per slave type in [https://secure.pub.build.mozilla.org/builddata/reports/slave_health/index.html slave health]. The graphs are helpful for noticing anomalous behavior. | The number of pending builds is available in [http://builddata.pub.build.mozilla.org/reports/pending/pending.html graphs] and is also displayed per slave type in [https://secure.pub.build.mozilla.org/builddata/reports/slave_health/index.html slave health]. The graphs are helpful for noticing anomalous behavior. You will also see an alert in #buildduty, for example | ||
<pre> | |||
nagios-relengMon 17:00:34 PDT [4860] cruncher.srv.releng.scl3.mozilla.com:Pending builds is CRITICAL: CRITICAL Pending Builds: 7370 (http://m.mozilla.org/Pending+builds) | |||
</pre> | |||
Here are some steps you can use to help figure out why it's happening: | Here are some steps you can use to help figure out why it's happening: | ||