Sheriffing/TBPL/ArchitectureAndDependencies: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
(added ports)
Line 17: Line 17:
* MongoDB needs to run
* MongoDB needs to run
* TBPL PHP scripts need Apache and PHP 5.3 with access to:
* TBPL PHP scripts need Apache and PHP 5.3 with access to:
** MongoDB through MongoPHP driver
** MongoDB (port 27017) through MongoPHP driver
** file system for caching
** file system for caching
* TBPL Python script needs Python 2.6 with access to:
* TBPL Python script needs Python 2.6 with access to:
** MongoDB through pymongo driver
** MongoDB (port 27017) through pymongo driver
* Cronjob needs to run /dataimport/import-buildbot-data.py periodically
* Cronjob needs to run /dataimport/import-buildbot-data.py periodically


Line 27: Line 27:
tbpl.mozilla.org needs access to:
tbpl.mozilla.org needs access to:


* tinderbox.mozilla.org
* tinderbox.mozilla.org (port 80)
** from ''/php/getTinderboxSummary.php'' to ''/showlog.cgi?...'': Build logs
** from ''/php/getTinderboxSummary.php'' to ''/showlog.cgi?...'': Build logs
** from ''/leak-analysis/index.php'' to ''/showlog.cgi?...'': Build logs
** from ''/leak-analysis/index.php'' to ''/showlog.cgi?...'': Build logs
* build.mozilla.org
* build.mozilla.org (port 80)
** from ''/dataimport/import-buildbot-data.py'' to ''/builds/builds-...js.gz'': Build data
** from ''/dataimport/import-buildbot-data.py'' to ''/builds/builds-...js.gz'': Build data
* hg.mozilla.org
* hg.mozilla.org (port 80)
** from ''/dataimport/import-buildbot-data.py'' to ''/try/json-pushes?...'': Pusher for revision
** from ''/dataimport/import-buildbot-data.py'' to ''/try/json-pushes?...'': Pusher for revision
* ftp.mozilla.org
* ftp.mozilla.org (port 21)
** from ''/php/inc/RawGzLogDownloader.php'' to ''/pub/mozilla.org/...'': Build logs
** from ''/php/inc/RawGzLogDownloader.php'' to ''/pub/mozilla.org/...'': Build logs
* api-dev.bugzilla.mozilla.org
* api-dev.bugzilla.mozilla.org (port 443)
** from ''/php/submitBugzillaComment.php'' to ''/...'': Automated commenting on starred orange bugs
** from ''/php/submitBugzillaComment.php'' to ''/...'': Automated commenting on starred orange bugs
* elasticsearch1.metrics.sjc1.mozilla.com:9200
* elasticsearch1.metrics.sjc1.mozilla.com (port 9200)
** from ''/php/starcomment.php'' to ''/...'': Storing and retrieving build stars
** from ''/php/starcomment.php'' to ''/...'': Storing and retrieving build stars


Line 45: Line 45:
Visitors of TBPL (the "client") need access to:
Visitors of TBPL (the "client") need access to:


* tbpl.mozilla.org (duh)
* tbpl.mozilla.org (port 80)
* tinderbox.mozilla.org
* tinderbox.mozilla.org (port 80)
** to ''/.../status.html'': Tree status
** to ''/.../status.html'': Tree status
** to ''/showbuilds.cgi?...'': Build data
** to ''/showbuilds.cgi?...'': Build data
** to ''/.../json.js'': Cached build data
** to ''/.../json.js'': Cached build data
* build.mozilla.org
* build.mozilla.org (port 80)
** to ''/builds/...'': Data about pending and running builds
** to ''/builds/...'': Data about pending and running builds
** to ''/buildapi/...'': Self-serve API to retrigger and cancel builds
** to ''/buildapi/...'': Self-serve API to retrigger and cancel builds
* hg.mozilla.org
* hg.mozilla.org (port 80)
** to ''/.../pushlog'': Push data
** to ''/.../pushlog'': Push data
* api-dev.bugzilla.mozilla.org
* api-dev.bugzilla.mozilla.org (port 443)
** to ''/...'': Showing bug summaries as tooltips for bug numbers
** to ''/...'': Showing bug summaries as tooltips for bug numbers



Revision as of 21:59, 28 July 2011

Involved Servers

And then there's the client, i.e. the user's browser.

Dependencies

Inside the TBPL server

  • MongoDB needs to run
  • TBPL PHP scripts need Apache and PHP 5.3 with access to:
    • MongoDB (port 27017) through MongoPHP driver
    • file system for caching
  • TBPL Python script needs Python 2.6 with access to:
    • MongoDB (port 27017) through pymongo driver
  • Cronjob needs to run /dataimport/import-buildbot-data.py periodically

Between TBPL server and other servers

tbpl.mozilla.org needs access to:

  • tinderbox.mozilla.org (port 80)
    • from /php/getTinderboxSummary.php to /showlog.cgi?...: Build logs
    • from /leak-analysis/index.php to /showlog.cgi?...: Build logs
  • build.mozilla.org (port 80)
    • from /dataimport/import-buildbot-data.py to /builds/builds-...js.gz: Build data
  • hg.mozilla.org (port 80)
    • from /dataimport/import-buildbot-data.py to /try/json-pushes?...: Pusher for revision
  • ftp.mozilla.org (port 21)
    • from /php/inc/RawGzLogDownloader.php to /pub/mozilla.org/...: Build logs
  • api-dev.bugzilla.mozilla.org (port 443)
    • from /php/submitBugzillaComment.php to /...: Automated commenting on starred orange bugs
  • elasticsearch1.metrics.sjc1.mozilla.com (port 9200)
    • from /php/starcomment.php to /...: Storing and retrieving build stars

Between the client and other servers

Visitors of TBPL (the "client") need access to:

  • tbpl.mozilla.org (port 80)
  • tinderbox.mozilla.org (port 80)
    • to /.../status.html: Tree status
    • to /showbuilds.cgi?...: Build data
    • to /.../json.js: Cached build data
  • build.mozilla.org (port 80)
    • to /builds/...: Data about pending and running builds
    • to /buildapi/...: Self-serve API to retrigger and cancel builds
  • hg.mozilla.org (port 80)
    • to /.../pushlog: Push data
  • api-dev.bugzilla.mozilla.org (port 443)
    • to /...: Showing bug summaries as tooltips for bug numbers

Diagram

Tbpl diagram.png