Socorro Communication Paths: Difference between revisions
Jump to navigation
Jump to search
| (5 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
= 1.7.6 connectivity requirements = | = 1.7.6 connectivity requirements = | ||
* Collectors (optionally) to HBase (Thrift:9090) | * Collectors (optionally) to HBase (Thrift:9090) | ||
* Crash mover to HBase (Thrift:9090) | * Crash mover to HBase (Thrift:9090) | ||
* Monitor to HBase (Thrift:9090), PG (via Zeus:5432) | * Monitor to HBase (Thrift:9090), PG (via Zeus:5432) | ||
* Processor to HBase (Thrift:9090), PG (via Zeus:5432) | * Processor to HBase (Thrift:9090), PG (via Zeus:5432) | ||
* Processor pulls symbols for mdsw from an NFS mount; no firewall rule needed | |||
* PostgreSQL has other things talk to it only | * PostgreSQL has other things talk to it only | ||
* Middleware to HBase (Thrift:9090), PG (via Zeus:5432), memcache(11211) | * Middleware to HBase (Thrift:9090), PG (via Zeus:5432), memcache(11211) | ||
* Webapp to PG (via Zeus:5432), middleware (80, probably via Zeus?), memcache(11211) | * Webapp to PG (via Zeus:5432), middleware (80, probably via Zeus?), memcache(11211) | ||
* Memcache to itself [jabba supply details here] | * Memcache to itself [jabba supply details here] | ||
* Cron jobs (on admin node) to: | * Cron jobs (on admin node) to: | ||
** Bugzilla cron connects to bugzilla on 80 | ** Bugzilla cron connects to bugzilla on 80 | ||
** builds cron connects to builds FTP server (20) and PG | ** builds cron connects to builds FTP server (20) and PG | ||
| Line 24: | Line 25: | ||
= 1.7.5 requirements = | = 1.7.5 requirements = | ||
* In a handy, but hand-drawn [https://wiki.mozilla.org/File:175connections.png diagram] | * In a handy, but hand-drawn [https://wiki.mozilla.org/File:175connections.png diagram] | ||
= Route Requirements, in Detail = | |||
== PostgreSQL Connections == | |||
"PostgreSQL" below refers to BOTH master01 and master02 | |||
* Zeus --> PostgreSQL port 5432 (working) | |||
* Zeus --> PostgreSQL port 6432 (working) | |||
* Monitors --> Zeus 5432 (not tested) | |||
* Processors --> Zeus 5432 (not tested) | |||
* Middleware --> Zeus 6432 (not tested) | |||
* Webapp --> Zeus 6432 (not tested) | |||
* Cron Master --> Zeus 5432 (not tested) | |||
* Memcache Server(s) --> Zeus 6432 (not tested) | |||
* Metrics Server --> Zeus 5432 (not tested) | |||
* Ganglia Server --> Zeus 5432 (not tested) | |||
* Ganglia Server --> PostgreSQL 8849 (ganglia agent port) (not tested) | |||
* Nagios Server --> Zeus 5432 (not tested) | |||
* Nagios Server --> Zeus 6432 (not tested) | |||
* Nagios Server --> PostgreSQL 6432 (not tested) | |||
* Nagios Server --> PostgreSQL 5432 (not tested) | |||
* Nagios Server --> PostgreSQL Nagios port (5667?) (not tested) | |||
* PostgreSQL Master01 <--> Master02: SSH, Rysnc, 5432 (working) | |||
Migration routes (all are currently working, do not disable until after migration) | |||
* Old PostgreSQL server <--> new Master01 SSH (working) | |||
* Old PostgreSQL server <--> new Master01 5432 (working) | |||
Contingency Routes: these are routes to allow us to continue processing crashes in the event that a failure with Zeus renders it inoperable for several hours. | |||
* Monitors --> PostgreSQL 5432 | |||
* Processors --> PostgreSQL 5432 | |||
Latest revision as of 20:12, 10 January 2011
1.7.6 connectivity requirements
- Collectors (optionally) to HBase (Thrift:9090)
- Crash mover to HBase (Thrift:9090)
- Monitor to HBase (Thrift:9090), PG (via Zeus:5432)
- Processor to HBase (Thrift:9090), PG (via Zeus:5432)
- Processor pulls symbols for mdsw from an NFS mount; no firewall rule needed
- PostgreSQL has other things talk to it only
- Middleware to HBase (Thrift:9090), PG (via Zeus:5432), memcache(11211)
- Webapp to PG (via Zeus:5432), middleware (80, probably via Zeus?), memcache(11211)
- Memcache to itself [jabba supply details here]
- Cron jobs (on admin node) to:
- Bugzilla cron connects to bugzilla on 80
- builds cron connects to builds FTP server (20) and PG
- Partition cron connects to PG
- topsites cron connects to alexa(80) and PG
- dailyurl connects to NFS (for CSVs)
- all other crons just connect to PG
- Thrift has other things talk to it only
- Hbase to Monitor (port?)
- Zeus to PG (6432), webapp (80), mware (80?)
- MPT-VPN to all PHX boxes (ssh:443) [jabba: or should this be to admin, and then ssh from admin->all other boxes]
- Nagios/ganglia? [jabba to fill in]
- Metrics ADU updates connect to PostgreSQL [daniel to supply machine name]
1.7.5 requirements
- In a handy, but hand-drawn diagram
Route Requirements, in Detail
PostgreSQL Connections
"PostgreSQL" below refers to BOTH master01 and master02
- Zeus --> PostgreSQL port 5432 (working)
- Zeus --> PostgreSQL port 6432 (working)
- Monitors --> Zeus 5432 (not tested)
- Processors --> Zeus 5432 (not tested)
- Middleware --> Zeus 6432 (not tested)
- Webapp --> Zeus 6432 (not tested)
- Cron Master --> Zeus 5432 (not tested)
- Memcache Server(s) --> Zeus 6432 (not tested)
- Metrics Server --> Zeus 5432 (not tested)
- Ganglia Server --> Zeus 5432 (not tested)
- Ganglia Server --> PostgreSQL 8849 (ganglia agent port) (not tested)
- Nagios Server --> Zeus 5432 (not tested)
- Nagios Server --> Zeus 6432 (not tested)
- Nagios Server --> PostgreSQL 6432 (not tested)
- Nagios Server --> PostgreSQL 5432 (not tested)
- Nagios Server --> PostgreSQL Nagios port (5667?) (not tested)
- PostgreSQL Master01 <--> Master02: SSH, Rysnc, 5432 (working)
Migration routes (all are currently working, do not disable until after migration)
- Old PostgreSQL server <--> new Master01 SSH (working)
- Old PostgreSQL server <--> new Master01 5432 (working)
Contingency Routes: these are routes to allow us to continue processing crashes in the event that a failure with Zeus renders it inoperable for several hours.
- Monitors --> PostgreSQL 5432
- Processors --> PostgreSQL 5432