Apps/ServerArchitecture: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(7 intermediate revisions by 3 users not shown)
Line 1: Line 1:
http://ziade.org/appsync.png
http://ziade.org/appsync.png


= Overview =
* The appsync server provides
** appsync APIs
** the static myapps website
** a MySQL database that mirrors all writes
* The sauropod server is a Node.js server
** keeps sessions in memory (DB tokens)
** proxies the calls to the HBAse server
* The HBase cluster manage the data


= appsync/myapps =
= appsync/myapps =
Line 31: Line 41:
* status - DEPLOYED
* status - DEPLOYED


= Sauropod Node.JS server ? =  
= Sauropod Node.JS server =  


* Points of contact
* Points of contact
Line 40: Line 50:
* stack
* stack
** CentOS6
** CentOS6
** ?
** node.js 0.6.3 from mozilla-services package repository
* status - ?
** direct checkout from github
* CI / CD - ?
* status - Hackishly deployed
* CI / CD - not yet


= Sauropod HBAse stack =  
= Sauropod HBase stack =  


* Points of contact
* Points of contact
Line 51: Line 62:
* Servers
* Servers
** appsync-hbase-stage1.vm1.labs.sjc1.mozilla.com
** appsync-hbase-stage1.vm1.labs.sjc1.mozilla.com
*** "master": running the namenode
*** Zookeeper quorum node
*** Also running as an HDFS data node and HBase region server
** appsync-hbase-stage2.vm1.labs.sjc1.mozilla.com
** appsync-hbase-stage2.vm1.labs.sjc1.mozilla.com
*** "slave": running HDFS data node and HBase region server
*** Zookeeper quorum node
* stack
* stack
** CentOS6
** CentOS6
** ?
** Sun JVM 1.6.0
** Cloudera HBase distro version CDH3U2
* status - DEPLOYED
* status - DEPLOYED
* CI / CD - ?
* CI / CD - none
 
= open questions =
 
* how to load balance sauropod ? client-side ? Zeus ?
* backup on the sauropod nodes ?

Latest revision as of 10:04, 14 December 2011

appsync.png

Overview

  • The appsync server provides
    • appsync APIs
    • the static myapps website
    • a MySQL database that mirrors all writes
  • The sauropod server is a Node.js server
    • keeps sessions in memory (DB tokens)
    • proxies the calls to the HBAse server
  • The HBase cluster manage the data

appsync/myapps

memcached

  • Points of contact
    • Ops: Gozer
    • appsync-stage1.vm1.labs.sjc1.mozilla.com
  • stack
    • CentOS 6
    • Python 2.6
    • nginx
    • gunicorn
    • appsync server
  • status - DEPLOYED

Sauropod Node.JS server

  • Points of contact
    • Ops: Gozer
    • Devs: ?
  • Servers
    • sauropod-stage1.vm1.labs.sjc1.mozilla.com
  • stack
    • CentOS6
    • node.js 0.6.3 from mozilla-services package repository
    • direct checkout from github
  • status - Hackishly deployed
  • CI / CD - not yet

Sauropod HBase stack

  • Points of contact
    • Ops: Gozer
    • Devs: rtilder
  • Servers
    • appsync-hbase-stage1.vm1.labs.sjc1.mozilla.com
      • "master": running the namenode
      • Zookeeper quorum node
      • Also running as an HDFS data node and HBase region server
    • appsync-hbase-stage2.vm1.labs.sjc1.mozilla.com
      • "slave": running HDFS data node and HBase region server
      • Zookeeper quorum node
  • stack
    • CentOS6
    • Sun JVM 1.6.0
    • Cloudera HBase distro version CDH3U2
  • status - DEPLOYED
  • CI / CD - none

open questions

  • how to load balance sauropod ? client-side ? Zeus ?
  • backup on the sauropod nodes ?