Confirmed users
1,905
edits
Auto-tools/Projects/OrangeFactor: Difference between revisions
Auto-tools/Projects/OrangeFactor (view source)
Revision as of 19:22, 22 December 2010
, 22 December 2010→Architecture
(note where tinderbox stores its logs) |
|||
| Line 43: | Line 43: | ||
The system will have several moving parts: | The system will have several moving parts: | ||
* | * a [http://hive.apache.org/ Hive] database ({{bug|601028}}), hosted by the metrics team, which will store raw logs, and an [http://www.elasticsearch.com ElasticSearch] database, which will store data parsed out from the buildbot logs | ||
* a [http://flume.csail.mit.edu/doku.php?id=flume flume] agent, which will move logs from the | * a [http://flume.csail.mit.edu/doku.php?id=flume flume] agent, which will move logs from the into the Hive and ElasticSearch databases hosted by metrics | ||
* a unittest [http://hg.mozilla.org/automation/logparser/ logparser] ({{bug|601216}}), that will parse buildbot test logs and produce output that gets fed into the | * a unittest [http://hg.mozilla.org/automation/logparser/ logparser] ({{bug|601216}}), that will parse buildbot test logs and produce output that gets fed into the ElasticSearch db via flume | ||
* a web dashboard that pulls data from the database and displays various interesting statistics about it | * a web dashboard that pulls data from the database and displays various interesting statistics about it | ||