Auto-tools/Meetings/2015-02-09: Difference between revisions

m
words
(move cont. metrics)
m (words)
Line 153: Line 153:
** Currently integrating the ETL code and Ahal's worker management code.  Works in development, but needs to be deployed on AWS
** Currently integrating the ETL code and Ahal's worker management code.  Works in development, but needs to be deployed on AWS
** Enhancing the ETL to deal with 600Meg structured logs; ensuring streams are used everywhere, otherwise Python runs out of memory.
** Enhancing the ETL to deal with 600Meg structured logs; ensuring streams are used everywhere, otherwise Python runs out of memory.
** ETL is filling the ES cluster (still only one node), but way too slow to keep up.
** ETL is filling the ES cluster (cluster still only one node), but way too slow to keep up.
** Started building the ActiveData service (https://github.com/klahnakoski/ActiveData); focus is on test infrastructure to ensure service can be tested, and more tests added easily.
** Started building the ActiveData service (https://github.com/klahnakoski/ActiveData); focus is on test infrastructure to ensure service can be tested, and more tests added easily.


Confirmed users
513

edits