Confirmed users
513
edits
Klahnakoski (talk | contribs) (move cont. metrics) |
Klahnakoski (talk | contribs) m (words) |
||
Line 153: | Line 153: | ||
** Currently integrating the ETL code and Ahal's worker management code. Works in development, but needs to be deployed on AWS | ** Currently integrating the ETL code and Ahal's worker management code. Works in development, but needs to be deployed on AWS | ||
** Enhancing the ETL to deal with 600Meg structured logs; ensuring streams are used everywhere, otherwise Python runs out of memory. | ** Enhancing the ETL to deal with 600Meg structured logs; ensuring streams are used everywhere, otherwise Python runs out of memory. | ||
** ETL is filling the ES cluster (still only one node), but way too slow to keep up. | ** ETL is filling the ES cluster (cluster still only one node), but way too slow to keep up. | ||
** Started building the ActiveData service (https://github.com/klahnakoski/ActiveData); focus is on test infrastructure to ensure service can be tested, and more tests added easily. | ** Started building the ActiveData service (https://github.com/klahnakoski/ActiveData); focus is on test infrastructure to ensure service can be tested, and more tests added easily. | ||