Confirmed users
513
edits
Auto-tools/Projects/PublicES: Difference between revisions
Jump to navigation
Jump to search
Auto-tools/Projects/PublicES (view source)
Revision as of 03:53, 20 November 2013
, 20 November 2013→Introduction
Klahnakoski (talk | contribs) |
Klahnakoski (talk | contribs) |
||
| Line 72: | Line 72: | ||
* '''Overview''' https://wiki.mozilla.org/Auto-tools/Projects/PublicES | * '''Overview''' https://wiki.mozilla.org/Auto-tools/Projects/PublicES | ||
* '''Architecture''' https://bugzilla.mozilla.org/attachment.cgi?id=828667 | * '''Architecture''' | ||
** PowerPoint https://bugzilla.mozilla.org/attachment.cgi?id=828667 | |||
** png [http://people.mozilla.org/~klahnakoski/Achitecture.png] | |||
* '''Code''' https://github.com/klahnakoski/Bugzilla-ETL/tree/bzAliases | * '''Code''' https://github.com/klahnakoski/Bugzilla-ETL/tree/bzAliases | ||
** '''Main Routine''' https://github.com/klahnakoski/Bugzilla-ETL/blob/bzAliases/bzETL/bz_etl.py#L310 | ** '''Main Routine''' https://github.com/klahnakoski/Bugzilla-ETL/blob/bzAliases/bzETL/bz_etl.py#L310 | ||
| Line 88: | Line 90: | ||
=== What solutions/approaches were considered other than the proposed solution? === | === What solutions/approaches were considered other than the proposed solution? === | ||
* Tried to publicize the existing ES cluster information (private bugs with no comments | * Tried to publicize the existing ES cluster information (private bugs with no comments or summary), but there was concern the CC list may reveal the bug's security category (https://bugzilla.mozilla.org/show_bug.cgi?id=823303) | ||
* Using the BZ-API directly requires sophisticated caching, which appears to stall | * Using the BZ-API directly requires sophisticated caching, which appears to stall attempts at making snappy dashboards. | ||
=== Why was this solution chosen? === | === Why was this solution chosen? === | ||
* ElasticSearch is very fast | * ElasticSearch is very fast | ||
* Direct DB access leverages existing code | * Direct DB access leverages existing code | ||
* Direct DB access | * Direct DB access puts no load on Bugzilla app | ||
* Proven to work with business intelligence queries, which demand fast aggregate data over thousands of bugs https://wiki.mozilla.org/Bugzilla_Anthropology/2013-01-29) | * Proven to work with business intelligence queries, which demand fast aggregate data over thousands of bugs https://wiki.mozilla.org/Bugzilla_Anthropology/2013-01-29) | ||