Confirmed users
513
edits
BMO/ElasticSearch: Difference between revisions
Jump to navigation
Jump to search
rewrite, first draft
Klahnakoski (talk | contribs) (add link to history) |
Klahnakoski (talk | contribs) (rewrite, first draft) |
||
| Line 1: | Line 1: | ||
= | = A Public ElasticSearch Cluster with Bugzilla Data = | ||
== Objective == | == Objective == | ||
Provide the public with an easy-to-query historical view of Bugzilla bugs. | |||
== Justification == | |||
The BMO/ES cluster is important for managing many of Mozilla's projects: It is the underlying [https://wiki.mozilla.org/Projects/ActiveData active data] system that is used by a multitude of dashboards to track various project metrics. It is capable of providing both high level aggregates over the million+ issues, providing detailed historical views into those issues, and it provides that information ''fast''. | |||
== Let's Use It! == | |||
BMO/ES is a service, which means you can use it right now! You probably already have your browser open, so lets send it queries: | |||
'''Examples''' | '''Examples''' | ||
:[http://people.mozilla.org/~klahnakoski/modevmetrics/Tutorial01-Minimum.html Minimum required to hit ES cluster] [https://github.com/klahnakoski/MoDevMetrics/blob/dev/html/Tutorial01-Minimum.html on Github] | :[http://people.mozilla.org/~klahnakoski/modevmetrics/Tutorial01-Minimum.html Minimum required to hit ES cluster] [https://github.com/klahnakoski/MoDevMetrics/blob/dev/html/Tutorial01-Minimum.html on Github] | ||
| Line 21: | Line 19: | ||
'''Basic walk-through''' | '''Basic walk-through''' | ||
:https://github.com/klahnakoski/Qb/blob/master/docs/BZ_Tutorial.md | :https://github.com/klahnakoski/Qb/blob/master/docs/BZ_Tutorial.md | ||
'''Code''' | |||
:Backend ETL Code: https://github.com/klahnakoski/Bugzilla-ETL | |||
:Frontend Examples: https://github.com/klahnakoski/MoDevMetrics/tree/dev | |||
== Hacking/Contributors == | |||
This project needs your help! If you love data munging and dealing with complexity; and you get satisfaction that people will build atop your hard work every day, then this project is for you! | |||
== Contacts == | |||
ekyle@irc.mozilla.org (in #ateam and #bteam) | |||
I know hard this job is, and how little it gets noticed, maybe we can hang out on IRC and commiserate together! | |||
== Other Reading == | == Other Reading == | ||
* | * [https://wiki.mozilla.org/BMO/ElasticSearch/History Annals of adventures in initial BMO/ES development] - yet another web timesink! | ||
* A [http://people.mozilla.org/~klahnakoski/docs/Bugs%20in%20ES.pdf ppt presentation] to show what you can build using this cluster as a [http://en.wikipedia.org/wiki/Data_mart datamart]. | |||