Auto-tools/Projects/Pulse/Exchanges: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Add link to docs.taskcluster.net as not everything is listed here, and we can't keep manual lists up-to-date)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
This page is meant to be a list of exchanges available on <code>pulse.mozilla.org</code>. If exchanges you are publishing isn't listed here, please add them. Your description doesn't have to be long, this is just give an overview of which exchanges is available on pulse, so that people can build tools on top of them. If you have additional documentation available, this is also a good place to put a link.
This page is meant to be a list of exchanges available on <code>pulse.mozilla.org</code>. If exchanges you are publishing isn't listed here, please add them. Your description doesn't have to be long, this is just give an overview of which exchanges is available on pulse, so that people can build tools on top of them. If you have additional documentation available, this is also a good place to put a link.
'''Example entry'''
<pre>
== Notifications About Jonas' Lunch ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fjonasfj%2Flunch-notifications&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/jonasfj/lunch-notifications</code>]
;maintainer: jonasfj@mozilla.com
;description: Exchange where I publish JSON messages about my lunch every day.
</pre>


== Treeherder ==
== Treeherder ==
Line 41: Line 33:
}
}
</pre>
</pre>
== Pulse Test ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fpulse%2Ftest&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/pulse/test</code>]
;maintainer: mcote@mozilla.com
;description: A simple heartbeat message published every minute.  This can be used to test if your client is working, although subscribing to any high-traffic exchange (e.g. BuildBot) would work as well.  Note that this is currently broken.


== Simple Bugzilla ==
== Simple Bugzilla ==
Line 51: Line 38:
;maintainer: mcote@mozilla.com
;maintainer: mcote@mozilla.com
;description: Notifications of Bugzilla bug updates.  See [[BMO/ChangeNotificationSystem]].
;description: Notifications of Bugzilla bug updates.  See [[BMO/ChangeNotificationSystem]].
== BuildBot ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fbuild%2F&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/build/</code>]
;maintainer: catlee@mozilla.com
;description: Notifications of builds and test runs.  See [[Auto-tools/Projects/Pulse#Consuming_Buildbot_messages]].
== Normalized BuildBot ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fbuild%2Fnormalized&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/build/normalized</code>]
;maintainer: jgriffin@mozilla.com
;description: See [[Auto-tools/Projects/Pulse#Consuming_Buildbot_messages]].


== hg.mozilla.org ==
== hg.mozilla.org ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fhgpushes%2Fv1&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/hgpushes/v1</code>]
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fhgpushes%2Fv2&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/hgpushes/v2</code>]
;maintainer: gps@Mozilla.com
;maintainer: gps@Mozilla.com
;description: See [https://mozilla-version-control-tools.readthedocs.io/en/latest/hgmo/notifications.html v-c-t docs]
;description: See [https://mozilla-version-control-tools.readthedocs.io/en/latest/hgmo/notifications.html v-c-t docs]
== MozReview ==
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fmozreview%2F&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/mozreview/</code>]
;maintainer: mcote@mozilla.com
;description: See [https://mozilla-version-control-tools.readthedocs.io/en/latest/mozreview/notifications.html v-c-t docs]


== TaskCluster ==
== TaskCluster ==
This is just an outline of the most useful exchanges, taskcluster publishes a lot of events to pulse, for more details see reference documentation on [https://docs.taskcluster.net/reference docs.taskcluster.net].
Taskcluster publishes events to pulse for just about everything that goes on. For more details see the [https://docs.taskcluster.net/docs/reference Taskcluster Reference Docs].
 
=== Queue: Task Defined ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-defined&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-defined</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of new task definitions, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskDefined official documentation]
 
=== Queue: Task Pending ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-pending&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-pending</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of pending tasks, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskPending official documentation]
 
=== Queue: Task Running ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-running&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-running</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of running tasks, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskRunning official documentation]
 
=== Queue: Artifact Creation ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Fartifact-created&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/artifact-created</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of new artifacts, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#artifactCreated official documentation]
 
=== Queue: Task Completed ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-completed&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-completed</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of completed tasks, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskCompleted official documentation]
 
=== Queue: Task Failed ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-failed&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-failed</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of failed tasks, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskFailed official documentation]
 
=== Queue: Task Exception ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-queue%2Fv1%2Ftask-exception&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-queue/v1/task-exception</code>]
;maintainer: jonasfj@mozilla.com
;description: Notifications of tasks that could not run, for details see [https://docs.taskcluster.net/reference/platform/taskcluster-queue/references/events#taskException official documentation]
 
=== Mozilla: Push detected ===
;exchange: [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Fmozilla-taskcluster%2Fv1%2Fpushlog&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/mozilla-taskcluster/v1/pushlog</code>]
;maintainer: selena@mozilla.com (for now)
;description: Notifications of pushes detected by mozilla-taskcluster, still filling in details by reverse engineering
 
Generated with [https://github.com/taskcluster/mozilla-taskcluster/blob/master/src/jobs/publish_push.js#L13 publish_push.js]
 
=== Taskcluster-treeherder: Job Event ===
;exchange(prod): [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-treeherder%2Fv1%2Fjobs&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-treeherder/v1/jobs</code>]
;exchange(stage): [https://tools.taskcluster.net/pulse-inspector?bindings%5B0%5D%5Bexchange%5D=exchange%2Ftaskcluster-treeherder-staging%2Fv1%2Fjobs&bindings%5B0%5D%5BroutingKeyPattern%5D=%23 <code>exchange/taskcluster-treeherder-staging/v1/jobs</code>]
;maintainer: garndt@mozilla.com
;description: Treeherder consumable job information created from Taskcluster task events.


== Firefox Test Engineering ==
== Firefox Test Engineering ==

Latest revision as of 18:26, 10 May 2019

This page is meant to be a list of exchanges available on pulse.mozilla.org. If exchanges you are publishing isn't listed here, please add them. Your description doesn't have to be long, this is just give an overview of which exchanges is available on pulse, so that people can build tools on top of them. If you have additional documentation available, this is also a good place to put a link.

Treeherder

New Result-Sets

exchange(prod)
exchange/treeherder/v1/new-result-set
exchange(stage)
exchange/treeherder-stage/v1/new-result-set
maintainer
mdoglio@mozilla.com
description
Messages about new result-sets. These messages include the revision_hash, and can be used to add additional jobs to a treeherder result-set. The exchange for stage is operational as of writing.

Job Actions

exchange(prod)
exchange/treeherder/v1/job-actions
exchange(stage)
exchange/treeherder-stage/v1/job-actions
maintainer
mdoglio@mozilla.com
description
Messages about retrigger/cancel actions on jobs. Includes requester (an email address) and job_id/job_guid to fetch details about the job itself. The exchange for stage is operational as of writing.

Resultset Actions

exchange(prod)
exchange/treeherder/v1/resultset-runnable-job-actions
exchange(stage)
exchange/treeherder-stage/v1/resultset-runnable-job-actions
maintainer
mdoglio@mozilla.com
description
Messages for a push (e.g. "add new jobs"). Sample:

NOTE: Beware, the following sample was copied from tc's pulse-inspector and I could not access to the raw value. I hand edited the structure.

{
  u"requested_jobs": [u'0:desktop-test-linux64/opt-reftest-1', u'Windows 7 VM-GFX 32-bit try debug test mochitest-1'],
  u"resultset_id": u"117941",
  u"timestamp": 1471878682.08,
  u"project": u"try",
  u"version": 1,
  u"requester": "armenzg@mozilla.com",
  u"decisionTaskID": "OpXU-JkRRpW96DEgCoQo2g"
}

Simple Bugzilla

exchange
exchange/bugzilla/simple
maintainer
mcote@mozilla.com
description
Notifications of Bugzilla bug updates. See BMO/ChangeNotificationSystem.

hg.mozilla.org

exchange
exchange/hgpushes/v2
maintainer
gps@Mozilla.com
description
See v-c-t docs

TaskCluster

Taskcluster publishes events to pulse for just about everything that goes on. For more details see the Taskcluster Reference Docs.

Firefox Test Engineering

exchange
exchange/fxtesteng/jobs
maintainer
dhunt@mozilla.com
description
Treeherder consumable job information created from automated tests.