TestEngineering/Performance/Results: Difference between revisions

No edit summary
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{DISPLAYTITLE:{{wip|Firefox Performance Results}}}}
{{DISPLAYTITLE:Firefox Performance Results}}
There are a variety of places where performance results are available, some of these can be queried directly, and others are dashboards built on top of those sources.
There are a variety of places where performance results are available, some of these can be queried directly, and others are dashboards built on top of those sources.


Line 9: Line 9:
** [[#Compare|Perfherder compare]]
** [[#Compare|Perfherder compare]]
* How does Firefox compare against other browsers?
* How does Firefox compare against other browsers?
** [[#Firefox Health|Firefox Health]]
** [[#Firefox Performance Dashboard|Firefox Performance Dashboard]]
** [[#Firefox Performance Dashboard|Firefox Performance Dashboard]]
* Are we meeting our goals?
* Are we meeting our goals?
** [[#Firefox Health|Firefox Health]]
* What performance tests are we running?
* What performance tests are we running?
** [[#ActiveData|ActiveData]]
* What platforms are we running performance tests against?
* What platforms are we running performance tests against?
** [[#ActiveData|ActiveData]]


= What do we have? =
= What do we have? =
== ActiveData ==
ActiveData is a collection of billions of records covering unit tests, jobs, performance data, and source code revision history.
* Access: Public
* Audience: Engineers
* Documentation: [[EngineeringProductivity/Projects/ActiveData]]
* Issue tracker: https://bugzilla.mozilla.org/buglist.cgi?product=Testing&component=ActiveData&resolution=---
* Contact: Kyle Lahnakoski [ekyle]
=== Query Tool ===
The intended use for ActiveData is for automated clients or for building dashboards, however the query tool can be used for exploration.
* Location: https://activedata.allizom.org/tools/query.html
* Source code: https://github.com/mozilla/activedata
==== Examples ====
* [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance frameworks]
* [https://activedata.allizom.org/tools/query.html#query_id=rqnxuVpf Performance suites]
* [https://activedata.allizom.org/tools/query.html#query_id=1dtPBeZR Performance suites running on Android hardware]
=== Recipes ===
Due to the size and complexity of ActiveData, using it to answer everyday questions is not a straightforward task and the built-in query tool is often insufficient. ActiveData Recipes was created to provide an intuitive way to not only use ActiveData, but to save your queries for future use and share them with others.
* Location: https://adr-dev.herokuapp.com/
* Audience: Engineers, Managers
* Documentation: https://active-data-recipes.readthedocs.io/
* Source code: https://github.com/mozilla/active-data-recipes
* Issue tracker: https://github.com/mozilla/active-data-recipes/issues
* Contact: Andrew Halberstadt [ahal]
== Datadog ==
{{todo|add description}}
=== WebPageTest ===
* Location: https://app.datadoghq.com/dashboard/lists/manual/18187
* Access: File a bug to request access by replacing '''[user]''' and '''[email]''' in [https://bugzilla.mozilla.org/enter_bug.cgi?assigned_to=nobody%40mozilla.org&bug_ignored=0&bug_severity=normal&bug_status=NEW&bug_type=task&cf_fx_iteration=---&cf_fx_points=---&cf_status_firefox68=---&cf_status_firefox69=---&cf_status_firefox70=---&cf_status_firefox_esr60=---&cf_status_firefox_esr68=---&cf_tracking_firefox68=---&cf_tracking_firefox69=---&cf_tracking_firefox70=---&cf_tracking_firefox_esr60=---&cf_tracking_firefox_esr68=---&cf_tracking_firefox_relnote=---&comment=Please%20add%20%5Bemail%5D%20to%20the%20cloudservices_datadog%20LDAP%20group%20and%20be%20sent%20an%20invitation%20to%20access%20Datadog%3F&component=Operations&contenttypemethod=list&contenttypeselection=text%2Fplain&defined_groups=1&flag_type-37=X&flag_type-607=X&flag_type-708=X&flag_type-721=X&flag_type-737=X&flag_type-748=X&flag_type-787=X&flag_type-800=X&flag_type-803=X&flag_type-846=X&flag_type-864=X&flag_type-929=X&flag_type-936=X&flag_type-941=X&form_name=enter_bug&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=Unspecified&priority=--&product=Cloud%20Services&rep_platform=Unspecified&short_desc=Grant%20%5Buser%5D%20access%20to%20Datadog&target_milestone=---&version=unspecified this template].
* Audience: Engineers, Managers
* Documentation: https://mozilla-wpt-api-docs.readthedocs.io/ {{todo|add doc on how to use datadog}}
* Source code: https://github.com/mozilla/wpt-api
* Issue tracker: https://github.com/mozilla/wpt-api/issues
* Contact: Stephen Donner [stephend]
== Firefox Health ==
The health dashboard tracks metrics and statistics important for tracking performance improvements.
* Location: https://health.graphics/
* Access: Public
* Audience: Managers
* Documentation: {{todo|add link to documentation}}
* Source code: https://github.com/mozilla-frontend-infra/firefox-health-dashboard
* Issue tracker: https://github.com/mozilla-frontend-infra/firefox-health-dashboard/issues
* Contact: Kyle Lahnakoski [ekyle]


== Firefox Performance Dashboard ==
== Firefox Performance Dashboard ==
* Location: https://arewefastyet.com/  
* Location: https://arewefastyet.com/  
* Access: Public
* Access: Public
* Audience: Managers
* Audience: Managers, Engineers
* Documentation: {{todo|add link to documentation}}
* Documentation: {{todo|add link to documentation}}
* Source code: https://github.com/mozilla-frontend-infra/firefox-performance-dashboard
* Source code: https://github.com/mozilla-frontend-infra/firefox-performance-dashboard
* Issue tracker: https://github.com/mozilla-frontend-infra/firefox-performance-dashboard/issues
* Issue tracker: https://github.com/mozilla-frontend-infra/firefox-performance-dashboard/issues
* Contact: Armen Zambrano Gasparnian [armenzg]
* Contact: Dave Hunt [davehunt]


== Metrics ==
== Metrics ==
{{todo|https://metrics.mozilla.com/protected/shiny/cdowhygelund/firefox-perf-telemetry-dashboard/}}
{{todo|https://metrics.mozilla.com/protected/shiny/cdowhygelund/firefox-perf-telemetry-dashboard/}}
== Nimbledroid ==
{{todo|add description}}
* Location: https://nimbledroid.com/my_apps
* Access: Private {{todo|add details}}
* Audience: Engineers
* Documentation: {{todo|add link to documentation}}
* Issue tracker: {{todo|}}
* Contact: No-Jun Park [npark]


== Perfherder ==
== Perfherder ==
Confirmed users
2,177

edits