Confirmed users
90
edits
Firefox OS/Performance/Datazilla: Difference between revisions
→Gaia Tests
Kevingrandon (talk | contribs) |
Kevingrandon (talk | contribs) |
||
| Line 14: | Line 14: | ||
=== Gaia Tests === | === Gaia Tests === | ||
* '''Startup Time''': This is gathered using the 'test-perf' make target with Gaia, and the data is submitted to Datazilla using [https://github.com/mozilla/b2gperf b2gperf]. The test-perf jobs can measure other arbitrary performance metrics that are designed by the test authors (like "rendering_WiFi_list_>_settings-panel-wifi-ready"); the job that submits data to datazilla can operate on arbitrary metric names without any changes to the datazilla infrastructure. All the logic which runs these tests is part of Gaia; the output of 'make test-perf' includes a JSON structure which b2gperf submits to datazilla. | * '''Startup Time''': This is gathered using the 'test-perf' make target with Gaia, and the data is submitted to Datazilla using [https://github.com/mozilla/b2gperf b2gperf]. The test-perf jobs can measure other arbitrary performance metrics that are designed by the test authors (like "rendering_WiFi_list_>_settings-panel-wifi-ready"); the job that submits data to datazilla can operate on arbitrary metric names without any changes to the datazilla infrastructure. All the logic which runs these tests is part of Gaia; the output of 'make test-perf' includes a JSON structure which b2gperf submits to datazilla. | ||
Here is an example flow of an app using the startup time test today: | |||
Process Startup -> Start Timer -> Make API calls -> Onload Event (Fire startup time event) -> API calls return, app useable. | |||
There are a few problems with this test: | |||
** The time between Process Startup and starting the timer is not constant. Ideally we would start the timer before we run startup. I was informed that this was difficult. TODO: File a bug if this does not exist. | |||
** The startup time can be taken before the app is really ready. There are bugs open to add "startup path done" tests for the various apps. | |||
** Test code: https://github.com/mozilla-b2g/gaia/blob/master/tests/performance/startup_events_test.js | ** Test code: https://github.com/mozilla-b2g/gaia/blob/master/tests/performance/startup_events_test.js | ||
* '''Startup Path Done''': Test which listens to a custom event of when the startup is done. Currently not implemented for every test. Triggered after the startup-path-done event. | * '''Startup Path Done''': Test which listens to a custom event of when the startup is done. Currently not implemented for every test. Triggered after the startup-path-done event. | ||