Firefox OS/Performance/Datazilla

Datazilla

This page details Datazilla and how we use it to triage performance problems in Firefox OS.

Collection

Data in Datazilla is collected from automated tests. Some of these tests reside within gaia in tests/performance, and there are also python tests on github in the b2gperf repo. There is a jenkins instance in Mountain View which runs the automated tests.

Current Tests

• Cold Load Time: b2gperf measures time taken from launching an app to the apploadtime event firing.
• Endurance: Gaia UI tests that perform the same few interactions repeatedly in order to identify memory leaks or performance issues.
• FPS: b2gperf performs a smooth scroll/swipe against the app and measures the frames per second using Gecko
• Startup Time: Does what now? This is gathered using test-perf make target with Gaia, and the data is submitted to Datazilla using b2gperf

Triaging Regressions

Each point in datazilla has a gaia, gecko, and platform build revision id. You can use this information to triage and locate where the regression occurred. One way of doing this is to use the B2G profiler: https://github.com/mozilla-b2g/B2G/blob/master/profile.sh

Resources

• Datazilla: https://datazilla.mozilla.org/b2g/
• Read the docs: http://datazilla.readthedocs.org/en/latest/
• Github repository: https://github.com/mozilla/datazilla
• Gaia Perf Tests: https://github.com/mozilla-b2g/gaia/tree/master/tests/performance
• Python Perf Tests (b2gperf): https://github.com/mozilla/b2gperf/