Confirmed users
43
edits
Project Fission/Memory: Difference between revisions
Jump to navigation
Jump to search
Add details on test with awsy
m (→AWSY (sb): fix link) |
(Add details on test with awsy) |
||
| Line 17: | Line 17: | ||
Our main focus for Fission is the simpler about:blank ''SY-e10s(ab)'' test. This gives a less noisy baseline metric that allows us to focus on incremental improvements. This is essentially our ''best case'' metric. | Our main focus for Fission is the simpler about:blank ''SY-e10s(ab)'' test. This gives a less noisy baseline metric that allows us to focus on incremental improvements. This is essentially our ''best case'' metric. | ||
===== Metrics ===== | |||
'''Resident Unique''' is our main measurement of success. It's the total amount of memory that the content process is using that's not shared with other processes: | '''Resident Unique''' is our main measurement of success. It's the total amount of memory that the content process is using that's not shared with other processes: | ||
* [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1684862,1,4 Resident Unique Memory - Linux] | * [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1684862,1,4 Resident Unique Memory - Linux] | ||
| Line 27: | Line 28: | ||
* [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1684850,1,4 JavaScript Memory - OSX] | * [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1684850,1,4 JavaScript Memory - OSX] | ||
* [https://treeherder.mozilla.org/perf.html#/graphs?series=mozilla-central,1684866,1,4&series=autoland,1684884,1,4&series=mozilla-inbound,1684802,1,4&zoom=1541470622441.3396,1541636058000,4522136.655023917,4592343.839863093 JavaScript Memory - Regression view]<br/>This is useful for tracking down where a regression started by breaking out integration branches. It's limited to just Linux, but JS is generally platform agnostic. | * [https://treeherder.mozilla.org/perf.html#/graphs?series=mozilla-central,1684866,1,4&series=autoland,1684884,1,4&series=mozilla-inbound,1684802,1,4&zoom=1541470622441.3396,1541636058000,4522136.655023917,4592343.839863093 JavaScript Memory - Regression view]<br/>This is useful for tracking down where a regression started by breaking out integration branches. It's limited to just Linux, but JS is generally platform agnostic. | ||
===== Testing your changes ===== | |||
To run locally use: | |||
./mach awsy-test testing/awsy/awsy/test_base_memory_usage.py | |||
To run on try for comparisons use: | |||
hg up base_revision | |||
./mach try -b o -p linux64 -u awsy-base-e10s -t none --rebuild 5 | |||
hg up new_revision | |||
./mach try -b o -p linux64 -u awsy-base-e10s -t none --rebuild 5 | |||
==== AWSY (sy) ==== | ==== AWSY (sy) ==== | ||
The original test suite, ''SY-e10s(sy)'', is a stress test that loads 100 pages into 30 tabs 3 times and measures memory at various points and is useful for detecting regressions in startup memory usage, longer term leaks, leaked windows, etc. This is essentially our ''worst case'' metric. | The original test suite, ''SY-e10s(sy)'', is a stress test that loads 100 pages into 30 tabs 3 times and measures memory at various points and is useful for detecting regressions in startup memory usage, longer term leaks, leaked windows, etc. This is essentially our ''worst case'' metric. | ||
===== Metrics ===== | |||
'''after tabs opened''' is one of several data points gathered, it is the most relevant to this project: | '''after tabs opened''' is one of several data points gathered, it is the most relevant to this project: | ||
* [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1651963,1,4 Resident Memory - Linux] | * [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1651963,1,4 Resident Memory - Linux] | ||
| Line 36: | Line 48: | ||
* [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1651894,1,4 Resident Memory - OSX] | * [https://treeherder.mozilla.org/perf.html#/graphs?timerange=31536000&series=mozilla-central,1651894,1,4 Resident Memory - OSX] | ||
===== Testing your changes ===== | |||
To run locally use: | |||
./mach awsy-test | |||
To run on try for comparisons use: | |||
hg up base_revision | |||
./mach try -b o -p linux64 -u awsy-e10s -t none --rebuild 5 | |||
hg up new_revision | |||
./mach try -b o -p linux64 -u awsy-e10s -t none --rebuild 5 | |||
== Meetings == | == Meetings == | ||