Electrolysis/Release Criteria: Difference between revisions

Update links to analysis to account for change in repo folder structure
(→‎Stability: Link to stability dashboard)
(Update links to analysis to account for change in repo folder structure)
Line 35: Line 35:
| chrome+content process crash rate
| chrome+content process crash rate
| chrome process crash ping counts + SUBPROCESS_CRASHES_WITH_DUMP['content'] per 1000 hours of subsessionLength
| chrome process crash ping counts + SUBPROCESS_CRASHES_WITH_DUMP['content'] per 1000 hours of subsessionLength
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s-stability-analysis.ipynb 46 experiment]  
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s-stability-analysis.ipynb 46 experiment]  
| rvitillo
| rvitillo
| 84,390 (Beta 45)
| 84,390 (Beta 45)
Line 44: Line 44:
| plugin process crash rate
| plugin process crash rate
| SUBPROCESS_CRASHES_WITH_DUMP['plugin'] per 1000 hours of subsessionLength
| SUBPROCESS_CRASHES_WITH_DUMP['plugin'] per 1000 hours of subsessionLength
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s-stability-analysis.ipynb 46 experiment]  
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s-stability-analysis.ipynb 46 experiment]  
| rvitillo
| rvitillo
| 41,897 (Beta 45)
| 41,897 (Beta 45)
Line 124: Line 124:
| GC pauses
| GC pauses
| GC_MAX_PAUSE_MS (parent, children)
| GC_MAX_PAUSE_MS (parent, children)
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
| rvitillo
| rvitillo
| style="background-color: PaleGreen;" | YES: e10s is slightly better
| style="background-color: PaleGreen;" | YES: e10s is slightly better
Line 131: Line 131:
| Cycle Collector pauses
| Cycle Collector pauses
| CYCLE_COLLECTOR_MAX_PAUSE (parent, children)
| CYCLE_COLLECTOR_MAX_PAUSE (parent, children)
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
| rvitillo
| rvitillo
| style="background-color: PaleGreen;" | YES: e10s is slightly better
| style="background-color: PaleGreen;" | YES: e10s is slightly better
Line 138: Line 138:
| Event loop lag
| Event loop lag
| INPUT_EVENT_RESPONSE_MS
| INPUT_EVENT_RESPONSE_MS
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
[http://mzl.la/21WwhFj Nightly 48 telemetry]
[http://mzl.la/21WwhFj Nightly 48 telemetry]
| chutten
| chutten
Line 197: Line 197:
|-
|-
| FX_PAGE_LOAD_MS ±5%
| FX_PAGE_LOAD_MS ±5%
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment] ({{bug|1228020}})
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment] ({{bug|1228020}})
| rvitillo
| rvitillo
|
|
Line 252: Line 252:
| SIMPLE_MEASURES_FIRSTPAINT ±10%
| SIMPLE_MEASURES_FIRSTPAINT ±10%
("simpleMeasurements/firstPaint")
("simpleMeasurements/firstPaint")
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
| rvitillo
| rvitillo
| 4468 ms
| 4468 ms
Line 263: Line 263:
| SIMPLE_MEASURES_SHUTDOWNDURATION ±25%
| SIMPLE_MEASURES_SHUTDOWNDURATION ±25%
("simpleMeasurements/shutdownDuration")
("simpleMeasurements/shutdownDuration")
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
| rvitillo
| rvitillo
| 1156 ms
| 1156 ms
Line 302: Line 302:
|-
|-
| FX_REFRESH_DRIVER_SYNC_SCROLL_FRAME_DELAY_MS
| FX_REFRESH_DRIVER_SYNC_SCROLL_FRAME_DELAY_MS
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]
| avih
| avih
| style="background-color: PaleGreen;" | YES: e10s is faster
| style="background-color: PaleGreen;" | YES: e10s is faster
Line 353: Line 353:
| Plugin module initialization jank time
| Plugin module initialization jank time
| BLOCKED_ON_PLUGIN_MODULE_INIT_MS ±5%
| BLOCKED_ON_PLUGIN_MODULE_INIT_MS ±5%
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| chutten
| chutten
| style="background-color: PaleGreen;" | '''Flash''': YES. e10s is better.
| style="background-color: PaleGreen;" | '''Flash''': YES. e10s is better.
Line 367: Line 367:
| Plugin initialization jank time
| Plugin initialization jank time
| BLOCKED_ON_PLUGIN_INSTANCE_INIT_MS ±5%
| BLOCKED_ON_PLUGIN_INSTANCE_INIT_MS ±5%
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| chutten
| chutten
| style="background-color: PaleGreen;" | '''Flash''': MAYBE? e10s is slightly worse.
| style="background-color: PaleGreen;" | '''Flash''': MAYBE? e10s is slightly worse.
Line 381: Line 381:
| Plugin destruction jank time
| Plugin destruction jank time
| BLOCKED_ON_PLUGIN_INSTANCE_DESTROY_MS ±5%
| BLOCKED_ON_PLUGIN_INSTANCE_DESTROY_MS ±5%
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/apz/e10s_plugin_lag.ipynb Beta 46 experiment]
| chutten
| chutten
| style="background-color: PaleGreen;" | '''Flash''': YES. e10s is different, but not worse.
| style="background-color: PaleGreen;" | '''Flash''': YES. e10s is different, but not worse.
Line 433: Line 433:
|-
|-
| MEMORY_TOTAL ±25% (browser + content process)
| MEMORY_TOTAL ±25% (browser + content process)
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment] and [http://www.erahm.org/2016/02/11/memory-usage-of-firefox-with-e10s-enabled/ erahm's blog post]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment] and [http://www.erahm.org/2016/02/11/memory-usage-of-firefox-with-e10s-enabled/ erahm's blog post]
|
|
|
|
Line 440: Line 440:
|-
|-
| VSIZE_MAX_CONTIGUOUS (browser + content process)
| VSIZE_MAX_CONTIGUOUS (browser + content process)
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]  
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]  
|
|
|
|
Line 539: Line 539:
| FX_TAB_SWITCH_TOTAL_MS
| FX_TAB_SWITCH_TOTAL_MS
| Gabor
| Gabor
| [https://github.com/vitillo/e10s_analyses/blob/master/beta46-noapz/e10s_experiment.ipynb beta 46 experiment]  
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/46/noapz/e10s_experiment.ipynb beta 46 experiment]  
| style="background-color: PaleGreen;" | 52.66 ms (median) < 82.61 ms (median)
| style="background-color: PaleGreen;" | 52.66 ms (median) < 82.61 ms (median)
| style="background-color: PaleGreen;" | [https://bugzilla.mozilla.org/show_bug.cgi?id=1252031#c2 bug 1252031]
| style="background-color: PaleGreen;" | [https://bugzilla.mozilla.org/show_bug.cgi?id=1252031#c2 bug 1252031]
Line 646: Line 646:
| Slow script warnings
| Slow script warnings
| SLOW_SCRIPT_PAGE_COUNT
| SLOW_SCRIPT_PAGE_COUNT
| [https://github.com/vitillo/e10s_analyses/blob/master/beta47-ex1/e10s_experiment.ipynb beta 47 experiment]
| [https://github.com/vitillo/e10s_analyses/blob/master/beta/47/week1/e10s_experiment.ipynb beta 47 experiment]
| azhang
| azhang
| 0.00117087669174 warnings per hour
| 0.00117087669174 warnings per hour
105

edits