Electrolysis/Release Criteria/Scrolling: Difference between revisions

Revision as of 23:45, 24 February 2016

Scrolling responsiveness must not regress when we turn on e10s.

RASCI:

Criteria:

"e10s appears to be much better here"
from billm: Analysis was done in bug 1228147 but this was not a valid dataset because it considers users from outside the experiment.

e10s comparison validated: kats
Current e10s diff: worse except linux
- Linux: 17% better
- All Windows and OS X: 45-110% worse
bug 1179735 - tp5o_scroll regression on windows compared to non-e10s
Note: reflects synchronous scroll only, so meaningless where APZ kicks in. Currently APZ handles only mouse wheel, so the test currently reflects autoscroll/arrows/page-up-down/etc.

e10s comparison validated: kats
Current e10s diff: worse except linux
- Linux: 30% better
- Windows 7/8: 7% worse
- OS X: 17% worse
- Windows XP: 50% worse
bug 1249976 - tscrollx regressed 6% with e10s on December 25th
bug 1174772 - 2.9% win7 tscrollx regression on e10s only
Note: reflects synchronous scroll only, so meaningless where APZ kicks in. Currently APZ handles only mouse wheel, so the test currently reflects autoscroll/arrows/page-up-down/etc.

@@ Line 16: / Line 16: @@
 * from billm: Analysis was done in {{bug|1228147}} but this was not a valid dataset because it considers users from outside the experiment.
-=== tp5o_scroll ===
+=== talos tp5o_scroll ===
+* e10s comparison validated: kats
+* Current e10s diff: worse except linux
+** Linux: 17% better
+** All Windows and OS X: 45-110% worse
 * {{bug|1179735}} - tp5o_scroll regression on windows compared to non-e10s
+* Note: reflects synchronous scroll only, so meaningless where APZ kicks in. Currently APZ handles only mouse wheel, so the test currently reflects autoscroll/arrows/page-up-down/etc.
-e10s is much worse in aurora.
+=== talos tscrollx ===
-Don't know who owns this test.
-Concerns: Do these tests scroll synchronously or asynchronously? If synchronously, do we care what the results are? Most scrolls that users do will use APZ.
-=== tscrollx ===
+* e10s comparison validated: kats
+* Current e10s diff: worse except linux
+** Linux: 30% better
+** Windows 7/8: 7% worse
+** OS X: 17% worse
+** Windows XP: 50% worse
 * {{bug|1249976}} - tscrollx regressed 6% with e10s on December 25th
 * {{bug|1174772}} - 2.9% win7 tscrollx regression on e10s only
+* Note: reflects synchronous scroll only, so meaningless where APZ kicks in. Currently APZ handles only mouse wheel, so the test currently reflects autoscroll/arrows/page-up-down/etc.
-e10s is worse in aurora.
-Don't know who owns this test