Electrolysis/Release Criteria/UI Smoothness

Some UI smoothness metrics may regress, on Windows and Mac, up to 5%, if that gets wins elsewhere.

RASCI

• Responsible: mconley
• Accountable: RyanVM
• Supporting: jmaher, avih, gabor
• Consulted:
• Informed: cpeterson, elan, release management

Criteria

talos TART (tab animation smoothness)

• e10s comparison validated: mconley
• signed off by barbara over email on April 20th, 2016
• Current e10s diff: No worse than non-e10s with APZ disabled (see this analysis)
• bug 1251699 - 5.7% TART regression on OS X with APZ disabled
  • Closed as WORKSFORME - this regression seems to have disappeared.
• bug 1253412 - APZ causes 4% - 12% TART regression - Event Region Regression
  • This has been WONTFIX'd by the APZ team. See this comment and this comment.

talos tpaint (first paint of a new window opened from content)

• e10s comparison validated: jimm
• Current e10s diff: worse by 3-8% on Linux 64, Windows 7 and Windows 8 platforms, with APZ on or off. 11% improvement on OS X
• bug 1174770 - tpaint regressions (3%-8%) in e10s mode compared to non-e10s mode

Notes

• tpaint measures the time it takes to paint the content for a new window that has been opened from content. Windows can be opened from content in a few ways:
  • The content runs some JavaScript that calls window.open with non-default features, like window.open("https://www.mozilla.org", "_blank", "toolbars=no");
  • The user has flipped the browser.link.open_newwindow pref from its default to open new windows instead of new tabs, and then clicks on a target="_blank" anchor
• tpaint does not measure the time it takes to open a window triggered from the parent. Windows can be opened from the parent in a number of ways:
  • The user uses Ctrl-N or File > New Window to open a new window
  • The user clicks on a link in another application that opens the browser the first time
  • The user right clicks on a link in content, and chooses to Open Link in New Window
  • The user tears a tab out into a new window
• An experiment was conducted to determine whether or not e10s regresses opening windows from the parent.
  • The experiment was conducted in bug 1251732
  • The conclusion was that e10s does not regress this case.
• We suspect there is a second slow-path here that Talos is not measuring, and that's when the user clicks on a link that opens a new tab.
  • A bug has been filed to add such a test (bug 1253382)
  • Preliminary local results from that test show that e10s does not seem to regress this case
• A bug has been filed to get Telemetry on how often we hit the ContentParent::RecvCreateWindow codepath, which we believe is the slow path. (bug 1253388)

talos tresize (window resize responsiveness)

• e10s comparison validated: jimm
• Current e10s diff: mixed
  • Linux 64: ~7% regression
  • OS X: ~2% regression
  • Windows 7: ~2% regression
  • Windows 8 64: ~17% improvement
  • Windows XP: ~9% regression
• Signed off by canuckistani here.
• bug 1179732 - 11-147% linux*/winxp tresize regression when comparing e10s to non e10s on the same build
• bug 1252947 - ~5% winxp tresize regression when comparing e10s to non e10s on the same build

talos tps (tab-switch speed)

• e10s comparison validated: jimm
• Current e10s diff:
  • Linux 64: 19.38% improvement
  • OS X: 35.59% improvement
  • Win 7: 26.61% improvement
  • Win 8: 33.78% improvement
  • Win XP: 26.26% improvement

talos CART (customization mode animation test)

• e10s comparison validated: mconley
• Current e10s diff (with APZ disabled - see this analysis)
  • Win 8: 2.0% worse
  • Win 7: 4.0% worse
  • OS X: 3.7% worse
  • Linux 64: 6.8% worse
• bug 1252768 - 2–7% e10s CART regression
  • The regressions on non-Linux platforms is due to the "New non-e10s window" button that is added to Nightly and Aurora builds
  • The regression for Linux 64 is not yet understood.

Bugs

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);