Confirmed users, Bureaucrats and Sysops emeriti
998
edits
Electrolysis/Release Criteria/UI Smoothness: Difference between revisions
Electrolysis/Release Criteria/UI Smoothness (view source)
Revision as of 15:29, 21 April 2016
, 21 April 2016→talos CART (customization mode animation test): CART stuff
(bugz) |
(→talos CART (customization mode animation test): CART stuff) |
||
| (33 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
Some UI smoothness metrics may regress, on Windows and Mac, up to 5%, if that gets wins elsewhere. | Some UI smoothness metrics may regress, on Windows and Mac, up to 5%, if that gets wins elsewhere. | ||
RASCI | = RASCI = | ||
* Responsible: | * Responsible: mconley | ||
* Accountable: RyanVM | * Accountable: RyanVM | ||
* Supporting: jmaher | * Supporting: jmaher, avih, gabor | ||
* Consulted: | * Consulted: | ||
* Informed: cpeterson, elan, release management | * Informed: cpeterson, elan, release management | ||
= | = Criteria = | ||
== talos TART (tab animation smoothness) == | |||
=== | * e10s comparison validated: mconley | ||
* '''signed off by barbara over email on April 20th, 2016''' | |||
* Current e10s diff: '''No worse than non-e10s with APZ disabled''' (see [https://bugzilla.mozilla.org/show_bug.cgi?id=1251699#c5 this analysis]) | |||
* {{bug|1251699}} - 5.7% TART regression on OS X with APZ disabled | |||
** Closed as WORKSFORME - this regression seems to have disappeared. | |||
* {{bug|1253412}} - APZ causes 4% - 12% TART regression - Event Region Regression | |||
** This has been WONTFIX'd by the APZ team. See [https://bugzilla.mozilla.org/show_bug.cgi?id=1253412#c10 this comment] and [https://bugzilla.mozilla.org/show_bug.cgi?id=1253412#c19 this comment]. | |||
== talos tpaint (first paint of a new window opened from content) == | |||
* e10s comparison validated: jimm | |||
* Current e10s diff: '''worse by 3-8% on Linux 64, Windows 7 and Windows 8 platforms, with APZ on or off. 11% improvement on OS X''' | |||
* {{bug|1174770}} - tpaint regressions (3%-8%) in e10s mode compared to non-e10s mode | |||
=== | === Notes === | ||
* tpaint measures the time it takes to paint the content for a new window that has been '''opened from content'''. Windows can be opened from content in a few ways: | |||
** The content runs some JavaScript that calls window.open with non-default features, like window.open("https://www.mozilla.org", "_blank", "toolbars=no"); | |||
** The user has flipped the browser.link.open_newwindow pref from its default to open new windows instead of new tabs, and then clicks on a target="_blank" anchor | |||
* tpaint '''does not''' measure the time it takes to open a window triggered from the parent. Windows can be opened from the parent in a number of ways: | |||
** The user uses Ctrl-N or File > New Window to open a new window | |||
** The user clicks on a link in another application that opens the browser the first time | |||
** The user right clicks on a link in content, and chooses to Open Link in New Window | |||
** The user tears a tab out into a new window | |||
* An experiment was conducted to determine whether or not e10s regresses opening windows from the parent. | |||
** The experiment was conducted in {{bug|1251732}} | |||
** '''The conclusion was that e10s does not regress this case.''' | |||
* We suspect there is a second slow-path here that Talos is not measuring, and that's when the user clicks on a link that opens a new tab. | |||
** A bug has been filed to add such a test ({{bug|1253382}}) | |||
** Preliminary local results from that test show that '''e10s does not seem to regress this case''' | |||
* A bug has been filed to get Telemetry on how often we hit the ContentParent::RecvCreateWindow codepath, which we believe is the slow path. ({{bug|1253388}}) | |||
== talos tresize (window resize responsiveness) == | |||
= | * e10s comparison validated: jimm | ||
* Current e10s diff: mixed | |||
** Linux 64: ~7% regression | |||
** OS X: ~2% regression | |||
** Windows 7: ~2% regression | |||
** Windows 8 64: ~17% improvement | |||
** Windows XP: ~9% regression | |||
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1252947#c23 Signed off by canuckistani here.] | |||
* {{bug|1179732}} - 11-147% linux*/winxp tresize regression when comparing e10s to non e10s on the same build | |||
* {{bug|1252947}} - ~5% winxp tresize regression when comparing e10s to non e10s on the same build | |||
== talos tps (tab-switch speed) == | |||
* e10s comparison validated: jimm | |||
* Current e10s diff: | |||
** '''Linux 64: 19.38% improvement''' | |||
** '''OS X: 35.59% improvement''' | |||
** '''Win 7: 26.61% improvement''' | |||
** '''Win 8: 33.78% improvement''' | |||
** '''Win XP: 26.26% improvement''' | |||
== talos CART (customization mode animation test) == | |||
* e10s comparison validated: mconley | |||
* Current e10s diff (with APZ disabled - see [https://bugzilla.mozilla.org/show_bug.cgi?id=1252768#c4 this analysis]) | |||
** Win 8: 2.0% worse | |||
** Win 7: 4.0% worse | |||
** OS X: 3.7% worse | |||
** '''Linux 64: 6.8% worse''' | |||
* {{bug|1252768}} - 2–7% e10s CART regression | |||
** The regressions on non-Linux platforms is due to the "New non-e10s window" button that is added to Nightly and Aurora builds | |||
** The regression for Linux 64 is not yet understood. | |||
= Bugs = | |||
<bugzilla> | |||
{ | |||
"blocks": "1251547", | |||
"resolution": "---", | |||
"include_fields": "id, summary, whiteboard, keywords, assigned_to" | |||
} | |||
</bugzilla> | |||