Firefox/Desktop Onboarding/OKRs/Q3: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(aug 16)
(aug 20 confidence levels)
Line 25: Line 25:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|align="left"|
|align="left"|
|
|
Line 36: Line 36:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|align="left"|
|align="left"|
|
|
Line 49: Line 49:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|
|
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1268708 Bug 1268708] - [meta] Allow a like-new experience for returning users
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1268708 Bug 1268708] - [meta] Allow a like-new experience for returning users
Line 58: Line 58:
|-
|-
|align="left"| 1.4 Run experiment related to data migration which identifies the cause of changes in retention
|align="left"| 1.4 Run experiment related to data migration which identifies the cause of changes in retention
*Analyze data migration telemetry to identify causes in retention.
|align="center"| 66.7%
|align="center"| 66.7%
|align="center"| 66.7%
|align="center"| 66.7%
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 75%
|
|
* TBD
* [[https://metrics.mozilla.com/protected/sguha/v112_112_3.html]]
|
|
* 8/2/2017
* 8/2/2017
Line 71: Line 72:
* 8/16/2017
* 8/16/2017
** Need to clarify with pdol on next steps. Keeping confidence level the same till then.
** Need to clarify with pdol on next steps. Keeping confidence level the same till then.
* 8/20/2017
** we were able to identify correlation
** need to do more exploration and iterative implementation to figure out exact technically cause and possible solutions
|-
|-
|align="left"| 1.5 Publish draft UX spec for product documentation which includes 8 individual product areas
|align="left"| 1.5 Publish draft UX spec for product documentation which includes 8 individual product areas
Line 78: Line 82:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| --
|
|
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1360465 Bug 1360465] - [UX] Photon user documentation
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1360465 Bug 1360465] - [UX] Photon user documentation
Line 89: Line 93:
|align="center"| 100%
|align="center"| 100%
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|align="left"|
|align="left"|
|
|
* [https://docs.google.com/document/d/1MKe5J6qlnhCi_-XGPbS6vlMh_y9RoVmdnZ3YpDOkoqg/edit Onboarding Tour Overlay Diary Study]
* [https://docs.google.com/presentation/d/18LhpZEUo4tRhPGj8TT_vbNk_1UxWC3giT9m8VDbw_4o/edit#slide=id.g25fa8be9c8_0_122 Chrome Leavers Study]
|
|
* 8/16/17
* 8/16/17
Line 101: Line 105:
|align="center"| 100%
|align="center"| 100%
|align="center"|
|align="center"|
|align="center"|
|align="center"| 25%
|align="left"|
|align="left"|
|
|
Line 108: Line 112:
* 8/16/2017
* 8/16/2017
** Study is on pause. Kamyar is confident that we will conduct study and analyze data by end of quarter.
** Study is on pause. Kamyar is confident that we will conduct study and analyze data by end of quarter.
* 8/20/2017
** rrayborn has a study ready but has not launched yet.
|-
|-
|align="left"| 2.3 Publish top 5 correlations between telemetry attributes in first 10 minutes (or first session) of use and churn after day 0
|align="left"| 2.3 Publish top 5 correlations between telemetry attributes in first 10 minutes (or first session) of use and churn after day 0
Line 115: Line 121:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 25%
|
|
* TBD
* TBD
Line 123: Line 129:
*8/16/2017
*8/16/2017
** Keeping the confidence level the same as last week till we talk to pdol and septarshi
** Keeping the confidence level the same as last week till we talk to pdol and septarshi
* 8/20/2017
** Preliminary findings have been shared with cmore and pdol.
|-
|-
|rowspan=4| 3. Keep existing / lapsed users*
|rowspan=4| 3. Keep existing / lapsed users*
Line 129: Line 137:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|align="left"|
|align="left"|
|
|
Line 140: Line 148:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|align="left"|
|align="left"|
|
|
Line 152: Line 160:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|
|
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1366056 Bug 1366056] - Show existing users the 57 tour
*[https://bugzilla.mozilla.org/show_bug.cgi?id=1366056 Bug 1366056] - Show existing users the 57 tour
Line 163: Line 171:
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"|
|align="center"| 100%
|
|
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1360461 Bug 1360461] - [UX] Pre-Photon In-product message UX Specs
* [https://bugzilla.mozilla.org/show_bug.cgi?id=1360461 Bug 1360461] - [UX] Pre-Photon In-product message UX Specs
Line 169: Line 177:
* 8/16/2017
* 8/16/2017
** verdi clarifying next steps in meeting today. Keeping confidence level the same till we get more information.
** verdi clarifying next steps in meeting today. Keeping confidence level the same till we get more information.
* 8/20/2017
** Completed by content and marketing team. Page is built here.
|-
|-
|}
|}

Revision as of 17:22, 20 September 2017

Aug 2, 2017

Doc - 2017 Firefox Desktop Onboarding OKR's

Q3 OKR Progress

Objective Key Result Confidence Features Notes
Aug 2 Aug 16 Aug 30 Sep 13 Score
1. Improve Firefox retention 1.1 Land onboarding tour overlay with QA sign-off (no blocking bugs) going into beta 100% 100%
1.2 Land onboarding tour notifications with QA sign-off (no blocking bugs) going into beta 100% 100%
  • Bug 1357008 - [User Story] [Tour Notification] As Firefox team, we want to send tour notifications of product features that we believe matter to user
1.3 Land new user tour content for v57 with QA sign-off (no blocking bugs) going into beta 100% 100%
  • Bug 1268708 - [meta] Allow a like-new experience for returning users
  • 8/2/2017
    • Data analysis was conducted
    • May not need to run another experiement on this
1.4 Run experiment related to data migration which identifies the cause of changes in retention
  • Analyze data migration telemetry to identify causes in retention.
66.7% 66.7% 75%
  • 8/2/2017
    • Data analysis was conducted
    • May not need to run another experiement on this
  • 8/16/2017
    • Need to clarify with pdol on next steps. Keeping confidence level the same till then.
  • 8/20/2017
    • we were able to identify correlation
    • need to do more exploration and iterative implementation to figure out exact technically cause and possible solutions
1.5 Publish draft UX spec for product documentation which includes 8 individual product areas 75% --
2. Learn about Chrome churners, and about first Firefox session actions 2.1 Identify top three reasons Chrome users leave Chrome and suggest actionable ways to lure Chrome users to Firefox 73.3% 100% 100%
  • 8/16/17
    • Study in progress. Will be able to analyze qualitative data and make actionable suggestions by end of quarter.
2.2 Run heartbeat study, publish top 3 things user do immediately after opening Firefox 76.7% 100% 25%
  • TBD
  • 8/16/2017
    • Study is on pause. Kamyar is confident that we will conduct study and analyze data by end of quarter.
  • 8/20/2017
    • rrayborn has a study ready but has not launched yet.
2.3 Publish top 5 correlations between telemetry attributes in first 10 minutes (or first session) of use and churn after day 0 60% 60% 25%
  • TBD
  • 8/2/2017
    • Many unknowns. Need to clarify status.
  • 8/16/2017
    • Keeping the confidence level the same as last week till we talk to pdol and septarshi
  • 8/20/2017
    • Preliminary findings have been shared with cmore and pdol.
3. Keep existing / lapsed users* 3.1 Land updating user tour content for v57 with QA sign-off (no blocking bugs) going into beta [existing / lapsed users] 86.6% 100%
3.2 Land profile refresh for lapsed users for v57 with QA sign-off (no blocking bugs) going into beta 80% 100%
  • Bug 1369255 - Profile clean-up option in stub installer
3.3 Land new user tour for lapsed users for v57 with QA sign-off (no blocking bugs) going into beta 86.7% 100%
3.4 Complete implementation of v57 preview content (for What’s New page) (to land in v56 dot release) 53.3% 53.3% 100%
  • Bug 1360461 - [UX] Pre-Photon In-product message UX Specs
  • 8/16/2017
    • verdi clarifying next steps in meeting today. Keeping confidence level the same till we get more information.
  • 8/20/2017
    • Completed by content and marketing team. Page is built here.