Firefox/Accounts/Progress Report/2017Q3

From MozillaWiki
< Firefox‎ | Accounts/Progress Report
Revision as of 01:18, 30 September 2017 by Juliemccracken (talk | contribs) (Updated comments for objectives 1 and 2)
Jump to navigation Jump to search

September 25, 2017

Q3 OKR Progress

Objective Key Result Confidence Features Notes
Jul 10 Jul 24 Aug 8 Aug 21 Sep 5 Sep 18 Score
1. To have improved the quality for the Firefox Account experience on desktop. 1.1 Close ALL (100%) issues in the Quantum/Photon milestone. (Crouton) 60% 65% 70% 75% 90% 100% 1.0

Priorities for support of Quantum/Photon in 57:

1.2 Close 50% of our Q3 quality backlog. 50% 75% 75% 90% 100% 1.0

Quality Priorities for Q3:

1.3 Increase by 15% the rate of users that become multi-device as a result of going through our first run flow. 50% 50% 50% 40% 0% 0% 0.0
  • Still not seeing any difference in outcomes between the different phases in our ABC test. Landed our iOS deeplink patch on Sept 7th so signinCodes consumption should have increased since that date. Form views on iOS should also have increased since that date thanks to deeplinks. Leif will compare form views per phase.
  • The bottom charts of our dashboard are not measuring phase 2 and 3 the same way. They show very different results because phase 3 uses the flow_id. There may be a bug with the flow_id so Leif will copy the phase 2 chart for phase 3. Will see what difference that makes.
1.4 Fix newsletter subscription when email is confirmed on a 2nd device. 95% 95% 95% 95% 90% 90% 1.0

Fixes a problem with getting marketing newsletter opt-in data over to Salesforce.

  • Done!
2. To have improved the quality of the Firefox Account experience on mobile.


2.1 Measure and A/B test best push opt-in screen on iOS. 50% 40% 55% 55% 50% 50% 0.7
  • PR reviewed but not merged.
  • Review brought up some interesting points to address.
2.2 Complete 80% of Q3 mobile bugs. N/A 60% 60% 60% 65% 90% 0.8

Identification and fixing of the most impactful bugs on iOS

Currently working on:

3. To have completed all features that are still in flight from Q1 and Q2. 3.1 Have a device pairing flow ready to A/B test. 75% 75% 50% 25% 0% 0% 0.3
  • Allow users to test out device pairing. This does not necessarily mean that QR codes are used.
  • Feature doc and issues coming soon.
  • Pushed forward the auto-focus
  • Things we got done this quarter that we can roll forward.
  • Great analysis
3.2 Ship secondary email. 80% 80% 90% 90% 90% 90% 0.9
  • Caching bug fixed

Client code is in Works for AMO,and they have an issue to fix one little thing Pocket was the only remaining thing. Confident we’ll be able to turn it on next quarter. Removed feature flag for add secondary email last week. We’ll pref it on sometime in November after 57 has shipped

3.3 Land support for relier encryption keys. 70% 70% 75% 75% 75% 80% 0.9

Relier encryption keys

3.4 Integrate 100% of high priority Amplitude events. 75% 75% 75% 75% 75% 90% 0.9

Implementation of Amplitude

  • Feel good about having data in place in time for the training.
  • Logging 2.0 is sending the data over.
  • Should be able to start doing the backfill using the same process.