Firefox/Accounts/Progress Report/2017Q3: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Added scores)
(Updated comments for objectives 1 and 2)
Line 29: Line 29:
|align="center"|90%
|align="center"|90%
|align="center"|100%
|align="center"|100%
|align="left"|1.0
|align="center"|1.0
|
|
Priorities for support of Quantum/Photon in 57:
Priorities for support of Quantum/Photon in 57:
Line 44: Line 44:
|align="center"|90%
|align="center"|90%
|align="center"|100%
|align="center"|100%
|align="left"|1.0
|align="center"|1.0
|
|
Quality Priorities for Q3:
Quality Priorities for Q3:
Line 50: Line 50:
|
|
*Done!
*Done!
*Completed 13 out of 20.
*[https://waffle.io/mozilla/fxa/metrics/burndown?milestone=FxA-131:%20Q3%20Quality Quality P1s Burndown]
*[https://waffle.io/mozilla/fxa/metrics/burndown?milestone=FxA-131:%20Q3%20Quality Quality P1s Burndown]
|-
|-
Line 79: Line 80:
Fixes a problem with getting marketing newsletter opt-in data over to Salesforce.
Fixes a problem with getting marketing newsletter opt-in data over to Salesforce.
|
|
*Not sure if the fix is working. Ryan is going to put together a test plan to confirm it.
*Done!
|-
|-
|rowspan=2| 2. To have improved the quality of the Firefox Account experience on mobile.
|rowspan=2| 2. To have improved the quality of the Firefox Account experience on mobile.
Line 96: Line 97:
*[https://mozilla.invisionapp.com/share/76CPM7AC2#/screens/240561291_Desktop-_Connect_Another_Device Proposed mock up]
*[https://mozilla.invisionapp.com/share/76CPM7AC2#/screens/240561291_Desktop-_Connect_Another_Device Proposed mock up]
|
|
*Bug to set up a feature flag for it.
*PR reviewed but not merged.
*Should be able to get into 9.1 and do an A/B test with the beta users.
*Review brought up some interesting points to address.
*Probably won’t be able to declare this a success within this quarter.
|-
|-
| align="left"|2.2 Complete 80% of Q3 mobile bugs.
| align="left"|2.2 Complete 80% of Q3 mobile bugs.
Line 116: Line 116:
*[https://github.com/mozilla/fxa-bugzilla-mirror/issues/332 Issue 332: Use Firefox Account server's /.well-known/fxa-client-configuration to configure servers in Firefox for iOS [bz1237407]]  
*[https://github.com/mozilla/fxa-bugzilla-mirror/issues/332 Issue 332: Use Firefox Account server's /.well-known/fxa-client-configuration to configure servers in Firefox for iOS [bz1237407]]  
|
|
*70% of the 80% are done. Probably won’t reach 80%, but confident that we’ll be close.
*8 out of 13 are done - 80% of 80% done as of 9/25
*[https://waffle.io/mozilla/fxa/metrics/burndown?milestone=FxA-132:%20Q3%20Mobile Mobile Quality Burndown Chart]
*[https://waffle.io/mozilla/fxa/metrics/burndown?milestone=FxA-132:%20Q3%20Mobile Mobile Quality Burndown Chart]
|-
|-
Line 131: Line 131:
*Allow users to test out device pairing. This does not necessarily mean that QR codes are used.
*Allow users to test out device pairing. This does not necessarily mean that QR codes are used.
*Feature doc and issues coming soon.
*Feature doc and issues coming soon.
|
|  
*Not going to happen this quarter.  
*Pushed forward the auto-focus
*This KR is about device pairing. What we tried with QR code hasn't worked out.
*Things we got done this quarter that we can roll forward.
*Great analysis
|-
|-
| align="left"|3.2 Ship secondary email.
| align="left"|3.2 Ship secondary email.
Line 151: Line 152:
**[https://github.com/mozilla/fxa-bugzilla-mirror/issues/341 Issues 341: Detect when account email has changed, and update local state to match]
**[https://github.com/mozilla/fxa-bugzilla-mirror/issues/341 Issues 341: Detect when account email has changed, and update local state to match]
|
|
*Android side is close to being done.
*Caching bug fixed
*Pretty confident this one is going to happen.
Client code is in
*We should be able to wrap up the server 2 side bugs (500 errors).
Works for AMO,and they have an issue to fix one little thing
*Getting ready to test again.
Pocket was the only remaining thing.
Confident we’ll be able to turn it on next quarter.
Removed feature flag for add secondary email last week.
We’ll pref it on sometime in November after 57 has shipped
|-
|-
| align="left"|3.3 Land support for relier encryption keys.  
| align="left"|3.3 Land support for relier encryption keys.  

Revision as of 01:18, 30 September 2017

September 25, 2017

Q3 OKR Progress

Objective Key Result Confidence Features Notes
Jul 10 Jul 24 Aug 8 Aug 21 Sep 5 Sep 18 Score
1. To have improved the quality for the Firefox Account experience on desktop. 1.1 Close ALL (100%) issues in the Quantum/Photon milestone. (Crouton) 60% 65% 70% 75% 90% 100% 1.0

Priorities for support of Quantum/Photon in 57:

1.2 Close 50% of our Q3 quality backlog. 50% 75% 75% 90% 100% 1.0

Quality Priorities for Q3:

1.3 Increase by 15% the rate of users that become multi-device as a result of going through our first run flow. 50% 50% 50% 40% 0% 0% 0.0
  • Still not seeing any difference in outcomes between the different phases in our ABC test. Landed our iOS deeplink patch on Sept 7th so signinCodes consumption should have increased since that date. Form views on iOS should also have increased since that date thanks to deeplinks. Leif will compare form views per phase.
  • The bottom charts of our dashboard are not measuring phase 2 and 3 the same way. They show very different results because phase 3 uses the flow_id. There may be a bug with the flow_id so Leif will copy the phase 2 chart for phase 3. Will see what difference that makes.
1.4 Fix newsletter subscription when email is confirmed on a 2nd device. 95% 95% 95% 95% 90% 90% 1.0

Fixes a problem with getting marketing newsletter opt-in data over to Salesforce.

  • Done!
2. To have improved the quality of the Firefox Account experience on mobile.


2.1 Measure and A/B test best push opt-in screen on iOS. 50% 40% 55% 55% 50% 50% 0.7
  • PR reviewed but not merged.
  • Review brought up some interesting points to address.
2.2 Complete 80% of Q3 mobile bugs. N/A 60% 60% 60% 65% 90% 0.8

Identification and fixing of the most impactful bugs on iOS

Currently working on:

3. To have completed all features that are still in flight from Q1 and Q2. 3.1 Have a device pairing flow ready to A/B test. 75% 75% 50% 25% 0% 0% 0.3
  • Allow users to test out device pairing. This does not necessarily mean that QR codes are used.
  • Feature doc and issues coming soon.
  • Pushed forward the auto-focus
  • Things we got done this quarter that we can roll forward.
  • Great analysis
3.2 Ship secondary email. 80% 80% 90% 90% 90% 90% 0.9
  • Caching bug fixed

Client code is in Works for AMO,and they have an issue to fix one little thing Pocket was the only remaining thing. Confident we’ll be able to turn it on next quarter. Removed feature flag for add secondary email last week. We’ll pref it on sometime in November after 57 has shipped

3.3 Land support for relier encryption keys. 70% 70% 75% 75% 75% 80% 0.9

Relier encryption keys

3.4 Integrate 100% of high priority Amplitude events. 75% 75% 75% 75% 75% 90% 0.9

Implementation of Amplitude

  • Feel good about having data in place in time for the training.
  • Logging 2.0 is sending the data over.
  • Should be able to start doing the backfill using the same process.