Test Pilot/2016Q3
Test Pilot Q3 Objectives and Key Results
| Final Status (Sep 30) | Comments | ||
|---|---|---|---|
| Objective 1 | Grow the Test Pilot user base. | ||
| KR1 | Grow total Test Pilot user base by 66% | ||
| KR2 | Add localization support to Test Pilot and get 80% of users using Test Pilot in their first choice language. | ||
| KR3 | All new Test Pilot experiments support localization when appropriate. | ||
| KR4 | Get 6% of our legacy users into the new Test Pilot program. | ||
| KR5 | Remove Firefox Accounts integration. | 1.0 | |
| Objective 2 | Make it easy for existing Test Pilot users to learn about new experiments and start using them. | ||
| KR1 | Get new experiment within 24 hours of launch at a rate 10% higher than our baseline engagement ratio. | ||
| KR2 | Implement a notification system in Test Pilot | ||
| KR3 | 5% of active Test Pilot users share an experiment socially | ||
| Objective 3 | Demonstrate that the Test Pilot experiment life cycle is valuable and sustainable. | ||
| KR1 | Ensure at least one experiment graduates | ||
| KR2 | Ensure at least one new experiment is publicly available | 1.0 | No More 404s |
| KR3 | Publish conclusions | ||
| KR4 | Build an offboarding process |
Non-Goals
The below were discussed as part of our goal setting but were not selected. They are included here for posterity and/or future planning.
- Objective: Expose standardized experiment performance data in an easily consumable format
- Key Results:
- Build a standardized “report card” with high level statistics
- Send an automated weekly summary email to executives