Test Pilot/2016Q3

2016 Q3 Goals

• Objective: Get 75% of our users to try a new experiment within 24 hours of launch
• Key Results:
  • Push Notifications used by 80% of users
  • 5% of users share an experiment socially
  • UI for new features lands

• Objective: Get 80% of users using the Test Pilot site and add-on in their first choice language
• Key Results:
  • Site & add-on is available in FIGS languages
  • Send one marketing email in FIGS languages

• Objective: All new Test Pilot experiments support localization when appropriate
• Key Results:
  • Determine and document our supported solutions
  • Site support for identifying experiments based on contextual information (eg. language, region, platform, etc)

• Objective: Get 6% of our legacy users into the new Test Pilot program
• Key Results:
  • Review & Implement the legacy migration program
  • Remove Firefox Accounts integration

• Objective: Graduate an experiment
• Key Results:
  • TODO TBD (publicly digestible after action report, persist the add-on somewhere. write a sweet blog post about it afterwards explaining our reasoning and conclusions.) Adjust experiment page to show conclusions and link to AMO if it went there.

Non-Goals

The below were discussed as part of our goal setting but were not selected. They are included here for posterity and/or future planning.

• Objective: Expose standardized experiment performance data in an easily consumable format
• Key Results:
  • Build a standardized “report card” with high level statistics
  • Send an automated weekly summary email to executives