Firefox OS/Metrics

Goals

The FxOS Metrics project enables making data driven decisions for the following:

• Understanding how FxOS is doing in the market versus product/business goals
• Gaining insights from quantitative and qualitative data, to enable improve the product/business goals
• Understanding usage models, to improve future product development and opportunities
• Determining effectiveness of marketing campaigns.

Metrics

Customer lifecycle	Metrics to be collected	Dashboard
Acquiring Customers	Partners/Channels though which devices are sold	Dashboard: Choose Operator/OEM/Country combination of channel
Activation of Devices	Total number of Activated devices	Dashboard: Choose 'All' in SW/Operator/OEM/ to get a count
Retention Of Customers	MAU (Monthly Active Users) Apps usage per month Performance (App Startup time, Power consumption)	In Progress
Revenue	Number of searches done Paid App Downloads	In Progress
Referral	Net Promoter Score Recommendations from Users User Satisfaction Factor	Future

Roadmap

FxOS Release	Metrics to be collected	Bugs
1.3	Acquisition, Activations: Activation Ping:	Engg: 986701,997960 Legal: 980920 Privacy: 992487
2.1	Retention App Usage (Default Off)	Client: 982663 Legal: 1021259, 1109429
2.2	Retention App Usage (Default On) AppUsage, MAU Acquisition: Report Preinstalled Apps Revenue Num of Searches/Revenue	AppUsage, MAU: 1109422 Client side work for enabling AppUsage , 1119009 Marketplace Apps Only 1109426 Server side dashboard for Most used apps: 1021173 Report Preinstalled Apps, 1126524 Search
2.5	Retention: Engagement with device: Number of voice calls, data (wifi and cellular), number of text messages. 1193225. Inclusion of device metrics in A/B testing OTA collection of App Startup time, device startup time. Activations FTU Ping: Avoid counting repeat pings from a known device. 1171685. Privacy: User ability to delete collected info. 126513. Converged UX for opt-in, opt-out of metrics. 1181295. Scaling: Framework (Metabug: 1152000) to add Metrics (1183101) and collect custom histogram (1176992) Converge the collection of items under "FxOS Health Report" branding. 126513. Framework for adding additional metrics. Bug tbd Support for Non Phone devices: Using TV serial number to avoid counting repeat pings. 1171685.
3.0 & Future (In Planning)	(In Planning) Activation Optimizing FTU: % of signups to Moz services: FxAccounts, FMD Retention Content Recommendation Engine based on usage (User Benefit) Advanced A/B testing Referral Net Promoter Score (User Satisfaction Factor)

User Stories

• User Stories

Virtual Team

• Device Engg: Tamara Hills, Gregor Wagner
• Device QA: Shing Lyu
• Server Metrics: Dave Zeber, John Jensen
• Engg Program Mgmt: Michael Treese
• Planning: Dominik Strohmeier
• Product Mgmt: Ravi Dandu
• Marketplace Product Mgmt: David Bialer
• Marketplace Program Mgmt: tbd
• Marketplace Engg: Andy McKay, Rob Hudson
• Alumni: Marshall Culpepper, Hema Koka

Links

• Activation Ping
• AppUsage Data
• MAU Doc
• Main Metrics Page (this page)
• Testing Guide
• Frequently Asked Questions
• Performance Goals