Firefox OS/Metrics: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
m (t)
(Update the team)
 
(25 intermediate revisions by 4 users not shown)
Line 28: Line 28:
*Apps usage per month
*Apps usage per month
*Performance (App Startup time, Power consumption)
*Performance (App Startup time, Power consumption)
|In Progress
|Internal
|-
|-
|Revenue
|Revenue
Line 34: Line 34:
*Number of searches done
*Number of searches done
*Paid App Downloads
*Paid App Downloads
|In Progress
|Internal
|-
|-
|Referral
|Referral
Line 87: Line 87:
|
|
*Retention:
*Retention:
**Engagement with device: [https://bugzilla.mozilla.org/1193225 Number of voice calls, data (wifi and cellular), number of text messages. 1193225.]
**[https://bugzilla.mozilla.org/1179004 OTA collection of App Startup time (1179004)].  
**Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
*Activation
**[https://bugzilla.mozilla.org/1179004 OTA collection of App Startup time, device startup time (1179004)].  
**Accuracy of activation: [https://bugzilla.mozilla.org/1171685 FTU Ping: Avoid counting repeat pings from a known device. (1171685).]
*Activations
** [https://bugzilla.mozilla.org/1171685 FTU Ping: Avoid counting repeat pings from a known device. 1171685.]
*Privacy:
*Privacy:
**[https://bugzilla.mozilla.org/126513 User ability to delete collected info. 126513.]
**[https://bugzilla.mozilla.org/1181295 Converged UX for opt-in, opt-out of metrics. 1181295.]  
**[https://bugzilla.mozilla.org/1181295 Converged UX for opt-in, opt-out of metrics. 1181295.]  
*Scaling:
*Scaling:
**[https://bugzilla.mozilla.org/1152000 Framework (Metabug: 1152000) to collect custom Metrics and histogram]
**[https://bugzilla.mozilla.org/1152000 Framework (Metabug: 1152000) to collect custom Metrics and histogram]
**[https://bugzilla.mozilla.org/1181295 Converge the collection of items under "FxOS Health Report" branding. (1181295)]
**Non Phone devices support: [https://bugzilla.mozilla.org/1171685 Using TV serial number to avoid counting repeat pings. 1171685.]  
**Support for Non Phone devices: [https://bugzilla.mozilla.org/1171685 Using TV serial number to avoid counting repeat pings. 1171685.]  
**B2GDroid Support ([https://bugzilla.mozilla.org/show_bug.cgi?id=1198338 B2GDroid Metric Collection 1198338])
**B2GDroid Support (In planning)
**AddOns Support ([https://bugzilla.mozilla.org/1198346: AddOns Metric collection 1198346])
**AddOns Support (In planning)
|
|
|-
|-
|3.0 & Future (In Planning)
|2.6 (May 2016)
| (In Planning)
| (In Planning [https://bugzilla.mozilla.org/show_bug.cgi?id=1226182 Meta Bug for 2.6 (1226182)])
*Activation
*Activation
**Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
**Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
**Accuracy of Retention/MAU: [https://bugzilla.mozilla.org/1198164 FTU ping should include info on whether User opt-in for metrics (1198164)]
*Retention  
*Retention  
**Content Recommendation Engine based on usage (User Benefit)
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1226458 Support for progressive web apps (1226458)]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1226274 Make uuid available to Foxfooder app (1226274)]
**Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
**Engagement with device: [https://bugzilla.mozilla.org/1193225 Number of voice calls, data (wifi and cellular), number of text messages. 1193225.]
** Device Startup time: [https://bugzilla.mozilla.org/1177226 OTA collection of device dtartup time (1177226)]
**Advanced A/B testing
**Advanced A/B testing
**Churn Rate & User Lifecycle Analysis (In planning)
**Framework Improvements
***Enum Type and Boolean Type histograms
**Support for New Security model [https://bugzilla.mozilla.org/show_bug.cgi?id=1225960 1225960]
**FoTA Ping [https://bugzilla.mozilla.org/show_bug.cgi?id=1202970 Engg bug: 1202970], [https://bugzilla.mozilla.org/show_bug.cgi?id=1202987. Legal bug: 1202987].
*Referral
*Referral
**Net Promoter Score (User Satisfaction Factor)
**Net Promoter Score (User Satisfaction Factor)
*Privacy
**[https://bugzilla.mozilla.org/1126513 User ability to delete collected info. 1126513.]
*Server
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1226062 Graphing of Addon Histograms]
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1226064 Graphing of Keyed Histograms]
|-
|End-2016 (In Planning)
|
*Retention
**Content Recommendation Engine based on usage (User Benefit)
|
|
|}
|}
Line 117: Line 133:
=User Stories=
=User Stories=
*[https://docs.google.com/a/mozilla.com/spreadsheet/ccc?key=0AmVPziKCVEUEdGFoczVCaHBzOGxQcXNxWWs3aWRSalE#gid=0 User Stories]
*[https://docs.google.com/a/mozilla.com/spreadsheet/ccc?key=0AmVPziKCVEUEdGFoczVCaHBzOGxQcXNxWWs3aWRSalE#gid=0 User Stories]
= FoxFooding =
[https://wiki.mozilla.org/FirefoxOS/Metrics/FoxFooding Data gathered for the FoxFooding program]


=Virtual Team=
=Virtual Team=
*Device Engg:  Tamara Hills, Gregor Wagner, Russ Nicoletti
*Device Engg:  Tamara Hills, Gregor Wagner, Russ Nicoletti
*Device QA: Shing Lyu
*Device QA: Shing Lyu, Iris Hsiao, Gerry Chang
*Server Metrics: Dave Zeber, John Jensen  
*Server Metrics: Dave Zeber, John Jensen  
*Engg Program Mgmt: Michael Treese
*Planning: Dominik Strohmeier, Maria Oteo
*Planning: Dominik Strohmeier
*Product Mgmt: Peter Dolanjski, Maria Oteo
*Product Mgmt: Ravi Dandu
*Marketplace Product Mgmt: David Bialer
*Marketplace Program Mgmt: tbd
*Marketplace Engg: Andy McKay, Rob Hudson
*Alumni: Marshall Culpepper, Hema Koka
*Alumni: Marshall Culpepper, Hema Koka


=Links=
=Links=
*[https://wiki.mozilla.org/FirefoxOS/Metrics/CustomMetrics CustomMetrics]
*[https://wiki.mozilla.org/FirefoxOS/Metrics/EngineeringMetrics EngineeringMetrics]
*[https://wiki.mozilla.org/FirefoxOS/Metrics/activationping Activation Ping]
*[https://wiki.mozilla.org/FirefoxOS/Metrics/activationping Activation Ping]
*[https://wiki.mozilla.org/FirefoxOS/Metrics/App_Usage AppUsage Data]
*[https://wiki.mozilla.org/FirefoxOS/Metrics/App_Usage AppUsage Data]

Latest revision as of 16:42, 21 January 2016

Goals

The FxOS Metrics project enables making data driven decisions for the following:

  • Understanding how FxOS is doing in the market versus product/business goals
  • Gaining insights from quantitative and qualitative data, to enable improve the product/business goals
  • Understanding usage models, to improve future product development and opportunities
  • Determining effectiveness of marketing campaigns.

Metrics

Customer lifecycle Metrics to be collected Dashboard
Acquiring Customers
  • Partners/Channels though which devices are sold
 Dashboard: Choose Operator/OEM/Country combination of channel

Activation of Devices

  • Total number of Activated devices
 Dashboard: Choose 'All' in SW/Operator/OEM/ to get a count

Retention Of Customers

  • MAU (Monthly Active Users)
  • Apps usage per month
  • Performance (App Startup time, Power consumption)
 Internal
Revenue
  • Number of searches done
  • Paid App Downloads
 Internal
Referral
  • Net Promoter Score
    • Recommendations from Users
    • User Satisfaction Factor
 Future

Roadmap

FxOS Release Metrics to be collected Bugs
1.3
  • Engg: 986701,997960
  • Legal: 980920
  • Privacy: 992487
2.1
  • Client: 982663
  • Legal: 1021259, 1109429
2.2
2.5
2.6 (May 2016) (In Planning Meta Bug for 2.6 (1226182))
End-2016 (In Planning)
  • Retention
    • Content Recommendation Engine based on usage (User Benefit)

User Stories

FoxFooding

Data gathered for the FoxFooding program

Virtual Team

  • Device Engg: Tamara Hills, Gregor Wagner, Russ Nicoletti
  • Device QA: Shing Lyu, Iris Hsiao, Gerry Chang
  • Server Metrics: Dave Zeber, John Jensen
  • Planning: Dominik Strohmeier, Maria Oteo
  • Product Mgmt: Peter Dolanjski, Maria Oteo
  • Alumni: Marshall Culpepper, Hema Koka

Links

Retrieved from "https://wiki.allizom.org/index.php?title=Firefox_OS/Metrics&oldid=1113701"