Metrics Description: Difference between revisions

 
(8 intermediate revisions by the same user not shown)
Line 5: Line 5:
===Product Requirements:===
===Product Requirements:===
Provisional Roadmap for 2.6 in included [[Firefox_OS/Metrics#Roadmap|here]]. Although it needs to be re-evaluated after Mozlando announcement. For the time being, these are the planned features although it's also necessary that they can be prioritized.
Provisional Roadmap for 2.6 in included [[Firefox_OS/Metrics#Roadmap|here]]. Although it needs to be re-evaluated after Mozlando announcement. For the time being, these are the planned features although it's also necessary that they can be prioritized.
==== Activation ====
===== Activation =====
*Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
*Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
*Accuracy of Retention/MAU: FTU ping should include info on whether User opt-in for metrics (1198164)
*Accuracy of Retention/MAU: FTU ping should include info on whether User opt-in for metrics (1198164)
==== Retention ====
===== Retention =====
*Support for progressive web apps (1226458)
*Support for progressive web apps
*Make uuid available to Foxfooder app (1226274)
*Make uuid available to Foxfooder app
*Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
*Inclusion of device metrics in A/B testing (likely to be moved beyond 2.5)
*Engagement with device: Number of voice calls, data (wifi and cellular), number of text messages. 1193225.
*Engagement with device: Number of voice calls, data (wifi and cellular), number of text messages.  
*Device Startup time: OTA collection of device dtartup time (1177226)
*Device Startup time: OTA collection of device dtartup time
*Advanced A/B testing
*Advanced A/B testing
*Churn Rate & User Lifecycle Analysis (In planning)
*Churn Rate & User Lifecycle Analysis (In planning)
*Framework Improvements
*Framework Improvements
**Enum Type and Boolean Type histograms
**Enum Type and Boolean Type histograms
*Support for New Security model 1225960
*Support for New Security model  
*FoTA Ping Engg bug: 1202970, Legal bug: 1202987.
*FoTA Ping  
==== Referral ====
===== Referral =====
*Net Promoter Score (User Satisfaction Factor)
*Net Promoter Score (User Satisfaction Factor)
==== Privacy =====
===== Privacy =====
*User ability to delete collected info. 1126513.
*User ability to delete collected info
==== Server ====
===== Server =====
*Graphing of Addon Histograms
*Graphing of Addon Histograms
*Graphing of Keyed Histograms
*Graphing of Keyed Histograms


===User Stories and Acceptance Criteria===
===User Stories and Acceptance Criteria===
Line 36: Line 35:
! style="text-align: center;" | Acceptance Criteria
! style="text-align: center;" | Acceptance Criteria
|-
|-
| rowspan="2" | Title Goes Here
| rowspan="2" | Activation
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| Optimizing FTU: % of signups to Moz services: FxAccounts, FMD
|
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1198164 Bug 1198164]
| FTU ping should include info on whether User opt-in for metrics
|
|-
| rowspan="1" | Metrics should be able to track progressive web apps [https://bugzilla.mozilla.org/show_bug.cgi?id=1226458 Bug 1226458]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|
|-
| rowspan="1" | Expose AUM UUID to foxfooding app [https://bugzilla.mozilla.org/show_bug.cgi?id=1226274 Bug 1226274]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|
|-
| rowspan="1" | Metrics should be able to track progressive web apps [https://bugzilla.mozilla.org/show_bug.cgi?id=1226458 Bug 1226458]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|-
| rowspan="1" | FxOS metrics of Engagement of User: voice calls, text, and data [https://bugzilla.mozilla.org/show_bug.cgi?id=1193225 Bug 1193225]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|
|-
| rowspan="1" | Support User Timing API events in the Developer HUD [https://bugzilla.mozilla.org/show_bug.cgi?id=1177226 Bug 1177226]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|
|-
| rowspan="1" | Advanced A/B testing
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|-
| rowspan="1" | Churn Rate & User Lifecycle Analysis
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|-
| rowspan="1" | Framework Improvements
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|-
| rowspan="1" | Metrics should support the new security model [https://bugzilla.mozilla.org/show_bug.cgi?id=1225960 Bug 1225960]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| User Story 1
|
| Acceptance Criteria 1
|  
|-
|-
| rowspan="1" | FOTA metrics collection [https://bugzilla.mozilla.org/show_bug.cgi?id=1202970 Bug 1202970]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| User Story 2
|  
| Acceptance Criteria 2
|  
|-
|-
| rowspan="1" | Help/Onboarding
| rowspan="1" | Net Promoter Score (User Satisfaction Factor)
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
| User Story 3
|
| Acceptance Criteria 3
|  
|-
| rowspan="1" | Metrics opt-out should give a choice to delete collected data [https://bugzilla.mozilla.org/show_bug.cgi?id=1126513 Bug 1126513]
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1180659 Bug ID]
|
|
|-
| rowspan="2" | Server
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1226062  Bug 1226062]
| Telemetry Server needs support for graphing of addonHistograms
|
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1226064  Bug 1226064]
| Reports for Engineering Metrics which are delivered as keyed Histograms need to be written
|
|}
|}


Line 179: Line 242:
|-
|-
| EPM
| EPM
|  
| Maria Oteo
|  
| mariaoteo
|-
|-
| EM
| EM
|  
| Francisco Jordano
|  
| framcisco
|-
|-
| PM
| PM
Line 191: Line 254:
|-
|-
| TL
| TL
|
| Tamara Hills
|
| thills
|-
|-
| UX
| UX
Line 211: Line 274:


----
----
==UX Specs==
==UX Specs==


Confirmed users
1,225

edits