Firefox OS/Performance/Release Acceptance: Difference between revisions

(→‎Definitions: Add Reference Devices)
 
(15 intermediate revisions by 3 users not shown)
Line 14: Line 14:
''Note: All measurements are the median results calculated from multiple iterations of relevant tests. For example, Datazilla's App Launch values are calculated from 30 such iterations.''
''Note: All measurements are the median results calculated from multiple iterations of relevant tests. For example, Datazilla's App Launch values are calculated from 30 such iterations.''


== 2.1 ==
== Reference Devices ==


* Reference Device: Flame 319MB
* [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame Flame]
* [https://en.wikipedia.org/wiki/Sony_Xperia_Z3_Compact Sony Xperia Z3 Compact (Aries)]
* [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Phone_specs Others phone ]
 
== Application cold launch ==
 
 
=== FxOS 2.5 ===
 
* Reference Device: Flame-KK 319MB and Aries-KK
* Reference Workload: Light
* Reference Workload: Light
* For Camera App, as discussed with the PM, the performance boundary will be based on the average of 3 performance runs done in Oct 2nd, 21st, and 30th.  If the number regresses more than 100ms from the criteria, it will be considered as a regression.


{| class="wikitable"
{| class="wikitable"
|-
|-
! Application !! [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,costcontrol,email%20FTU,fm,gallery,settings,sms,video&app=communications/dialer&plot=median First Launch] !! First Launch Memory <!-- Relaunch !! Max Memory !! Max Power -->
! Application !! [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.* First Launch] !! Regression !! Nominated
|-
| Calendar || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar&app=calendar&plot=median 1000 ms]
|-
| Camera || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=camera&app=camera&plot=median 1550 ms]
|-
|-
| Clock || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=clock&app=clock&plot=median 1000 ms]
| Calendar
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=1&fullscreen 1150 ms]
||
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=1181019 Bug 1181019]
|-
|-
| Contacts || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/contacts&app=communications/contacts&plot=median 1000 ms]
| Camera
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=2&fullscreen 1550 ms]
||
||
|-
|-
| Cost Control || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=costcontrol&app=costcontrol&plot=median 1000 ms]
| Clock
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=3&fullscreen 1000 ms]
||
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=1181021 Bug 1181021]
|-
|-
| Dialer || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/dialer&app=communications/dialer&plot=median 1000 ms]
| Contacts
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=4&fullscreen 1000 ms]
||
||
|-
|-
| Email || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median 1000 ms]
| Dialer
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=10&fullscreen 1000 ms]
||
||
|-
|-
| FM Radio || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median 1000 ms]
| Email
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=5&fullscreen 1000 ms]
||
||
|-
|-
| Gallery || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median 1000 ms]
| FM Radio
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=6&fullscreen 1000 ms]
||
||
|-
|-
| Homescreen  || 1000 ms
| Gallery
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=7&fullscreen 1000 ms]
||
||
|-
|-
| Marketplace  || 1000 ms
| Music
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=9&fullscreen 1000 ms]
||
||
|-
|-
| Settings || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=settings&app=settings&plot=median 2600 ms]
| Settings  
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=11&fullscreen 2600 ms]
||
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=1181023 Bug 1181023]
|-
|-
| SMS || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=sms&app=sms&plot=median 1000 ms]
| SMS  
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=8&fullscreen 1200 ms]
||
|| [https://bugzilla.mozilla.org/show_bug.cgi?id=1181017 Bug 1181017]
|-
|-
| Video || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median 1000 ms]
| Video  
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=319&series=coldlaunch.*&panelId=12&fullscreen 1000 ms]
||
||
|}
|}


''NOTE: These apps have been [https://bugzilla.mozilla.org/show_bug.cgi?id=996038#user_story_header instrumented] to emit events that support timing their [https://developer.mozilla.org/en-US/Apps/Build/Performance/Firefox_OS_app_responsiveness_guidelines#wiki-document-head launch states].''
''NOTE: These apps have been [https://bugzilla.mozilla.org/show_bug.cgi?id=996038#user_story_header instrumented] to emit events that support timing their [https://developer.mozilla.org/en-US/Apps/Build/Performance/Firefox_OS_app_responsiveness_guidelines#wiki-document-head launch states].''


== 2.0 ==
=== FxOS 2.0, 2.1, 2.2 ===


* Reference Device: Flame 319MB
* Reference Device: Flame 319MB
* Reference Workload: Light
* Reference Workload: Light
* For Camera App, as discussed with the PM, the performance boundary will be based on the average of 3 performance runs done in Oct 2nd, 21st, and 30th.  If the number regresses more than 100ms from the criteria, it will be considered as a regression.


{| class="wikitable"
{| class="wikitable"
|-
|-
! Application !! [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,costcontrol,email%20FTU,fm,gallery,settings,sms,video&app=communications/dialer&plot=median First Launch] <!-- !! First Launch Memory !! Relaunch !! Max Memory !! Max Power -->
! Application !! [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,costcontrol,email%20FTU,fm,gallery,settings,sms,video&app=communications/dialer&plot=median FxOS 2.2] !! [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,costcontrol,email%20FTU,fm,gallery,settings,sms,video&app=communications/dialer&plot=median FxOS 2.1] !! [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,costcontrol,email%20FTU,fm,gallery,settings,sms,video&app=communications/dialer&plot=median FxOS 2.0]
|-
| Calendar
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar&app=calendar&plot=median 1150 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar&app=calendar&plot=median 1150 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar&app=calendar&plot=median 1000 ms]
|-
| Camera
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=camera&app=camera&plot=median 1550 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=camera&app=camera&plot=median 1550 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=camera&app=camera&plot=median 1000 ms]
|-
|-
| Calendar || [https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=calendar&app=calendar&plot=median 1000 ms]
| Clock
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=clock&app=clock&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=clock&app=clock&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=clock&app=clock&plot=median 1000 ms]
|-
|-
| Camera || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=camera&app=camera&plot=median 1000 ms]
| Contacts
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/contacts&app=communications/contacts&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/contacts&app=communications/contacts&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/contacts&app=communications/contacts&plot=median 1000 ms]
|-
|-
| Clock || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=clock&app=clock&plot=median 1000 ms]
| Cost Control
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=costcontrol&app=costcontrol&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=costcontrol&app=costcontrol&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=costcontrol&app=costcontrol&plot=median 1000 ms]
|-
|-
| Contacts || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/contacts&app=communications/contacts&plot=median 1000 ms]
| Dialer
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/dialer&app=communications/dialer&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/dialer&app=communications/dialer&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/dialer&app=communications/dialer&plot=median 1000 ms]
|-
|-
| Cost Control || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=costcontrol&app=costcontrol&plot=median 1000 ms]
| Email
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median 1000 ms]
|-
|-
| Dialer || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=communications/dialer&app=communications/dialer&plot=median 1000 ms]
| FM Radio
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median 1000 ms]
|-
|-
| Email || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median 1000 ms]
| Gallery
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median 1000 ms]
|-
|-
| FM Radio || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median 1000 ms]
| Homescreen 
|| 1000 ms
|| 1000 ms
||
|-
|-
| Gallery || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median 1000 ms]
| Marketplace 
|| 1000 ms
|| 1000 ms
|| 1000 ms
|-
|-
| Marketplace   || 1000 ms
| Music    
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=music&app=music&gaia_rev=a53a3a1d5d4f8d75&gecko_rev=fdad48b0e5b5&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=music&app=music&gaia_rev=a53a3a1d5d4f8d75&gecko_rev=fdad48b0e5b5&plot=median 1000 ms]
||
|-
|-
| Settings || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=settings&app=settings&plot=median 1000 ms]
| Settings  
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=settings&app=settings&plot=median 2600 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=settings&app=settings&plot=median 2600 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=settings&app=settings&plot=median 1000 ms]
|-
|-
| SMS || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=sms&app=sms&plot=median 1000 ms]
| SMS  
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=sms&app=sms&plot=median 1200 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=sms&app=sms&plot=median 1200 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=sms&app=sms&plot=median 1000 ms]
|-
|-
| Video || [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median 1000 ms]
| Video  
|| [https://datazilla.mozilla.org/b2g/?branch=v2.2&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.1&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median 1000 ms]
|| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame-319MB&range=7&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median 1000 ms]
|}
|}


''NOTE: These apps have been [https://bugzilla.mozilla.org/show_bug.cgi?id=996038#user_story_header instrumented] to emit events that support timing their [https://developer.mozilla.org/en-US/Apps/Build/Performance/Firefox_OS_app_responsiveness_guidelines#wiki-document-head launch states].''
=== FxOS 1.4 ===
 
== 1.4 ==


* Reference Device: Buri/Hamachi
* Reference Device: Buri/Hamachi
Line 121: Line 210:
|}
|}


== 1.3T ==
=== FxOS 1.3T ===


* Reference Device: Tarako
* Reference Device: Tarako


Acceptance for 1.3T will be determined by reviewing final performance results which will include [https://datazilla.mozilla.org/b2g/?branch=v1.3t&device=tarako&range=90&test=cold_load_time&plot=median cold launch time].
Acceptance for 1.3T will be determined by reviewing final performance results which will include [https://datazilla.mozilla.org/b2g/?branch=v1.3t&device=tarako&range=90&test=cold_load_time&plot=median cold launch time].
== Memory Usage ==
== [[Firefox OS/Performance/Power Consumption|Power Consumption]] ==
== [[Firefox_OS/Performance/MTBF | MTBF (Mean time between failures)]] ==

Latest revision as of 09:02, 26 August 2015

Criteria

Definitions

First Launch
Milliseconds elapsed from the user-initiated launch of a not-already-in-memory app to the stable display of that app and its visible content. These timings are captured to the moz-app-visually-complete event documented on MDN.
First Launch Memory
Maximum bytes of RAM used by an application after completing its First Launch.
Reference Workload
A standardized collection of application data preloaded before the test is run.

Note: All measurements are the median results calculated from multiple iterations of relevant tests. For example, Datazilla's App Launch values are calculated from 30 such iterations.

Reference Devices

Application cold launch

FxOS 2.5

  • Reference Device: Flame-KK 319MB and Aries-KK
  • Reference Workload: Light
Application First Launch Regression Nominated
Calendar 1150 ms Bug 1181019
Camera 1550 ms
Clock 1000 ms Bug 1181021
Contacts 1000 ms
Dialer 1000 ms
Email 1000 ms
FM Radio 1000 ms
Gallery 1000 ms
Music 1000 ms
Settings 2600 ms Bug 1181023
SMS 1200 ms Bug 1181017
Video 1000 ms

NOTE: These apps have been instrumented to emit events that support timing their launch states.

FxOS 2.0, 2.1, 2.2

  • Reference Device: Flame 319MB
  • Reference Workload: Light
  • For Camera App, as discussed with the PM, the performance boundary will be based on the average of 3 performance runs done in Oct 2nd, 21st, and 30th. If the number regresses more than 100ms from the criteria, it will be considered as a regression.
Application FxOS 2.2 FxOS 2.1 FxOS 2.0
Calendar 1150 ms 1150 ms 1000 ms
Camera 1550 ms 1550 ms 1000 ms
Clock 1000 ms 1000 ms 1000 ms
Contacts 1000 ms 1000 ms 1000 ms
Cost Control 1000 ms 1000 ms 1000 ms
Dialer 1000 ms 1000 ms 1000 ms
Email 1000 ms 1000 ms 1000 ms
FM Radio 1000 ms 1000 ms 1000 ms
Gallery 1000 ms 1000 ms 1000 ms
Homescreen 1000 ms 1000 ms
Marketplace 1000 ms 1000 ms 1000 ms
Music 1000 ms 1000 ms
Settings 2600 ms 2600 ms 1000 ms
SMS 1200 ms 1200 ms 1000 ms
Video 1000 ms 1000 ms 1000 ms

FxOS 1.4

  • Reference Device: Buri/Hamachi
  • Reference Workload: Medium
Application First Launch
Browser No regression since 1.3
Camera No regression since 1.3
Contacts No regression since 1.3
Dialer No regression since 1.3
Email No regression since 1.3
Gallery No regression since 1.3
Marketplace No regression since 1.3
Settings No regression since 1.3
SMS No regression since 1.3

FxOS 1.3T

  • Reference Device: Tarako

Acceptance for 1.3T will be determined by reviewing final performance results which will include cold launch time.

Memory Usage

Power Consumption

MTBF (Mean time between failures)