Firefox OS/Performance/Memory acceptance criteria: Difference between revisions

Line 53: Line 53:
This section defines the workloads by which the criteria above are evaluated.  Along with each workload, the acceptance status is listed for the given commit IDs below.
This section defines the workloads by which the criteria above are evaluated.  Along with each workload, the acceptance status is listed for the given commit IDs below.


[http://git.mozilla.org/?p=releases/gecko.git;a=commit;h=375383a94d3ec2ee44e7bcf2895d86c15fcf9762 '''Gecko'''] [http://git.mozilla.org/?p=releases/gaia.git;a=commit;h=b277f372f097c77dd2ec1988a80e458280dda491 '''Gaia''']
[http://git.mozilla.org/?p=releases/gecko.git;a=commit;h=cb007bcbaaffacf2e8ea93a60cf7c4ccd1164437 '''Gecko'''] [http://git.mozilla.org/?p=releases/gaia.git;a=commit;h=9aab784d8e572853c79403334f4dac0f9c9c4678 '''Gaia''']


MW0: [<font color="red">'''FAIL'''</font>] Every app is successfully launched into the foreground
MW0: [<font color="red">'''FAIL'''</font>] Every app is successfully launched into the foreground
Line 59: Line 59:
MW1: [<font color="red">'''FAIL'''</font>] Music stays alive
MW1: [<font color="red">'''FAIL'''</font>] Music stays alive


MW2: [<font color="green">'''PASS'''</font>] Active call stays active
MW2: [<font color="red">'''FAIL'''</font>] Active call stays active


MW3: [<font color="green">'''PASS'''</font>] 114MB: (QoS) Maximum amount of memory that web apps can directly allocate (not including per-app memory)
MW3: [<font color="green">'''PASS'''</font>] 113MB: (QoS) Maximum amount of memory that web apps can directly allocate (not including per-app memory)


MW4: [<font color="green">'''PASS'''</font>] Apps are successfully launched into the foreground under memory pressure
MW4: [<font color="red">'''FAIL'''</font>] Apps are successfully launched into the foreground under memory pressure


=== MW0: Every app is successfully launched into the foreground ===
=== MW0: Every app is successfully launched into the foreground ===


<font color="red">Calendar fails to launch in step 14</font>{{bug|837927}}
<font color="red">Maps crashing on startup</font> {{bug|839256}}


# Ensure wifi is enabled and a network has been successfully configured
# Ensure wifi is enabled and a network has been successfully configured
Line 75: Line 75:
# Launch Contacts app, press HOME button
# Launch Contacts app, press HOME button
# Launch Browser app, press HOME button
# Launch Browser app, press HOME button
# Launch Feedback app, press HOME button
# <s>Launch Feedback app, press HOME button</s>
# Launch Camera app, press HOME button
# Launch Camera app, press HOME button
# Launch Gallery app, press HOME button
# Launch Gallery app, press HOME button
Line 96: Line 96:
=== MW1: Music stays alive ===
=== MW1: Music stays alive ===


<font color="red">Calendar fails to launch in MW0 step 14</font>{{bug|837927}}
<font color="red">Maps crashing on startup</font> {{bug|839256}}


# Long-tap POWER button, choose "Restart"
# Long-tap POWER button, choose "Restart"
Line 105: Line 105:


=== MW2: Active call stays active ===
=== MW2: Active call stays active ===
<font color="red">Contacts app dying in step 22</font> {{bug|840252}}


# Long-tap POWER button, choose "Restart"
# Long-tap POWER button, choose "Restart"
Line 140: Line 142:
# Long-tap POWER button, choose "Restart"
# Long-tap POWER button, choose "Restart"
# Open settings app, go to "Display" and set "Screen timeout" to "Never"
# Open settings app, go to "Display" and set "Screen timeout" to "Never"
# Go to "Device information", "More information", "Developer" and check "Remote debugging" and "Console enabled"
# Open browser app, navigate to http://people.mozilla.com/~cjones/membuster.html
# Open browser app, navigate to http://people.mozilla.com/~cjones/membuster.html
# Tap the "Bust system memory" button
# Tap the "Bust system memory" button
Line 147: Line 150:


=== MW4: Apps are successfully launched into the foreground under memory pressure ===
=== MW4: Apps are successfully launched into the foreground under memory pressure ===
<font color="red">Incoming call is dropped</font> {{bug|840257}}


# Long-tap POWER button, choose "Restart"
# Long-tap POWER button, choose "Restart"
Confirmed users
699

edits