Auto-tools/Projects/B2G Test And Performance: Difference between revisions

← Older edit

Auto-tools/Projects/B2G Test And Performance (view source)

Revision as of 18:08, 15 November 2012

3,231 bytes added , 15 November 2012

→‎Meetings

Ahal

Confirmed users

656

edits

@@ Line 6: / Line 6: @@
 == Eideticker ==
-[https://wiki.mozilla.org/Project_Eideticker Eideticker] is a video capture and analysis tool for performance analysis. It will use marionette to drive the system under test.  It can also be used to do performance testing for fennec and desktop browsers as well.
+[https://wiki.mozilla.org/Project_Eideticker Eideticker] is a video capture and analysis tool for performance analysis. It can also be used to do performance testing for fennec and desktop browsers as well.
+== Benchmarks ==
+We'd like to address the wishlist of benchmarks summarized below (originally from [https://groups.google.com/d/topic/mozilla.dev.b2g/88rr_Acs1DE/discussion this thread], and emailed suggestions, aggregated [https://etherpad.mozilla.org/b2g-benchmark-wishlist here]):
+* Some brand name companies may ask for the performance of file reading/writing on different file sizes and file numbers.
+* [sicking] App startup time. we should start with the most critical built-in apps (phone, sms, browser), we should also do 3rd party apps, both packaged and hosted ones
+* [suggested by ieee engineer, off-thread] Boot time as a metric. This is specially interesting for the pandaboard user group, aiming to use B2G in OEM applications.
+* [Michael Treese, gal] Battery estimates. Example profiling:
+** Standby time (important), then videos and apps
+** Active radio usage (calls, etc) is for OEM to optimize
+** Test Battery life with other applications - Browser, FM Radio, FB, etc.
+** how many amps an applications consumes during normal usage
+* [overholt] Can we use [http://www.lesswatts.org/projects/powertop/ powerTOP] for power consumption usage?
+* [akeybl]:
+** startup/shutdown time, cold app launch time, warm app launch time (?), WebGL tech demo framerates, JS perf tests, dropped frames in video playback, memory usage all the while, and app eviction frequency (?).
+* [khu] CPU usage and memory usage:
+** related bug: https://bugzilla.mozilla.org/show_bug.cgi?id=756379
+* [jlebar] Perhaps we can do a straightforward measurement similar to [http://areweslimyet.com AWSY] (except with apps instead of webpages), if we're running on an emulator with unlimited memory.  If OTOH we're emulating a device with a fixed amount of memory, we'll have to be more clever in how we measure, since B2G will happily kill background apps when it's running out of memory.  Maybe you can come to a MemShrink meeting and we can talk over how we might want to do memory benchmarks on the device.  Don't be a stranger.
 == Meetings ==
@@ Line 13: / Line 31: @@
 When: Every Thursday [http://www.timeanddate.com/worldclock/fixedtime.html?iso=20111006T10&p1=283 10AM PDT]
-Where: Phone: 1-650-903-0800 x92, Conf # 304 OR 1-800-707-2533, PIN: 369, 304
+Where: Phone: 1-650-903-0800 x92, Conf #95589 OR 1-800-707-2533, PIN: 369, 95589
 Etherpad: Jot down meeting notes [https://etherpad.mozilla.org/b2g-ateam-automation here]
@@ Line 19: / Line 37: @@
 [[Auto-tools/Projects/B2G_Test_And_Performance/Meeting_Template| Meeting Template]]
+Create a new weekly agenda from the active [[Auto-tools/Projects/B2G_Test_And_Performance/Meeting_Template| Meeting Template]]:
+<createbox>
+align=left
+type=create
+preload=Auto-tools/Projects/B2G_Test_And_Performance/Meeting_Template
+default={{#time: Y-m-d}}
+prefix=Auto-tools/Projects/B2G_Test_And_Performance/Meetings/
+</createbox>
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-11-15| Nov 15 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-11-01| Nov 01 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-10-11| Oct 11 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-10-04| Oct 4 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-09-20| Sep 27 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-09-20| Sep 20 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-09-13| Sep 13 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-09-06| Sep 06 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-08-30| August 30 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-08-23| August 23 2012]]
+* [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-08-16| August 16 2012]]
 * [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-08-09| August 09 2012]]
 * [[Auto-tools/Projects/B2G_Test_And_Performance/Meetings/2012-08-02| August 2 2012]]