Auto-tools/Projects/B2G Test And Performance

From MozillaWiki
Jump to navigation Jump to search

B2G Test and Performance Automation

These are our current projects to support B2G and other mobile efforts going forward.

Marionette

Marionette is a low-level test automation integration into the Gecko Platform. It will communicate via a JSON API that is captured by the JavaScript remote debugging socket. And it will interpret those JSON commands into actions via the accessibility (a11y) interfaces already present in the platform.

Eideticker

Eideticker is a video capture and analysis tool for performance analysis. It will use marionette to drive the system under test. It can also be used to do performance testing for fennec and desktop browsers as well.

Benchmarks

We'd like to address the wishlist of benchmarks summarized below (originally from this thread, and emailed suggestions, aggregated here):

  • Some brand name companies may ask for the performance of file reading/writing on different file sizes and file numbers.
  • App startup time. we should start with the most critical built-in apps (phone, sms, browser), we should also do 3rd party apps, both packaged and hosted ones. [suggested by sicking]
  • Boot time as a metric. This is specially interesting for the pandaboard user group, aiming to use B2G in OEM applications. [suggested by ieee engineer, off-thread]
  • Battery estimates. Example profiling:
    • Make a 3 min. phone call, wait 3 min. and make another - repeat until the battery is done. (time could varry between 3 and 30 min.)
    • Make a 10 min. phone call, send 10 SMS messages, take 10 pictures, play 10 videos - repeat until the battery is done.
    • Test Battery life with other applications - Browser, FM Radio, FB, etc.
  • how many amps an applications consumes during normal usage

[Michael Treese]

Meetings

Join us, we'd love the help! You can either drop by in #ateam (irc.mozilla.org) or drop into one of our meetings.

When: Every Thursday 10AM PDT

Where: Phone: 1-650-903-0800 x92, Conf # 304 OR 1-800-707-2533, PIN: 369, 304

Etherpad: Jot down meeting notes here

Meeting Template

Retrieved from "https://wiki.allizom.org/index.php?title=Auto-tools/Projects/B2G_Test_And_Performance&oldid=463883"