Buildbot/Talos/Tests: Difference between revisions

Buildbot/Talos/Tests (view source)

Revision as of 19:28, 26 February 2014

388 bytes removed , 26 February 2014

m

→‎Robocop

Gbrown

Confirmed users

1,759

edits

@@ Line 520: / Line 520: @@
 [[Auto-tools/Projects/Robocop|Robocop]] is Mozilla's Android test framework based on [http://robotium.org Robotium].  In addition to functional/unit tests, there are several robocop performance tests run by Talos.
-; Robocop Checkerboarding Benchmark (tcheckerboard/trobocheck/rck)
-: "Checkerboard" refers to cases where we can't render new portions of a page as fast as a user scrolls to them, and so they see a blank area, low-resolution rendering, or a checkerboard pattern as they scroll.  This test measures "checkerboarding" by scrolling up and down a page and recording the '''average percentage of the screen that is "checkerboarded"''' over time.  (Lower is better.) [http://mxr.mozilla.org/mozilla-central/source/mobile/android/base/tests/testCheck.java.in (source)]
 ; Robocop Checkerboarding Real User Benchmark (tcheck2/trobocheck2/rck2)
-: This test is similar to tcheckerboard but designed to stress the browser harder.  It uses a real-world test page, scrolls in all directions, and also zooms the page in various ways.  Reports the '''average percentage of the screen that is "checkerboarded"''' over time (lower is better).  [http://mxr.mozilla.org/mozilla-central/source/mobile/android/base/tests/testCheck2.java.in (source)]
+: "Checkerboard" refers to cases where we can't render new portions of a page as fast as a user scrolls to them, and so they see a blank area, low-resolution rendering, or a checkerboard pattern as they scroll.  This test is designed to stress the browser.  It uses a real-world test page, scrolls in all directions, and also zooms the page in various ways.  Reports the '''average percentage of the screen that is "checkerboarded"''' over time (lower is better).  [http://mxr.mozilla.org/mozilla-central/source/mobile/android/base/tests/testCheck2.java.in (source)]
 ; Robocop Pan Benchmark (robopan/trobopan/rp)
 : This test measures "jank" during scrolling.  It scrolls down a page repeatedly, and records each "missed" frame (any frame drawn more than 1/40 sec after the previous frame).  For each missed frame, it calculates how much it was delayed past 1/40 second.  The test reports the '''sum of the squares of the delays for all missed frames''' (lower is better). [http://mxr.mozilla.org/mozilla-central/source/mobile/android/base/tests/testPan.java.in (source)]