QA/Fennec/33/RC/1/AppThwack Results: Difference between revisions

< QA‎ | Fennec‎ | 33‎ | RC/1
(Created page with "== QA Assignment == <onlyinclude> {| class="wikitable" width=100% ! Assigned ! Build ! Completed ! Results |- | Ioana Chiorean | fennec-33.0.multi.android-arm-armv7.ap...")
 
 
(2 intermediate revisions by the same user not shown)
Line 8: Line 8:
  ! Results
  ! Results
  |-
  |-
  | Ioana Chiorean
  | Catalin Suciu
  | fennec-33.0.multi.android-arm-armv7.apk
  | fennec-33.0.multi.android-arm-armv7.apk
  | October , 2014
  | October 9th, 2014
  | '''PASS'''
  | '''PASS'''
  |-
  |-
Line 16: Line 16:
  | fennec-33.0.multi.android-arm-i386.apk
  | fennec-33.0.multi.android-arm-i386.apk
  | October th, 2014
  | October th, 2014
  | ''' '''
  | '''not run'''
  |}
  |}
</onlyinclude>
</onlyinclude>
Line 22: Line 22:
== Results ==
== Results ==
* ARMv6 / '''ARMv7'''
* ARMv6 / '''ARMv7'''
** public results:
** public results: https://appthwack.com/public/7772b70494269beed122d27a4
=== Issues ===
=== Issues ===
==== Failures ====
==== Failures ====
* java.lang.ClassNotFoundException: org.mozilla.firefox.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox-1.apk] - 7 occurrences
** Motorola Admiral (2.3.5): Exerciser Monkey
** Motorola Photon 4G (2.3.5): Exerciser Monkey
** LG Optimus Elite (2.3.7): Exerciser Monkey
** HTC Evo 4G (2.3.5): Exerciser Monkey
** HTC G2 (2.3.4): Exerciser Monkey
** Samsung Galaxy S (CM) (CM7): Exerciser Monkey
** Samsung Conquer 4G (2.3.6): Exerciser Monkey
* java.lang.ClassNotFoundException: org.mozilla.firefox.App - 9 occurrences
** Sony Xperia Miro (4.0.4): Exerciser Monkey
** Sony Xperia E (4.1.1): Exerciser Monkey
** Samsung Galaxy Rush (4.1.2): Exerciser Monkey
** HTC Droid DNA (4.1.1): Exerciser Monkey
** Sony Xperia Arc (4.0.4): Exerciser Monkey
** Samsung Galaxy SIII Mini (4.1.2): Exerciser Monkey
** Samsung Nexus S 4G (4.1.2): Exerciser Monkey
** HTC One X (4.0.3): Exerciser Monkey
** Sony Xperia Arc S (4.0.4): Exerciser Monkey
* java.lang.NullPointerException - 1 occurrence
** HTC One X+ (4.1.1): Exerciser Monkey
* java.lang.IllegalStateException: Fragment PinSiteDialog{40681798} not attached to Activity - 1 occurrence
** Huawei Mercury (2.3.5): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox-1.apk - 1 occurrence
** Asus EeePad TF300T (4.2.1): Exerciser Monkey
==== PERFORMANCE ====
==== PERFORMANCE ====
* CPU Avg 18.97%
** Min 3.98% Samsung Galaxy S (CM) (2.3.4)
** Max 33.32% Samsung Galaxy S (CM) (2.3.4)
* Memory Avg 77.49MB
** Min 12.93MB Samsung Galaxy S (CM) (2.3.4)
** Max 150.08MB Samsung Galaxy S (CM) (2.3.4)
* Threads Avg 51.65
** Min 15.52 Samsung Galaxy S (CM) (2.3.4)
** Max 61.13 Samsung Galaxy S (CM) (2.3.4)
* Frame Draw Time Avg 1.37ms
** Min 0.0ms Samsung Galaxy S (CM) (2.3.4)
** Max 11.65ms Samsung Galaxy S (CM) (2.3.4)

Latest revision as of 14:07, 9 October 2014

QA Assignment

Assigned Build Completed Results
Catalin Suciu fennec-33.0.multi.android-arm-armv7.apk October 9th, 2014 PASS
Ioana Chiorean fennec-33.0.multi.android-arm-i386.apk October th, 2014 not run


Results

Issues

Failures

  • java.lang.ClassNotFoundException: org.mozilla.firefox.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox-1.apk] - 7 occurrences
    • Motorola Admiral (2.3.5): Exerciser Monkey
    • Motorola Photon 4G (2.3.5): Exerciser Monkey
    • LG Optimus Elite (2.3.7): Exerciser Monkey
    • HTC Evo 4G (2.3.5): Exerciser Monkey
    • HTC G2 (2.3.4): Exerciser Monkey
    • Samsung Galaxy S (CM) (CM7): Exerciser Monkey
    • Samsung Conquer 4G (2.3.6): Exerciser Monkey
  • java.lang.ClassNotFoundException: org.mozilla.firefox.App - 9 occurrences
    • Sony Xperia Miro (4.0.4): Exerciser Monkey
    • Sony Xperia E (4.1.1): Exerciser Monkey
    • Samsung Galaxy Rush (4.1.2): Exerciser Monkey
    • HTC Droid DNA (4.1.1): Exerciser Monkey
    • Sony Xperia Arc (4.0.4): Exerciser Monkey
    • Samsung Galaxy SIII Mini (4.1.2): Exerciser Monkey
    • Samsung Nexus S 4G (4.1.2): Exerciser Monkey
    • HTC One X (4.0.3): Exerciser Monkey
    • Sony Xperia Arc S (4.0.4): Exerciser Monkey
  • java.lang.NullPointerException - 1 occurrence
    • HTC One X+ (4.1.1): Exerciser Monkey
  • java.lang.IllegalStateException: Fragment PinSiteDialog{40681798} not attached to Activity - 1 occurrence
    • Huawei Mercury (2.3.5): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox-1.apk - 1 occurrence
    • Asus EeePad TF300T (4.2.1): Exerciser Monkey

PERFORMANCE

  • CPU Avg 18.97%
    • Min 3.98% Samsung Galaxy S (CM) (2.3.4)
    • Max 33.32% Samsung Galaxy S (CM) (2.3.4)
  • Memory Avg 77.49MB
    • Min 12.93MB Samsung Galaxy S (CM) (2.3.4)
    • Max 150.08MB Samsung Galaxy S (CM) (2.3.4)
  • Threads Avg 51.65
    • Min 15.52 Samsung Galaxy S (CM) (2.3.4)
    • Max 61.13 Samsung Galaxy S (CM) (2.3.4)
  • Frame Draw Time Avg 1.37ms
    • Min 0.0ms Samsung Galaxy S (CM) (2.3.4)
    • Max 11.65ms Samsung Galaxy S (CM) (2.3.4)