QA/Fennec/38/Aurora/SignOff/AppThwack Results: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 38‎ | Aurora/SignOff
Jump to navigation Jump to search
(adding testplans)
 
(adding my details)
Line 17: Line 17:
== Results ==
== Results ==
* ARMv6 / '''ARMv7'''
* ARMv6 / '''ARMv7'''
** public results:
** public results: https://appthwack.com/public/b5c107d11d07a861a498c5dc0
=== Issues ===
=== Issues ===
* java.lang.ClassNotFoundException: org.mozilla.fennec_aurora.App - 8 occurrences
** Kyocera Event (4.0.4): Exerciser Monkey
** Kyocera Rise (4.0.4): Exerciser Monkey
** HTC Desire S (4.0.4): Exerciser Monkey
** Samsung Galaxy Tab 3 7.0 (4.1.2): Exerciser Monkey
** Sony Xperia Arc S (4.0.4): Exerciser Monkey
** Sony Live with Walkman (4.0.4): Exerciser Monkey
** Sony Xperia Tipo (4.0.4): Exerciser Monkey
** Sony Xperia Active (4.0.4): Exerciser Monkey
* java.lang.ClassNotFoundException: org.mozilla.fennec_aurora.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.fennec_aurora-1.apk] - 1 occurrence
** Dell Streak 7 (3.2): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.fennec_aurora.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1.apk', zip file '/data/app/org.mozilla.fennec_aurora-1.apk'],nativeLibraryDirectories=[/data/app-lib/com.appthwack.gltest-1, /data/app-lib/org.mozilla.fennec_aurora-1, /vendor/lib, /system/lib]] - 1 occurrence
** Motorola Droid RAZR M (4.4.2): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.fennec_aurora.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.fennec_aurora-1.apk - 1 occurrence
** HTC One SV (4.2.2): Exerciser Monkey
* Application died after launching - 1 occurrence
** Sony Xperia Ion (4.0.4): Launch and Explore
=== PERFORMANCE ===
=== PERFORMANCE ===
* CPU Avg 19.76%
** Min 5.47% HTC One V (4.0.3)
** Max 64.27% HTC One V (4.0.3)
* Memory Avg 92.73MB
** Min 61.30MB HTC One V (4.0.3)
** Max 193.48MB HTC One V (4.0.3)
* Threads Avg 61.07
** Min 38.31 HTC One V (4.0.3)
** Max 74.52 HTC One V (4.0.3)
* Frame Draw Time Avg 2.28ms
** Min 0.0ms HTC One V (4.0.3)
** Max 24.01ms HTC One V (4.0.3)

Revision as of 13:47, 27 February 2015

QA Assignment

Assigned Build Completed Results
fennec-38.0a2.multi.android-arm-armv7.apk


Results

Issues

  • java.lang.ClassNotFoundException: org.mozilla.fennec_aurora.App - 8 occurrences
    • Kyocera Event (4.0.4): Exerciser Monkey
    • Kyocera Rise (4.0.4): Exerciser Monkey
    • HTC Desire S (4.0.4): Exerciser Monkey
    • Samsung Galaxy Tab 3 7.0 (4.1.2): Exerciser Monkey
    • Sony Xperia Arc S (4.0.4): Exerciser Monkey
    • Sony Live with Walkman (4.0.4): Exerciser Monkey
    • Sony Xperia Tipo (4.0.4): Exerciser Monkey
    • Sony Xperia Active (4.0.4): Exerciser Monkey
  • java.lang.ClassNotFoundException: org.mozilla.fennec_aurora.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.fennec_aurora-1.apk] - 1 occurrence
    • Dell Streak 7 (3.2): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.fennec_aurora.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1.apk', zip file '/data/app/org.mozilla.fennec_aurora-1.apk'],nativeLibraryDirectories=[/data/app-lib/com.appthwack.gltest-1, /data/app-lib/org.mozilla.fennec_aurora-1, /vendor/lib, /system/lib]] - 1 occurrence
    • Motorola Droid RAZR M (4.4.2): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.fennec_aurora.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.fennec_aurora-1.apk - 1 occurrence
    • HTC One SV (4.2.2): Exerciser Monkey
  • Application died after launching - 1 occurrence
    • Sony Xperia Ion (4.0.4): Launch and Explore

PERFORMANCE

  • CPU Avg 19.76%
    • Min 5.47% HTC One V (4.0.3)
    • Max 64.27% HTC One V (4.0.3)
  • Memory Avg 92.73MB
    • Min 61.30MB HTC One V (4.0.3)
    • Max 193.48MB HTC One V (4.0.3)
  • Threads Avg 61.07
    • Min 38.31 HTC One V (4.0.3)
    • Max 74.52 HTC One V (4.0.3)
  • Frame Draw Time Avg 2.28ms
    • Min 0.0ms HTC One V (4.0.3)
    • Max 24.01ms HTC One V (4.0.3)