Android Benchmarks DevKit2.3.4v2.1

From Texas Instruments Wiki
Jump to: navigation, search

TIBanner.png
Content is no longer maintained and is being kept for reference only!

Introduction

Content is no longer maintained and is being kept for reference only!

This page provides comparison among various TI processors running TI's Android-DevKit. Data published here is for the latest version of released Android-DevKit. Items yet to be measured are marked "TBD" and those that are not applicable to a particular platform are marked "N/A".

Platform Benchmarks

This is a collection of benchmarks comparing mainly CPU speed and other data transfer operations. In below tests, AM3730@1GHz, BeagleXM@1GHz, and AM3517@600MHz.

RowboPerf: ARM

See RowboPERF User Guide for more information about these metrics. The RowboPerf application calls native executables compiled with Android's NDK to perform these tests.

GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Dhrystone 948.27 DMIPS DMIPS 355.72 DMIPS
Whetstone 500 MIPS MIPS 250.0 MIPS
Linpack 33805 Kflops Kflops 27467 Kflops

RowboPERF: 0xBench

See RowboPERF User Guide for more information about these metrics.

Linpack GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Mflops/s 15.67 8.47
Scimark2 GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Composite 17.55 9.80
Fast Fourier Transform 13.06 7.33
Jacobi Successive Over-relaxation 24.97 13.43
Monte Carlo integration 5.42 3.05
Sparse matrix multiply 15.75 8.96
dense LU matrix factorization 28.53 16.22

Boot Time

Numbers shown here measure the time from start of loading the kernel image to appearance of Android's Home Screen. These measurements are done using the default (pre-built) images provided with the DevKit. Please note that the very first time you boot your device, the boot time will be significantly higher.

Time (secs) GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
SD First Boot Time1 65 82
SD Boot Time 31 38

1 First boot time refers to first time the system is booted with a freshly created SD card.

EDMA Test

Need to devise this test.

Memory Bandwidth

Need to devise this test.


Browser Performance

Sunspider

These metrics were collected using the well-known Sunspider performance benchmarks available at http://www2.webkit.org/perf/sunspider-0.9/sunspider.html

Sunspider GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Total 6445.80 ms +/- 1.2% 10553.60ms +/- 1.0%

V8

These metrics were collected using the v8 performance benchmarks available at http://v8.googlecode.com/svn/data/benchmarks/v6/run.html

V8 GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Total 166 122

AcidTests

These metrics were collected using the acid browser tests available at http://acid3.acidtests.org/

Acid3 GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Total 93/100 93/100


File Storage Performance

These tests were performed using the StorageIO application provided in RoboPerf. The application measures the write and read speed of different storage devices using several block sizes. For these tests the file size chosen was 100 MBytes. In order for the application to run the storage device chosen for the test must be mounted in the Android file system and a have read and write access. All the tests were perform on devices with a vfat file system.

MMC/SD Performance

Throughput (MB/s) GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Write, bs=512 2.798 3.256
Write, bs=4096 2.801 3.541
Write, bs=16384 3.599 3.389
Write, bs=65536 3.298 3.762
Write, bs=524288 3.764 3.947
Write, bs=1048576 3.660 3.791
Read, bs=512 6.437 7.261
Read, bs=4096 6.335 6.425
Read, bs=16384 6.800 6.254
Read, bs=65536 6.081 5.942
Read, bs=524288 5.796 5.824
Read, bs=1048576 6.542 6.001

USB Performance

Throughput (MB/s) GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Write, bs=512 2.917 3.291
Write, bs=4096 4.807 4.110
Write, bs=16384 4.862 4.481
Write, bs=65536 4.816 4.501
Write, bs=524288 5.031 4.853
Write, bs=1048576 5.021 4.556
Read, bs=512 8.200 7.775
Read, bs=4096 8.565 8.853
Read, bs=16384 8.084 6.713
Read, bs=65536 8.364 8.001
Read, bs=524288 7.761 7.712
Read, bs=1048576 8.184 7.093


Connectivity Performance

These tests provide throughput comparison across commonly used transports/mediums.

Ethernet

Measures TCP Throughput between Server (running on Host PC) and Client (Android Platform) using different buffer sizes (bs in bytes) Both Server and client uses the Netperf utility. For more information about Netperf, please see Netperf Home page

TCP Throughput GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
bs=16 22.81 Mb/s Mb/s 31.93 Mb/s
bs=1024 22.47 Mb/s Mb/s 31.85 Mb/s
bs=4096 54.92 Mb/s Mb/s 45.90 Mb/s
bs=8192 55.06 Mb/s Mb/s 12.88 Mb/s

Wireless LAN (WiFi)

Measures TCP Throughput between Server (running on Host PC) and Client (Android Platform) using different buffer sizes (bs in bytes) Both Server and client uses the Netperf utility. For more information about Netperf, please see Netperf Home page

Non-Secure

The CPU load shown is the highest number observed while running TOP for the duration of the test.

AM3730 GB 2.3.4 Devkit 2.1
TCP Throughput CPU Util (%)
bs=1024 3.72 Mb/s  % (twl4030-irqchip:%, twl4030-irq:%)
bs=4096 6.77 Mb/s  % (twl4030-irqchip:%, twl4030-irq:%)
bs=8192 9.84 Mb/s  % (twl4030-irqchip:%, twl4030-irq:%)

Secure

These tests were run with a buffer size of 4096 bytes (i.e. bs=4096). The CPU load shown is the highest number observed while running TOP for the duration of the test.

AM3730 GB 2.3.4 Devkit 2.1
TCP Throughput
PSA-PSK Authentication 6.03 Mb/s
WEP 40bit Encryption 6.41 Mb/s
WEP 128bit Encryption 6.40 Mb/s

ADB

Measure Android Debug Bridge (ADB) throughput between Host PC and Android device by pushing and pulling a 20MB file with random content 10 times. TX and RX numbers are from the Host PC point of view, so TX is measured by doing "adb push" on the Host PC.

USB

ADB USB Throughput GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
TX 3753.2 KB/s KB/s 2316.8 KB/s
RX 4244.0 KB/s KB/s 4019.4 KB/s

Ethernet

ADB Ethernet Throughput GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
TX 2770.3 KB/s KB/s 2615.4 KB/s
RX 3155.5 KB/s KB/s 3455.7 KB/s


Graphics Performance

RowboPERF: 0xBench 2D

See RowboPERF User Guide for more information about these metrics.

2D GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Draw Canvas (fps) 57.93 59.60
Draw Circle (fps) 42.63 37.66
Draw Circle2 (fps) 56.29 55.92
Draw Rect (fps) 32.62 37.89
Draw Arc (fps) 47.92 49.23
Draw Image (fps) 55.30 37.70
Draw Text (fps) 49.59 29.77

RowboPERF: 0xBench 3D

See RowboPERF User Guide for more information about these metrics.

3D GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
OpenGL Cube (fps) 57.34 58.84
OpenGL Blending (fps) 60.84 62.38
OpenGL Fog (fps) 60.99 62.47
OpenGL Teapot (fps) 60.54 60.6

Nenamark v1.5

See Nenamark Home Page for more information.

3D GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
FPS 39.60 36.50 26.70

Smartbench 2011

See Smartbench 2011 Android Market Page for more information. Compare the scores at SmartphoneBenchmarks Home Page.

System Productivity + 3D Gaming GB 2.3.4 Devkit 2.1
AM3730 BeagleXM AM3517
Productivity Index 749 412 285
Games Index 1246 787 616

GLBenchmark v2.02

See GLBenchmark Home Page for more information.


GLBenchmark v2.02 results for AM3730

GLBenchmark 2 02.jpg


GLBenchmark v2.02 results for BeagleXM

GLBenchmark 2 02 beaglexm.jpg


GLBenchmark v2.02 results for AM3517

GLBenchmark 2 02 am3517.jpg

MultiMedia Performance

Tests to measure video, audio, image and speech processing performance.

Video Display

To measure Video decode and display performance, the Big Buck Bunny clip was used. The clip has the following video and audio streams
Stream #0.0(und): Video: mpeg4, yuv420p, 352x288 [PAR 48:11 DAR 16:3], 30 tbr, 30 tbn, 30 tbc
Stream #0.1(und): Audio: aac, 48000 Hz, stereo, s16
DDR2 memory was set to 256M in the boot parameters (Default value)

Video decode GB 2.3.4 Devkit 2.1
MPEG4
AM3730 BeagleXM AM3517 DM3730
Min (fps) 27.34 27.23
AVG (fps) 29.34 28.88
Max (fps) 30.99 30.45


Video decode CPU Load GB 2.3.4 Devkit 2.1
MPEG4
AM3730 BeagleXM AM3517 DM3730
Min (%) 11.36 28.57
AVG (%) 22.94 38.78
Max (%) 53.06 56.90


VP8/WebM play back

The performance metrics for VP8/WebM play back on AM37x/AM35x devices in Android is documented below:

  • System Info
  # cat /proc/cpuinfo
    Processor       : ARMv7 Processor rev 2 (v7l)
    BogoMIPS        : 597.64
    Features        : swp half thumb fastmult vfp edsp thumbee neon vfpv3 
    CPU implementer : 0x41
    CPU architecture: 7
    CPU variant     : 0x3
    CPU part        : 0xc08
    CPU revision    : 2
    Hardware        : OMAP3 EVM
    Revision        : 0020
    Serial          : 0000000000000000
  • Clip Info 1
    MetaData(Retrieved from VLC player in Windows)
    File Name: big_buck_bunny_cif_mpeg4_aac.webmvp8.webm
    Resolution:352x288 
    Encoded FPS: 30 
  • FPS info
    # setprop debug.video.showfps 1
    #logcat -s
    D/TIHardwareRenderer( 1122): showfps enabled
    D/TIHardwareRenderer( 1122): 32 Frames, 0.004929 FPS
    D/TIHardwareRenderer( 1122): 64 Frames, 29.981586 FPS
    D/TIHardwareRenderer( 1122): 96 Frames, 29.864601 FPS
    D/TIHardwareRenderer( 1122): 128 Frames, 29.112556 FPS
    D/TIHardwareRenderer( 1122): 160 Frames, 29.685362 FPS
    D/TIHardwareRenderer( 1122): 192 Frames, 29.973873 FPS
    D/TIHardwareRenderer( 1122): 224 Frames, 29.863750 FPS
    D/TIHardwareRenderer( 1122): 256 Frames, 30.159227 FPS
    D/TIHardwareRenderer( 1122): 288 Frames, 25.164413 FPS
  • CPU Utilization
    /system/bin/mediaserver  30%
  • Clip Info 2
    MetaData(Retrieved from VLC player in Windows)
    FileName: sunflower.webm
    Resolution:640x360
    Encoded FPS:10
  • FPS info
    # setprop debug.video.showfps 1
    #logcat -s TIHardwareRenderer
    D/TIHardwareRenderer( 1122): showfps enabled
    D/TIHardwareRenderer( 1122): 5184 Frames, 0.302722 FPS
    D/TIHardwareRenderer( 1122): 5216 Frames, 9.639596 FPS
    D/TIHardwareRenderer( 1122): 5248 Frames, 9.303557 FPS
    D/TIHardwareRenderer( 1122): 5280 Frames, 9.379788 FPS
    D/TIHardwareRenderer( 1122): 5312 Frames, 8.108696 FPS
    D/TIHardwareRenderer( 1122): 5344 Frames, 10.107634 FPS
  • CPU Utilization
    /system/bin/mediaserver 35-40%

Notes:

  • Webm is the container format and vp8 is the video format for the videos.
  • Clips were able to be streamed from the web as well.
  • For Clip 2 the video was streamed from http://devfiles.myopera.com/articles/1891/sunflower-webm.html.
  • The video was played with the android media player.
  • The FPS is hard coded in Meta data of retrieved clip itself.

Power Management

To measure power consumption a Keithley 2000 multimeter with a multiple-channel scan card was used. vdd1 (core) and vdd2 (pheripherals) power was measured under different scenarios.

SUSPEND

Power consumption when the boards goes into SUSPEND mode.

Suspend Power sleep_while_idle=0,enable_off_mode=0 GB 2.3.4 Devkit 2.1 gitorious.org/rowboat
         AM3730
AM3730
vdd1 (mw) 7.70 7.70
vdd2 (mw) 7.53 7.53
vdd1+vdd2 (mw) 15.23 15.23
Suspend Power sleep_while_idle=1,enable_off_mode=0 GB 2.3.4 Devkit 2.1 gitorious.org/rowboat
AM3730            AM3730
vdd1 (mw) 9.17 9.17
vdd2 (mw) 7.58 7.58
vdd1+vdd2 (mw) 16.75 16.75
Suspend Power sleep_while_idle=0,enable_off_mode=1 GB 2.3.4 Devkit 2.1 gitorious.org/rowboat
AM3730            AM3730
vdd1 (mw) 8.06 ~0.0
vdd2 (mw) 4.29 ~0.0
vdd1+vdd2 (mw) 12.34 ~0.0
Suspend Power sleep_while_idle=1,enable_off_mode=1 GB 2.3.4 Devkit 2.1 gitorious.org/rowboat
AM3730            AM3730
vdd1 (mw) 6.18 ~0.0
vdd2 (mw) 4.31 ~0.0
vdd1+vdd2 (mw) 10.49 ~0.0


NOTE: In the latest code available at gitorious.org/rowboat, the suspend power consumption is lowerd to 0.0 when enable_off_mode is set

Video+Audio Decode and Playback

Power Consumption while decoding and playing the Big Buck Bunny clip

Video+Audio ondemand mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 65.12
vdd2 (mw) 154.87
vdd1+vdd2 (mw) 219.99
Video+Audio performance mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 273.10
vdd2 (mw) 156.80
vdd1+vdd2 (mw) 429.90
Video+Audio powersave mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 60.20
vdd2 (mw) 154.92
vdd1+vdd2 (mw) 215.11
Video+Audio userspace(1000000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 279.57
vdd2 (mw) 156.81
vdd1+vdd2 (mw) 436.38
Video+Audio userspace(800000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 216.97
vdd2 (mw) 156.07
vdd1+vdd2 (mw) 373.04
Video+Audio userspace(600000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 152.24
vdd2 (mw) 155.28
vdd1+vdd2 (mw) 307.82
Video+Audio userspace(300000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 61.82
vdd2 (mw) 155.31
vdd1+vdd2 (mw) 217.13

3D Graphics

Power consumption while running the 3D Graphics flying Teapot demo.

3D Graphics ondemand mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 65.17
vdd2 (mw) 154.80
vdd1+vdd2 (mw) 219.98
3D Graphics performance mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 282.29
vdd2 (mw) 156.67
vdd1+vdd2 (mw) 436.03
3D Graphics powersave mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 58.69
vdd2 (mw) 154.86
vdd1+vdd2 (mw) 213.55
3D Graphics userspace(1000000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 277.14
vdd2 (mw) 156.74
vdd1+vdd2 (mw) 433.88
3D Graphics userspace(800000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 216.13
vdd2 (mw) 155.85
vdd1+vdd2 (mw) 371.98
3D Graphics userspace(600000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 149.37
vdd2 (mw) 155.41
vdd1+vdd2 (mw) 304.79
3D Graphics userspace(300000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 60.38
vdd2 (mw) 155.05
vdd1+vdd2 (mw) 215.43

Idle with PARTIAL WakeLock

Power consumption with a CPU_PARTIAL WakeLock held and without running any activity (Home screen) in the foreground.

Idle ondemand mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 67.74
vdd2 (mw) 155.02
vdd1+vdd2 (mw) 222.77
Idle performance mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 280.90
vdd2 (mw) 156.54
vdd1+vdd2 (mw) 437.44
Idle powersave mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 60.83
vdd2 (mw) 154.92
vdd1+vdd2 (mw) 215.74
Idle userspace(1000000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 274.58
vdd2 (mw) 156.39
vdd1+vdd2 (mw) 430.97
Idle userspace(800000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 226.74
vdd2 (mw) 155.99
vdd1+vdd2 (mw) 382.73
Idle userspace(600000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 155.38
vdd2 (mw) 155.37
vdd1+vdd2 (mw) 310.76
Idle userspace(300000) mode GB 2.3.4 Devkit 2.1
AM3730
vdd1 (mw) 58.87
vdd2 (mw) 154.83
vdd1+vdd2 (mw) 213.70

Quadrant Benchmark

Quuadrant is a benchmark developed by aurorasoftworks to asses performance in CPU, Memory, IO, 2D graphics and 3D graphics, for more information refre to http://www.aurorasoftworks.com/

In the results shown below the results for AM3730 and AM3517 are displayed in the column labeled as "your device: xxxx"

AM3730

Am3730 GB2.3.4 Devkit2.1 quad.png

AM3517

Am3517 Gingerbread 2.3 Devkit 1.0 quadrant.png

Versioning


This is Release Gingerbread 2.3.4 Devkit 2.1. The release is available from http://software-dl.ti.com/dsps/dsps_public_sw/sdo_tii/TI_Android_DevKit/TI_Android_GingerBread_2_3_4_DevKit_2_1/index_FDS.html