The Samsung Exynos has leapfrogged Qualcomm's Snapdragon according to initial tests of the latest SoCs with a new Android benchmark. The AndEBench-Pro created by the Embedded Microprocessor Benchmark Consortium (EEMBC) revealed that Samsung's Exynos 5 Octa 5420 narrowly beat the Qualcomm Snapdragon 800 MSM8974AA v2 in overall device and 3D graphics performance. A similar Qualcomm part in a Google Nexus 5 system had a higher overall score than the Samsung part, but it ranked lower in the 3D performance category.

AndEBench-Pro is a suite of tests measuring the performance of CPU, GPU, memory and storage subsystems, as well as a platform test that gauges GUI rendering, XML parsing, image manipulation, data compression and cryptography tasks embedded in actual workloads. It was the product of an EEMBC workgroup led by Ronen Zohar, a principal engineer at Intel. Members represented most application processor vendors, including Imagination Technologies and Nvidia.

The suite marks a significant advance over the group's AndEBench v1, a CPU-only test released in 2012 and upgraded last year that uses just one workload. By contrast, the AndEBench-Pro suite uses 18 workloads just for its CPU tests.

Markus Levy, EEMBC's president, said the new benchmark is meant to be useful to both end users and device makers. It also has an implementation in Mandarin, since "a very, very large majority of users are in China," he said. "Unfortunately, Android benchmarks in the market have been developed by entities which might be naive about how to develop a structurally sound benchmark, and furthermore their motivation is unclear. Given the expertise that has gone into developing AndEBench-Pro and the transparent availability of source code, EEMBC is convinced the benchmark is structurally sound."

More than 5,600 users submitted scores using the original AndEBench on more than 1,000 devices. The benchmark remains available on the EEMBC website, but those scores are not directly comparable with tests using the AndEBench-Pro.

AndEBench-Pro can be downloaded for free from Google Play and the Amazon Appstore for Android. The app is free for personal, non-commercial uses, but an EEMBC license is required for any commercial uses.

Professional device reviewers should contact the EEMBC directly to obtain a version of AndEBench-Pro that will enable them to change benchmarking parameters and gain undisclosed scoring information to aid in their device analysis. The EEMBC plans future versions of the benchmarks, and it encourages anyone interested to join the consortium and working group developing them.

The EEMBC lays out in a technical document details of the test suit. For example, it notes the CPU test uses Base and Peak CoreMark-HPC Scores.

For the Base mode, the EEMBC built workloads using the default compiler included with the official Google Native Development Kit. In Peak mode, the workloads reflect the best performance that can be expected from the CPU, using compilers and compiler settings optimised for each CPU.

The 3D test generates a one-minute game sequence as an exercise routine and then measures the number of frames generated per second. It performs all rendering off screen to a 1,080-progressive pixel display. After the rendering, the frames are scaled and displayed on the actual device's screen. Higher-performing GPUs will be able to generate more frames and thus achieve higher scores, according to the EEBMC document.

The AndEBench-Pro memory bandwidth test uses several serial access patterns based on the Stream benchmark to test memory read and write performance. The test is run once in single-threaded execution and once in multi-threaded mode. The two results are aggregated using a geometric mean and reported in MB/s.

The memory latency test initialises a 64M block of memory as a linked list with the elements of the list arranged in random order inside the allocated block. The test measures the time it takes to traverse N nodes in the linked list. Each step of the traversal requires fetching the next node pointer from memory, thus testing the memory subsystem's latency. The score is reported in number of nodes accessed per second, so that higher scores reflect lower memory latency.

By: DocMemory
Copyright © 2023 CST, Inc. All Rights Reserved