SPECjvm2008 is a new multi-threaded Java benchmark from SPEC and it replaces the aging single threaded SPECjvm98. The benchmark is intended to address several shortcomings of the earlier workloads in SPECjvm98 by replacing DB, Chart, Javac; removing Jess, adding XML, Serial, Crypto, in-cache and out-cache versions of Scimark workloads. It is targeted for measuring the performance of both JVM and hardware systems. In this paper we describe the salient features of SPECjvm2008. We then take a first look at the performance of this benchmark on current multi-core platforms and study the sensitivity of the components of the workload to basic architectural aspects such as the number of processor cores, the processor frequency, cache and memory sub-system. We focus our study on understanding how the behavior of this workload compares with other standard Java benchmarks, SPECjbb2005 and SPECjAppServer2004, both in components of the software stack that the workloads touch as well as in the aspects of the platform that they exercise and draw conclusion on the usefulness of SPECjvm2008 for practitioners of JVM and hardware performance analysis.
[1]
Rudolf Eigenmann,et al.
Performance evaluation and benchmarking with realistic applications
,
2001
.
[2]
Urs Hölzle,et al.
The allocation behavior of the SPECjvm98 Java benchmarks
,
2001
.
[3]
Ramesh Radhakrishnan,et al.
Microarchitectural techniques to enable efficient java execution
,
2000
.
[4]
Hsien-Hsin S. Lee,et al.
Hierarchical Means: Single Number Benchmarking with Workload Cluster Analysis
,
2007,
2007 IEEE 10th International Symposium on Workload Characterization.
[5]
Anand Sivasubramaniam,et al.
Characterizing operating system activity in SPECjvm98 Benchmarks
,
2001
.