Software transactional memory (STM) is a promising technique for controlling concurrency in modern multi-processor architectures. STM aims to be more scalable than explicit coarse-grained locking and easier to use than fine-grained locking. However, STM implementations have yet to demonstrate that their runtime overheads are acceptable. To date, empiric evaluations of these implementations have suffered from the lack of realistic benchmarks. Measuring performance of an STM in an overly simplified setting can be at best uninformative and at worst misleading as it may steer researchers to try to optimize irrelevant aspects of their implementations.
This paper presents STMBench7: a candidate benchmark for evaluating STM implementations. The underlying data structure consists of a set of graphs and indexes intended to be suggestive of many complex applications, e.g., CAD/CAM. A collection of operations is supported to model a wide range of workloads and concurrency patterns. Companion locking strategies serve as a baseline for STM performance comparisons. STMBench7 strives for simplicity. Users may choose a workload, number of threads, benchmark length, as well as the possibility of structure modification and the nature of traversals of shared data structures. We illustrate the use of STMBench7 with an evaluation of a well-known software transactional memory implementation.
[1]
Maurice Herlihy,et al.
A flexible framework for implementing software transactional memory
,
2006,
OOPSLA '06.
[2]
Michael F. Spear,et al.
Conflict Detection and Validation Strategies for Software Transactional Memory
,
2006,
DISC.
[3]
Torvald Riegel,et al.
A Lazy Snapshot Algorithm with Eager Validation
,
2006,
DISC.
[4]
Nir Shavit,et al.
Transactional Locking II
,
2006,
DISC.
[5]
Virendra J. Marathe,et al.
Adaptive Software Transactional Memory
,
2005,
DISC.
[6]
Maurice Herlihy,et al.
Software transactional memory for dynamic-sized data structures
,
2003,
PODC '03.
[7]
Nir Shavit,et al.
Software transactional memory
,
1995,
PODC '95.
[8]
Maurice Herlihy,et al.
Transactional Memory: Architectural Support For Lock-free Data Structures
,
1993,
Proceedings of the 20th Annual International Symposium on Computer Architecture.
[9]
David Eisenstat,et al.
Lowering the Overhead of Software Transactional Memory
,
2006
.
[10]
Michael F. Spear,et al.
The rochester software transactional memory runtime
,
2006
.
[11]
David J. DeWitt,et al.
The oo7 Benchmark
,
1993,
SIGMOD Conference.