Scientific benchmark characterizations

A number of scientific and engineering benchmarks have emerged during the 1980s. Each of these benchmarks has a different origin, methodology and interpretation. This paper is a survey of the most common scientific benchmarks and includes a comparison of them based on their instruction mixes as measured by the CRAY X-MP hardware performance monitor (hpm). We discuss the relevance of these benchmarks to parallel computing as well as comparing their instruction mixes against an academic supercomputer workload.

[1]  Jack J. Dongarra,et al.  Performance of various computers using standard linear equations software in a FORTRAN environment , 1988, CARN.

[2]  B. R. Wienke.  ESN: One-dimensional Sn transport module for electrons , 1982 .

[3]  Jack J. Dongarra,et al.  Performance of various computers using standard linear equations software in a Fortran environment , 1987, SGNM.

[4]  R. Morse,et al.  NUMERICAL SIMULATION OF THE WEIBEL INSTABILITY IN ONE AND TWO DIMENSIONS. , 1971 .

[5]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[6]  V. Klema.  LINPACK user's guide , 1980 .

[7]  Alan Jay Smith,et al.  Machine Characterization Based on an Abstract High-Level Language Machine , 1989, IEEE Trans. Computers.

[8]  J. H. Griffin,et al.  Los Alamos National Laboratory computer benchmarking, 1983 , 1984 .

[9]  E. O. Brigham,et al.  The Fast Fourier Transform , 1967, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  George Cybenko,et al.  Supercomputer workload decomposition and analysis , 1991, ICS '91.

[11]  David J. Kuck,et al.  A Supercomputing Performance Evaluation Plan , 1988, ICS.

[12]  Geoffrey C. Fox,et al.  The Perfect Club Benchmarks: Effective Performance Evaluation of Supercomputers , 1989, Int. J. High Perform. Comput. Appl..

[13]  F. H. Mcmahon,et al.  The Livermore Fortran Kernels: A Computer Test of the Numerical Performance Range , 1986 .

[14]  Jack Dongarra,et al.  Computer benchmarking: paths and pitfalls , 1987 .

[15]  David H. Bailey,et al.  The NAS kernel benchmark program , 1985 .

[16]  James E. Smith,et al.  Characterizing computer performance with a single number , 1988, CACM.

[17]  J. L. Martin,et al.  Computer benchmarking: Paths and pitfalls: The most popular way of rating computer performance can confuse as well as inform; avoid misunderstanding by asking just what the benchmark is measuring , 1987, IEEE Spectrum.

[18]  Jack Dongarra,et al.  Linear algebra on high performance computers , 1986 .

[19]  George Cybenko,et al.  Supercomputer performance evaluation and the Perfect Benchmarks , 1990, ICS '90.

[20]  Reinhold Weicker,et al.  An overview of common benchmarks , 1990, Computer.