Overview of the SPEC Benchmarks

" The reputation of current benchmarketing claims regarding system performance is on par with the promises made by politicians during elections. " in cooperation with E. E. Times. SPEC is a nonprofit consortium of 22 major computer vendors whose common goals are " to provide the industry with a realistic yardstick to measure the performance of advanced computer systems " and to educate consumers about the performance of vendors' products. SPEC creates, maintains, distributes, and endorses a standardized set of application-oriented programs to be used as benchmarks.

[1]  George Cybenko,et al.  Scientific benchmark characterizations , 1991, Parallel Comput..

[2]  Reinhold Weicker,et al.  A detailed look at some popular benchmarks , 1991, Parallel Comput..

[3]  Rafael H. Saavedra-barrera,et al.  The spec and perfect club benchmarks: promises and limitations , 1990 .

[4]  James E. Smith,et al.  Characterizing computer performance with a single number , 1988, CACM.

[5]  M.J. Phillip Performance issues for the 88110 RISC microprocessor , 1992, Digest of Papers COMPCON Spring 1992.

[6]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[7]  K.M. Dixit New CPU benchmark suites from SPEC , 1992, Digest of Papers COMPCON Spring 1992.

[8]  Jack J. Dongarra Performance of various computers using standard linear equations software in a Fortran environment , 1983, CARN.

[9]  Kaivalya M. Dixit,et al.  The SPEC benchmarks , 1991, Parallel Comput..

[10]  Todd M. Austin,et al.  Dynamic dependency analysis of ordinary programs , 1992, ISCA '92.

[11]  Philip J. Fleming,et al.  How not to lie with statistics: the correct way to summarize benchmark results , 1986, CACM.

[12]  Brian A. Wichmann,et al.  A Synthetic Benchmark , 1976, Comput. J..

[13]  David H. Bailey,et al.  The NAS kernel benchmark program , 1985 .

[14]  John Paul Shen,et al.  Instruction level profiling and evaluation of the IBM RS/6000 , 1991, [1991] Proceedings. The 18th Annual International Symposium on Computer Architecture.

[15]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.