论文信息 - Irreproducible benchmarks might be sometimes helpful

Irreproducible benchmarks might be sometimes helpful

Historically, benchmarks have been used for commercial purposes. A customer develops or selects a benchmark that generates a load that is considered to be typical for her/his applications. The benchmark is executed on various machines to find the most appropriate vendor and machine. In OS research, we use benchmarks for completely different purposes that can be subsumed under the headline “understanding a complex system”:

[1] Brian D. Noble,et al. Continuous Monitoring and Performance Specification , 1998 .

[2] Lance M. Berc,et al. Continuous profiling: where have all the cycles gone? , 1997, TOCS.

[3] Jochen Liedtke. A short note on cheap fine-grained time measurement , 1996, OPSR.

[4] Alan Jay Smith,et al. Evaluating Associativity in CPU Caches , 1989, IEEE Trans. Computers.

[5] Zheng Wang,et al. System support for automatic profiling and optimization , 1997, SOSP.