A framework for benchmark performance analysis

A methodology is proposed for the sensible analysis of computer benchmark results, and illustrated with results from a parallelised particle/mesh (PIC) code, the Genesis LPM1 benchmark. The importance of choosing the correct performance metric is emphasised, and the temporal, simulation, benchmark and hardware performance metrics are deened. The use of speedup and MMop/s as gures of merit are strongly discouraged.