Evaluating OpenMP Performance Analysis Tools with the APART Test Suite

We outline the design of ATS, the APART Test Suite, for evaluating (automatic) performance analysis tools with respect to their correctness and effectiveness in detecting actual performance problems, with focus on the ATS test programs related to OpenMP. We report on results from applying two OpenMP performance analysis tools to the test cases generated from ATS.

[1]  Wolfgang E. Nagel,et al.  Performance Optimization for Large Scale Computing: The Scalable VAMPIR Approach , 2001, International Conference on Computational Science.

[2]  Bernd Mohr,et al.  Automatic performance analysis of hybrid MPI/OpenMP applications , 2003, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings..

[3]  D J Evans,et al.  Parallel processing , 1986 .

[4]  A. Morales.  Automatic performance analysis of parallel programs , 2000 .

[5]  Angewandte Mathematik,et al.  Knowledge Specification for Automatic Performance Analysis APART Technical Report Revised Version , 2001 .

[6]  Bernd Mohr,et al.  Initial design of a test suite for automatic performance analysis tools , 2003, Eighth International Workshop on High-Level Parallel Programming Models and Supportive Environments, 2003. Proceedings..

[7]  Hong Linh Truong,et al.  SCALEA: A Performance Analysis Tool for Distributed and Parallel Programs , 2002, Euro-Par.

[8]  Radu Prodan,et al.  ZENTURIO: an experiment management system for cluster and Grid computing , 2002, Proceedings. IEEE International Conference on Cluster Computing.

[9]  Bernd Mohr,et al.  Design and Prototype of a Performance Tool Interface for OpenMP , 2002, The Journal of Supercomputing.

[10]  Hong Linh Truong,et al.  On Using SCALEA for Performance Analysis of Distributed and Parallel Programs , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[11]  Barton P. Miller,et al.  The Paradyn Parallel Performance Measurement Tool , 1995, Computer.

[12]  Felix Wolf,et al.  Automatic performance analysis on parallel computers with SMP nodes , 2003 .

[13]  Bernd Mohr,et al.  A Tool Framework for Static and Dynamic Analysis of Object-Oriented Software with Templates , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[14]  Graham D. Riley,et al.  Formalizing OpenMP Performance Properties with ASL , 2000, ISHPC.