Deriving analytical models from a limited number of runs

Publisher Summary This chapter describes a methodology to derive a simple characterization of a parallel program and models of its performance on target architecture. The approach starts from an instrumented run of the program to obtain a trace. A simple linear model of the performance of the application as a function of architectural parameters is derived by fitting the results of a bunch of simulations based on the trace. The approach, while being very simple, is able to derive analytic models of execution time as a function of parameters, such as processor speed, network latency, or bandwidth without even looking at the application source. It shows how it is possible to extract from one trace detailed information about the intrinsic characteristics of a program. A relevant feature of this approach is that, a natural interpretation can be given to the different factors in the model. To derive models of other factors, such as number of processors, several traces are obtained and the values obtained with them extrapolated.

[1]  Pankaj Mehra,et al.  Automated modeling of message-passing programs , 1994, Proceedings of International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[2]  Ramesh Subramonian,et al.  LogP: towards a realistic model of parallel computation , 1993, PPOPP '93.

[3]  Mark M. Mathis,et al.  A performance model of non-deterministic particle transport on large-scale systems , 2003, Future Gener. Comput. Syst..

[4]  Jesús Labarta,et al.  Validation of Dimemas Communication Model for MPI Collective Operations , 2000, PVM/MPI.

[5]  Jesús Labarta,et al.  A Framework for Performance Modeling and Prediction , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[6]  Jeffrey K. Hollingsworth,et al.  The dynamic probe class library-an infrastructure for developing instrumentation for performance tools , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[7]  Guang R. Gao,et al.  An executable analytical performance evaluation approach for early performance prediction , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[8]  Jesús Labarta,et al.  Sensitivity of Performance Prediction of Message Passing Programs , 2004, The Journal of Supercomputing.