Automatic parameter assessment of logp-based communication models in MPI environments

Abstract Communications in modern interconnection networks become a complex issue to deliver the highest performance to the user. In MPI environments, this complexity leads to different communication protocols for different message sizes. The characterization of these different behaviors is important and useful for software developers and network designers. This paper presents an automatic method to obtain a characterization of the communication behavior of a specific MPI environment using LogP-based models. This procedure automatically detects the message sizes where the communication behavior changes due to the influence of different architectural features and protocols. Thereby, the range of message sizes is split in different intervals, in a transparent way to the user. Then, using LogP-based models, each interval is characterized by its own set of parameters. The procedure is based on the parameterized roundtrip-time low-overhead microbenchmark. The detection of different communication behaviors and the assessment of the parameters of the LogP-based models were implemented in an easy to use statistical environment. Real MPI environments were characterized using our proposal.

[1]  Jesús Labarta,et al.  Deriving analytical models from a limited number of runs , 2003, PARCO.

[2]  Jason Duell,et al.  An evaluation of current high-performance networks , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[3]  W HockneyRoger.  The communication challenge for MPP , 1994 .

[4]  Jack J. Dongarra,et al.  Performance Analysis of MPI Collective Operations , 2005, IPDPS.

[5]  Mary K. Vernon,et al.  Predictive analysis of a wavefront application using LogGP , 1999, PPoPP '99.

[6]  Torsten Hoefler,et al.  LogGP in theory and practice - An in-depth analysis of modern interconnection networks and benchmarking methods for collective operations , 2009, Simul. Model. Pract. Theory.

[7]  Paul D. Gader,et al.  Image algebra techniques for parallel image processing , 1987 .

[8]  Roger W. Hockney,et al.  The Communication Challenge for MPP: Intel Paragon and Meiko CS-2 , 1994, Parallel Computing.

[9]  Leslie G. Valiant,et al.  A bridging model for parallel computation , 1990, CACM.

[10]  Ramesh Subramonian,et al.  LogP: towards a realistic model of parallel computation , 1993, PPOPP '93.

[11]  Henri E. Bal,et al.  Bandwidth-efficient collective communication for clustered wide area systems , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[12]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[13]  José Luis Bosque,et al.  HLogGP: a new parallel computational model for heterogeneous clusters , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..