Interconnection Network Simulation Using Traces of MPI Applications

This paper addresses the utilization of traces taken from MPI applications to do simulation-based performance studies of parallel computing systems. Different mechanisms to capture traces are discussed, pointing out important limitations of some of them. One of these limitations is the invisibility of message interchanges in collective operations, which is circumvented modifying a trace-capturing library. During a simulation, trace records must be simulated in causal order, to fully comply with application semantics. Alternatives to follow this order, and the risks of not following it, are presented and discussed. The techniques introduced in this paper have been implemented in an in-house developed simulation environment, which is used in two example studies to show its usefulness: an evaluation of alternatives for interconnection network design, and a performance prediction study in which traces from one machine are used to estimate the execution times of applications running in a different machine.

[1]  William J. Dally,et al.  Principles and Practices of Interconnection Networks , 2004 .

[2]  Javier Navaridas,et al.  Concepts and components of full-system simulation of distributed memory parallel computers , 2007, HPDC '07.

[3]  Javier Navaridas,et al.  Mixed-radix Twisted Torus Interconnection Networks , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[4]  Jack J. Dongarra,et al.  Review of Performance Analysis Tools for MPI Parallel Programs , 2001, PVM/MPI.

[5]  Valentin Puente,et al.  SICOSYS: an integrated framework for studying interconnection network performance in multiprocessor systems , 2002, Proceedings 10th Euromicro Workshop on Parallel, Distributed and Network-based Processing.

[6]  Message Passing Interface Forum.  MPI: A message - passing interface standard , 1994 .

[7]  Javier Navaridas,et al.  On synthesizing workloads emulating MPI applications , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[8]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[9]  José Miguel-Alonso,et al.  TrGen: a traffic generation system for interconnection network simulators , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[10]  Message P Forum,et al.  MPI: A Message-Passing Interface Standard , 1994 .

[11]  José Miguel-Alonso,et al.  INSEE: An Interconnection Network Simulation and Evaluation Environment , 2005, Euro-Par.

[12]  William Gropp,et al.  Toward Scalable Performance Visualization with Jumpshot , 1999, Int. J. High Perform. Comput. Appl..

[13]  Javier Navaridas,et al.  Realistic Evaluation of Interconnection Network Performance at High Loads , 2007 .

[14]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[15]  Ron Brightwell.  A Comparison of Three MPI Implementations for Red Storm , 2005, PVM/MPI.

[16]  Daniel A. Menascé,et al.  A Methodology for Performance Evaluation of Parallel Applications on Multiprocessors , 1992, J. Parallel Distributed Comput..

[17]  Javier Navaridas,et al.  Evaluation of Interconnection Networks Using Full-System Simulators: Lessons Learned , 2007, 40th Annual Simulation Symposium (ANSS'07).

[18]  Philip Heidelberger,et al.  Optimization of MPI collective communication on BlueGene/L systems , 2005, ICS '05.

[19]  Allen D. Malony,et al.  Trace-Based Parallel Performance Overhead Compensation , 2005, HPCC.

[20]  Cruz Izu,et al.  The Adaptive Bubble Router , 2001, J. Parallel Distributed Comput..

[21]  Ewing Lusk,et al.  Performance analysis of MPI programs , 1994 .

[22]  Cruz Izu,et al.  A case study of trace-driven simulation for analyzing interconnection networks: cc-NUMAs with ILP processors , 2000, Proceedings 8th Euromicro Workshop on Parallel and Distributed Processing.

[23]  Laxmikant V. Kalé,et al.  Scaling an optimistic parallel simulation of large-scale interconnection networks , 2005, Proceedings of the Winter Simulation Conference, 2005..

[24]  Hong Shen,et al.  Privacy Preserving Set Intersection Protocol Secure against Malicious Behaviors , 2007 .

[25]  Fredrik Larsson,et al.  Simics: A Full System Simulation Platform , 2002, Computer.