Heterogeneity Issues and Supports in MPI Implementations: An Overview

Diverse computers interconnected via mixed network equipments are commonly available parallel architecture now, and achieve good performance/price ratio. As an important parallel communication tool, MPI system is a natural choice to support heterogeneous computing platform. The paper classifies the definition of heterogeneity into three categories, and presents the issues of them in detail respectively. Then overviews the heterogeneous support in eight MPI implementations. Comparison and analysis results are given from several aspects at last.

[1]  Alexey Lastovetsky,et al.  AN OVERVIEW OF HETEROGENEOUS HIGH PERFORMANCE AND GRID COMPUTING , 2004 .

[2]  William L. George,et al.  The Interoperable Message Passing Interface (IMPI) Extensions to LAM/MPI , 2001 .

[3]  Ronald Minnich,et al.  A Network-Failure-Tolerant Message-Passing System for Terascale Clusters , 2002, ICS '02.

[4]  George Bosilca,et al.  Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation , 2004, PVM/MPI.

[5]  Greg Burns,et al.  LAM: An Open Cluster Environment for MPI , 2002 .

[6]  Alexey L. Lastovetsky,et al.  HeteroMPI: Towards a message-passing library for heterogeneous networks of computers , 2006, J. Parallel Distributed Comput..

[7]  Carl Kesselman,et al.  Generalized communicators in the Message Passing Interface , 1996, Proceedings. Second MPI Developer's Conference.

[8]  George Bosilca,et al.  Open MPI: A High-Performance, Heterogeneous MPI , 2006, 2006 IEEE International Conference on Cluster Computing.

[9]  Liria Matsumoto Sato,et al.  HyMPI - A MPI Implementation for Heterogeneous High Performance Systems , 2006, GPC.

[10]  Jack J. Dongarra,et al.  Heterogeneous MPI Application Interoperation and Process Management under PVMPI , 1997, PVM/MPI.

[11]  Mario Trams.  Feasibility of PACX–MPI for use in a Cluster–of–Clusters Environment , 2003 .

[12]  Ian T. Foster,et al.  MPICH-G2: A Grid-enabled implementation of the Message Passing Interface , 2002, J. Parallel Distributed Comput..

[13]  J. Dongarra,et al.  Trends in high performance computing: a historical overview and examination of future developments , 2006, IEEE Circuits and Devices Magazine.

[14]  William L. George,et al.  IMPI: Making MPI Interoperable , 2000, Journal of research of the National Institute of Standards and Technology.

[15]  George K. Thiruvathukal,et al.  Wide-Area Implementation of the Message Passing Interface , 1998, Parallel Comput..

[16]  Alexey L. Lastovetsky,et al.  Building the communication performance model of heterogeneous clusters based on a switched network , 2007, 2007 IEEE International Conference on Cluster Computing.

[17]  William Gropp,et al.  Mpi---the complete reference: volume 1 , 1998 .

[18]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .