Heterogeneous Message Passing and a Link to Resource Management

Parallel process communication and system resource management have been seen as two separate entities in parallel and distributed systems. This causes difficulties in the dynamic mapping of newly spawned processes, because the application has little or no information on the availability, the connectivity and the current work-load of the target system. As a consequence, process mappings are often sub-optimal, overloading resources on one system while other processors are idling. We present a software system named "PLUS" that provides • interprocess communication between different message passing models such as MPI, PVM and PARIX, and • access to resource management systems for optimal process mapping and task migration.PLUS is a light-weight, extensible and efficient communication interface. With only four commands, PLUS is almost transparent ot the application code. Our current implementation supports inter-process communication between PVM, MPI and PARIX, but it can be easily extended to other vendor-specific message passing libraries. As PLUS has been designed for wide area networks, much effort has been spent on portability and on optimizing the communication speed across internet and also intranet links.

[1]  William Gropp,et al.  Mpich working note: creating a new mpich device using the channel interface , 1995 .

[2]  W. Richard Stevens,et al.  Unix network programming , 1990, CCRV.

[3]  Alexander Reinefeld,et al.  The MOL project: an open, extensible metacomputer , 1997, Proceedings Sixth Heterogeneous Computing Workshop (HCW'97).

[4]  Owen Thomas,et al.  Europort-1: Porting industrial codes to parallel architectures , 1995, HPCN Europe.

[5]  Miron Livny,et al.  Parallel Processing on Dynamic Resources with CARMI , 1995, JSSPP.

[6]  Alexander Reinefeld,et al.  Communicating across parallel message-passing environments , 1998, J. Syst. Archit..

[7]  Jörn Gehring Dynamic Program Description as a Basis for Runtime Optimization , 1997, Euro-Par.

[8]  Kurt Kremer,et al.  A Distributed Computing Center Software for the Efficient Use of Parallel Computer Systems , 1994, HPCN.

[9]  Roy Friedman,et al.  A framework for protocol composition in Horus , 1995, PODC '95.

[10]  Friedhelm Ramme,et al.  A General Purpose Resource Description Language , 1991, Transputer-Anwender-Treffen.

[11]  Rolf Hempel,et al.  The ANL/GMD Macros (PARMACS) in FORTRAN for Portable Parallel Programming using the Message Passing , 1991 .

[12]  Geoffrey C. Fox,et al.  Cluster Computing Review , 1995 .

[13]  Jack Dongarra,et al.  A User''s Guide to PVM Parallel Virtual Machine , 1991 .

[14]  Ian T. Foster,et al.  Managing Multiple Communication Methods in High-Performance Networked Computing Systems , 1997, J. Parallel Distributed Comput..

[15]  Ian T. Foster,et al.  Overview of the I-Way: Wide-Area Visual Supercomputing , 1996, Int. J. High Perform. Comput. Appl..

[16]  R. Stephenson A and V , 1962, The British journal of ophthalmology.