Dataexchange: High Performance Communications in Distributed Laboratories 1 Communication Substrates for High Performance Applications

Current communications tools and libraries for high performance computing are designed for platforms and applications that exhibit relatively stable computational and communication characteristics. In contrast, the demands of (1) mixed environments in which high performance applications interact with multiple end users, visualizations, storage engines, and I/O engines { termed`distributed laboratories' in our research { and (2) high performance collaborative computing applications in general, exhibit additional complexities in terms of dynamic behaviors. This paper explores the communication requirements of distributed laboratories, and it describes the DataExchange communication infrastructure supporting their high performance interactive and collaborative applications. Communication tools and libraries for high performance distributed computing have evolved substantially during the last few years, from systems enabling distributed parallel computing such as PVMM10], to industrial standards being actively implemented and improved such as MPII9], to recent proposals for infrastructures that can facilitate the construction of nationwide , networked supercomputers. Our work contributes to such research by addressing several speciic issues that arise whenever diverse networked machines are used in research and development settings or even in production environments, by single or multiple end users. The target applications we consider are those in which end users interact with powerful computational tools and with each other across heterogeneous networked machines, termed`distributed laboratories'. The communication demands of such dynamic computational environments share some commonalities with traditional distributed systems as well as with the highly dynamic environment of today's web browsers and CORBA-based distributed object systems, but unfortunately these similar environments do not adequately

[1]  Scott B. Baden,et al.  Software infrastructure for non-uniform scientific computations on parallel processors , 1996, SIAP.

[2]  Raghu V. Hudli,et al.  CORBA fundamentals and programming , 1996 .

[3]  Jack Dongarra,et al.  Pvm 3 user's guide and reference manual , 1993 .

[4]  Karsten Schwan,et al.  From interactive applications to distributed laboratories , 1998, IEEE Concurr..

[5]  Scott Pakin,et al.  High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[6]  Dawson R. Engler,et al.  VCODE: a retargetable, extensible, very fast dynamic code generation system , 1996, PLDI '96.

[7]  Greg Eisenhauer,et al.  The DataExchange Library , 1996 .

[8]  Krithi Ramamritham,et al.  The Design of the Spring Kernel , 1987, RTSS.

[9]  David D. Clark,et al.  Architectural considerations for a new generation of protocols , 1990, SIGCOMM '90.

[10]  Karsten Schwan,et al.  A parallel spectral model for atmospheric transport processes , 1996, Concurr. Pract. Exp..

[11]  Mark D. Wood,et al.  Information servers: a scaleable communication paradigm for wide area networks and the information superhighway , 1996, EW 7.

[12]  James M. Purtilo,et al.  Virtual environment architectures: interoperability through software interconnection technology , 1994, Proceedings of 3rd IEEE Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[13]  Greg Eisenhauer.  Portable Self-Describing Binary Data Streams , 1994 .

[14]  Corporate The MPI Forum,et al.  MPI: a message passing interface , 1993, Supercomputing '93.

[15]  Karsten Schwan,et al.  Falcon-toward interactive parallel programs: the on-line steering of a molecular dynamics application , 1994, Proceedings of 3rd IEEE International Symposium on High Performance Distributed Computing.