Campus-Wide Computing : Early Results Using Legion At the University of Virginia

The Legion project at the University of Virginia is an architecture for designing and building system services that provide the illusion of a single virtual machine to users, a virtual machine that provides both improved response time via parallel execution and greater throughput. Legion targets workstation clusters and larger wide area assem blies of workstations, supercomputers, and parallel super computers. The authors have built a working Legion pro totype called the Campus-Wide Virtual Computer (CWVC). The CWVC extends an existing object-oriented parallel processing system by aggressively incorporating lessons learned in the last 20 years of heterogeneous distributed computing. In this paper, the authors describe the challenges that they overcame to realize a working CWVC and characterize the performance of a production biochemistry application.

[1]  William Gropp,et al.  Skjellum using mpi: portable parallel programming with the message-passing interface , 1994 .

[2]  Brent Kingsbury,et al.  Network Queueing System , 1986 .

[3]  Adam J. Ferrari,et al.  The NAS Parallel Benchmark Kernels in MPL , 1995 .

[4]  Jack C. Wileden,et al.  Foundations for the Arcadia environment architecture , 1989, SDE 3.

[5]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .

[6]  Richard F. Freund,et al.  Superconcurrency: A Form of Distributed Heterogeneous Supercomputing , 1991 .

[7]  Gregory V. Wilson,et al.  Parallel Programming Using C , 1996 .

[8]  Paul T. Tymann,et al.  The virtual computing environment , 1994, Proceedings of 3rd IEEE International Symposium on High Performance Distributed Computing.

[9]  Andrew S. Grimshaw,et al.  Legion-a view from 50,000 feet , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[10]  Samuel T. Chanson,et al.  Distributed, object-based programming systems , 1991, CSUR.

[11]  Brian N. Bershad,et al.  A Remote Procedure Call Facility for Interconnecting Heterogeneous Computer Systems , 1987, IEEE Transactions on Software Engineering.

[12]  Dana S. Richards,et al.  A platform for biological sequence comparison on parallel computers , 1991, Comput. Appl. Biosci..

[13]  Barbara M. Chapman,et al.  Programming in Vienna Fortran , 1992, Sci. Program..

[14]  Joel H. Saltz,et al.  Parallel Programming Using C++ , 1996 .

[15]  Marvin Theimer,et al.  Heterogeneous process migration by recompilation , 1991, [1991] Proceedings. 11th International Conference on Distributed Computing Systems.

[16]  E. A. West,et al.  No pain and gain! - experiences with Mentat on a biological application , 1993, Concurr. Pract. Exp..

[17]  A. S. Grimshaw Meta-Systems: An Approach Combining Parallel Processing and Heterogeneous Distributed Computing Systems , 1992, Proceedings. Workshop on Heterogeneous Processing.

[18]  Henri E. Bal,et al.  Programming languages for distributed computing systems , 1989, CSUR.

[19]  Message P Forum,et al.  MPI: A Message-Passing Interface Standard , 1994 .

[20]  Abraham Silberschatz,et al.  Distributed file systems: concepts and examples , 1990, CSUR.

[21]  Sape Mullender,et al.  Distributed systems , 1989 .

[22]  Francine Berman,et al.  Program Speedup in a Heterogeneous Computing Network , 1994, J. Parallel Distributed Comput..

[23]  L Nelson Michael,et al.  A Comparison of Queueing, Cluster and Distributed Computing Systems , 1994 .

[24]  A. Fleischmann Distributed Systems , 1994, Springer Berlin Heidelberg.

[25]  Andrew S. Grimshaw,et al.  Metasystems: An Approach Combining Parallel Processing and Heterogeneous Distributed Computing Systems , 1994, J. Parallel Distributed Comput..

[26]  Jr. Harold W. Lockhart OSF DCE: guide to developing distributed applications , 1994 .

[27]  Nicholas Carriero,et al.  Linda in context , 1989, CACM.

[28]  James C. French,et al.  Legion: The Next Logical Step Toward a Nationwide Virtual Computer , 1994 .

[29]  Nicholas Carriero,et al.  Linda in Heterogeneous Computing Environments , 1992, Proceedings. Workshop on Heterogeneous Processing.

[30]  James H. Patterson,et al.  Portable Programs for Parallel Processors , 1987 .

[31]  Larry Carter,et al.  Distrbution and Abstract Types in Emerald , 1987, IEEE Transactions on Software Engineering.

[32]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[33]  M S Waterman,et al.  Identification of common molecular subsequences. , 1981, Journal of molecular biology.

[34]  Michael J. Quinn,et al.  Data-parallel programming on a network of heterogeneous workstations , 1992, Proceedings of the First International Symposium on High-Performance Distributed Computing. (HPDC-1).

[35]  Ron Ben-Natan,et al.  CORBA - a guide to common object request broker architecture , 1995, J. Ranade Workstation series.

[36]  Anthony P. Reeves,et al.  High performance computing on a cluster of workstations , 1992, Proceedings of the First International Symposium on High-Performance Distributed Computing. (HPDC-1).

[37]  Bruce Walker,et al.  The LOCUS distributed operating system , 1983, SOSP '83.

[38]  E. Myers,et al.  Basic local alignment search tool. , 1990, Journal of molecular biology.

[39]  David Notkin,et al.  Heterogeneous computing environments: report on the ACM SIGOPS workshop on accommodating heterogeneity , 1987, CACM.

[40]  Andrzej Duda,et al.  Primitives for Distributed Computing in a Heterogeneous Local Area Network Environment , 1989, IEEE Trans. Software Eng..

[41]  G. C. Fox,et al.  A test suite approach for Fortran90D compilers on MIMD distributed memory parallel computers , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[42]  Andrew S. Grimshaw,et al.  Object-Oriented Parallel Processing with Mentat , 1996, Inf. Sci..

[43]  Andrew S. Grimshaw,et al.  Dynamic, object-oriented parallel processing , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.

[44]  Viktor K. Prasanna,et al.  Heterogeneous Supercomputing: Problems and Issues , 1992, Proceedings. Workshop on Heterogeneous Processing.

[45]  Eugene W. Myers,et al.  Basic local alignment search tool. Journal of Molecular Biology , 1990 .

[46]  Andrew S. Grimshaw,et al.  Portable run-time support for dynamic object-oriented parallel processing , 1996, TOCS.

[47]  Philip J. Hatcher,et al.  Data-Parallel Programming on MIMD Computers , 1991, IEEE Trans. Parallel Distributed Syst..

[48]  Miron Livny,et al.  Experience with the Condor distributed batch system , 1990, IEEE Workshop on Experimental Distributed Systems.

[49]  Phillip B. Gibbons A Stub Generator for Multilanguage RPC in Heterogeneous Environments , 1987, IEEE Transactions on Software Engineering.

[50]  Andrew P. Black,et al.  Interconnecting heterogeneous computer systems , 1988, CACM.

[51]  R. F. Freund,et al.  Augmenting the Optimal Selection Theory for Superconcurrency , 1992, Proceedings. Workshop on Heterogeneous Processing.

[52]  Vaidy S. Sunderam,et al.  PVM: A Framework for Parallel Distributed Computing , 1990, Concurr. Pract. Exp..

[53]  Michael J. Quinn,et al.  Data-parallel programming on a network of heterogeneous workstations , 1993, Concurr. Pract. Exp..

[54]  Anh Nguyen-Tuong,et al.  Exploiting data-flow for fault-tolerance in a wide-area parallel system , 1996, Proceedings 15th Symposium on Reliable Distributed Systems.

[55]  Mahadev Satyanarayanan,et al.  Andrew: a distributed personal computing environment , 1986, CACM.

[56]  Eran Gabber,et al.  VMMP: A Practical Tool for the Development of Portable and Efficient Programs for Multiprocessors , 1990, IEEE Trans. Parallel Distributed Syst..

[57]  David B. Loveman High performance Fortran , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.