A method to solve the scalability problem in managing massively parallel processing on the Internet

A set of computers connected by the Internet can be seen as a MIMD virtual parallel computer with distributed memory. We call such a computer a Massively Parallel Virtual Computer (MPVC). The implementation of an MPVC will be feasible in the next few years, as new technologies brine to Internet communication speeds undreamed of nowadays. Problems such as Monte Carlo simulations and image processing and generation are good candidates to take advantage of MPVCs, since they can use practically all the computing power they can get. Massively Parallel Processing on the Internet introduces the problem of scalability, that is, how to administrate efficiently a large number of computers and an even larger number of tasks running in them, Previous approaches either do not scale well or let the program mer solve the problem by himself. This paper explains the Dynamic Virtual Hypercubes, a structure created to logically organize an MPVC. Dynamic Virtual Hypercubes provide a scalable and efficient way to handle a large number of computers and tasks, since they can adapt to changes in workload and number of available machines.

[1]  Kang G. Shin,et al.  Load Sharing in Distributed Real-Time Systems with State-Change Broadcasts , 1989, IEEE Trans. Computers.

[2]  Miron Livny,et al.  Interfacing Condor and PVM to harness the cycles of workstation clusters , 1996, Future Gener. Comput. Syst..

[3]  Andrew S. Grimshaw,et al.  Legion-a view from 50,000 feet , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[4]  Miron Livny,et al.  A worldwide flock of Condors: Load sharing among workstation clusters , 1996, Future Gener. Comput. Syst..

[5]  Geoffrey C. Fox,et al.  EXAOPS:UPERCOMPUTING ON THE WEB , 1997 .

[6]  Howard P. Katseff,et al.  Incomplete Hypercubes , 1988, IEEE Trans. Computers.

[7]  Kang G. Shin,et al.  A Coordinated Location Policy for Load Sharing in Hypercube-Connected Multicomputers , 1995, IEEE Trans. Computers.

[8]  Jack Dongarra,et al.  PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing , 1995 .

[9]  Andrew S. Grimshaw,et al.  The core Legion object model , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[10]  Richard M. Fujimoto,et al.  Multicomputer Networks: Message-Based Parallel Processing , 1987 .