SuperWeb: towards a global Web-based parallel computing infrastructure

The Internet, best known by most users as the World-Wide-Web, continues to expand at an amazing pace. We propose a new infrastructure to harness the combined resources, such as CPU cycles or disk storage, and make them available to everyone interested. This infrastructure has the potential for solving parallel supercomputing applications involving thousands of cooperating components. Our approach is based on recent advances in Internet connectivity and the implementation of safe distributed computing embodied in languages such as Java. We developed a prototype of a global computing infrastructure, called SuperWeb, that consists of hosts, brokers and clients. Hosts register a fraction of their computing resources (CPU time, memory, bandwidth, disk space) with resource brokers. Client computations are then mapped by the broker onto the registered resources. We examine an economic model for trading computing resources, and discuss several technical challenges associated with such a global computing environment.

[1]  Shu-Chin Wang,et al.  Optimal Agreement Protocol in Malicious Faulty Processors and Faulty Links , 1992, IEEE Trans. Knowl. Data Eng..

[2]  Ian Goldberg,et al.  A Secure Environment for Untrusted Helper Applications ( Confining the Wily Hacker ) , 1996 .

[3]  Joan Feigenbaum,et al.  Encrypting Problem Instances: Or ..., Can You Take Advantage of Someone Without Having to Trust Him? , 1985, CRYPTO.

[4]  James C. French,et al.  A Synopsis of the Legion Project , 1994 .

[5]  Peter R. Cappello,et al.  Javelin: Internet‐based parallel computing using Java , 1997 .

[6]  Zvi M. Kedem,et al.  Charlotte: Metacomputing on the Web , 1999, Future Gener. Comput. Syst..

[7]  K. Mani Chandy,et al.  A world-wide distributed system using Java and the Internet , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[8]  Michael Stonebraker,et al.  An economic paradigm for query processing and data migration in Mariposa , 1994, Proceedings of 3rd International Conference on Parallel and Distributed Information Systems.

[9]  Lei Tang.  A Set of Protocols for Micropayments in Distributed Systems , 1995, USENIX Workshop on Electronic Commerce.

[10]  James A. Gosling,et al.  The java language environment: a white paper , 1995 .

[11]  Mark S. Manasse,et al.  The Millicent Protocols for Electronic Commerce , 1995, USENIX Workshop on Electronic Commerce.

[12]  K. M. Chandy,et al.  Reliable Synchronization Primitives for Java , 1996 .

[13]  Vaidy S. Sunderam,et al.  PVM: A Framework for Parallel Distributed Computing , 1990, Concurr. Pract. Exp..

[14]  Eric A. Brewer,et al.  ATLAS: an infrastructure for global computing , 1996, EW 7.

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  Geoffrey C. Fox,et al.  Towards Web/Java-based high performance distributed computing-an evolving virtual machine , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[17]  Zhonghua Yang,et al.  CORBA: a platform for distributed object computing , 1996, OPSR.

[18]  Robert A. Whiteside,et al.  Using Linda for supercomputing on a local area network , 1988, Proceedings. SUPERCOMPUTING '88.

[19]  David Gelernter,et al.  Supercomputing out of recycled garbage: preliminary experience with Piranha , 1992, ICS '92.

[20]  Message Passing Interface Forum.  MPI: A message - passing interface standard , 1994 .

[21]  Message P Forum,et al.  MPI: A Message-Passing Interface Standard , 1994 .

[22]  David A. Wagner,et al.  A Secure Environment for Untrusted Helper Applications , 1996, USENIX Security Symposium.

[23]  Tim Brecht,et al.  ParaWeb: towards world-wide supercomputing , 1996, EW 7.