The POPCORN market—an online market for computational resources

The POPCORN project provides an infrastructure for globally distributed computation over the whole Internet. It provides any programmer connected to the Internet with a single huge virtual parallel computer composed of all processors on the Internet, which care to participate at any given moment. POPCORN provides a marketbased mechanism for trade in CPU time to motivate processors to provide their CPU cycles for other peoples’ computations. “Selling” CPU time is as easy as visiting a certain web site with a Java-enabled browser. “Buying” CPU time is done by writing a parallel program using the POPCORN paradigm. A third entity in the POPCORN system is a “market” for CPU time, which is where buyers and sellers meet and trade. The POPCORN system may be visited on our website: http://www.cs.huji.ac.il/~popcorn. This paper concentrates on the POPCORN market. The market is a trusted intermediary that is responsible for matching buyers and sellers according to economic criteria. Our design emphasizes minimal communication requirements and minimal strategic considerations on the part of both buyers and sellers. We implemented several market mechanisms of the single-sided and double-sided auction types. We analyze the economic efficiency of these mechanisms using analytical and simulation methods. Our findings support the use of these mechanisms in the Internet environment.

[1]  G. Debreu,et al.  Theory of Value , 1959 .

[2]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[3]  David E. Spray.  The principal stock exchanges of the world : their operation, structure and development , 1964 .

[4]  David A. Bowers,et al.  Nine Leading Stock Exchanges. , 1969 .

[5]  K. Arrow,et al.  General Competitive Analysis , 1971 .

[6]  H. Mendelson.  MARKET BEHAVIOR IN A CLEARING HOUSE , 1982 .

[7]  Robert J. Weber,et al.  Distributional Strategies for Games with Incomplete Information , 1985, Math. Oper. Res..

[8]  R. McAfee,et al.  Auctions and Bidding , 1986 .

[9]  Donald F. Ferguson,et al.  Microeconomic algorithms for load balancing in distributed computer systems , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[10]  Paul R. Milgrom,et al.  Auctions and Bidding: A Primer , 1989 .

[11]  Aldo Rustichini.  Convergence to Price-Taking Behavior in a Simple Market , 1990 .

[12]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[13]  Jeffrey K. MacKie-Mason,et al.  Pricing the Internet , 1995 .

[14]  Deborah Estrin,et al.  Pricing in computer networks: motivation, formulation, and example , 1993, TNET.

[15]  Andrew Whinston,et al.  Managing The Internet as an Economic System , 1994 .

[16]  Flavio M. Menezes,et al.  Sequential asymmetric auctions with endogenous participation , 1994 .

[17]  Nathaniel Rockwood Bogan,et al.  Economic allocation of computation time with computation markets , 1994 .

[18]  David A. Patterson,et al.  A case for networks of workstations (now) , 1994, Symposium Record Hot Interconnects II.

[19]  David E. Culler,et al.  A case for NOW (networks of workstation) , 1995, PODC '95.

[20]  Michael P. Wellman,et al.  A Simple Computational Market for Network Information Services , 1995, ICMAS.

[21]  Jeffrey K. MacKie-Mason,et al.  Pricing Congestible Network Resources (Invited Paper) , 1995, IEEE J. Sel. Areas Commun..

[22]  Ariel Orda,et al.  Architecting noncooperative networks , 1995, Eighteenth Convention of Electrical and Electronics Engineers in Israel.

[23]  Bernardo A. Huberman,et al.  Computation as Economics , 1996 .

[24]  Tim Brecht,et al.  ParaWeb: towards world-wide supercomputing , 1996, EW 7.

[25]  Peter R. Cappello,et al.  Javelin: Internet‐based parallel computing using Java , 1997 .

[26]  Nemo Semret,et al.  Auctions for Network Resource Sharing , 1997 .

[27]  Pattie Maes,et al.  Challenger: a multi-agent system for distributed resource allocation , 1997, AGENTS '97.

[28]  Noam Nisan,et al.  The popcorn project: distributed computation over the internet in java , 1997 .

[29]  Michael P. Wellman,et al.  The WALRAS Algorithm: A Convergent Distributed Implementation of General Equilibrium Outcomes , 1998 .

[30]  N. Nisan,et al.  Globally distributed computation over the Internet-the POPCORN project , 1998, Proceedings. 18th International Conference on Distributed Computing Systems (Cat. No.98CB36183).

[31]  Zvi M. Kedem,et al.  Charlotte: Metacomputing on the Web , 1999, Future Gener. Comput. Syst..