Why Markets Could (But Don't Currently) Solve Resource Allocation Problems in Systems

Using market mechanisms for resource allocation in distributed systems is not a new idea, nor is it one that has caught on in practice or with a large body of computer science research. Yet, projects that use markets for distributed resource allocation recur every few years [1, 2, 3], and a new generation of research is exploring market-based resource allocation mechanisms [4, 5, 6, 7, 8] for distributed environments such as Planetlab, Netbed, and computational grids. This paper has three goals. The first goal is to explore why markets can be appropriate to use for allocation, when simpler allocation mechanisms exist. The second goal is to demonstrate why a new look at markets for allocation could be timely, and not a re-hash of previous research. The third goal is to point out some of the thorny problems inherent in market deployment and to suggest action items both for market designers and for the greater research community. We are optimistic about the power of market design, but we also believe that key challenges exist for a markets/systems integration that must be overcome for market-based computer resource allocation systems to succeed.

[1]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[2]  David C. Parkes,et al.  ICE: an iterative combinatorial exchange , 2005, EC '05.

[3]  Amin Vahdat,et al.  SHARP: an architecture for secure resource peering , 2003, SOSP '03.

[4]  Emin Gün Sirer,et al.  KARMA : A Secure Economic Framework for Peer-to-Peer Resource Sharing , 2003 .

[5]  Noam Nisan,et al.  Bidding and allocation in combinatorial auctions , 2000, EC '00.

[6]  Paul R. Barham,et al.  Xen 2002 , 2002 .

[7]  Ivan E. Sutherland,et al.  A futures market in computer time , 1968, Commun. ACM.

[8]  G. D. Liveing,et al.  The University of Cambridge , 1897, British medical journal.

[9]  Lee L. Selwyn,et al.  Considerations for computer utility pricing policies , 1968, ACM National Conference.

[10]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[11]  N. Nisan,et al.  The POPCORN market—an online market for computational resources , 1998, ICE '98.

[12]  Robbert van Renesse,et al.  Using Sparse Capabilities in a Distributed Operating System , 1986, ICDCS.

[13]  S Grinstein,et al.  Resource Predictors in HEP Applications , 2005 .

[14]  Alvin E. Roth,et al.  Game Theory as a Tool for Market Design , 2000 .

[15]  Amin Vahdat,et al.  Resource Allocation in Federated Distributed Computing Infrastructures , 2004 .

[16]  David Abramson,et al.  A case for economy grid architecture for service oriented grid computing , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[17]  James S. Plank,et al.  G-Commerce - Building Computational Marketplaces for the Computational Grid , 2000 .

[18]  Noam Nisan,et al.  Algorithmic mechanism design (extended abstract) , 1999, STOC '99.

[19]  Bernardo A. Huberman,et al.  Tycoon: A Market-Based Resource Allocation System , 2004, ArXiv.