Markets vs auctions: Approaches to distributed combinatorial resource scheduling

Grid computations will be enabled by participants trading resources in order to construct bundles of goods or services that constitute experiments in science, engineering and, now emerging, social sciences. A combinatorial auction (CA) is a natural choice for optimal allocation, but the space and time dimensions that characterise a Grid would appear to indicate they are incompatible. This paper proposes that an analogue of a physical commodities market seems more appropriate and that there is a class of bundling problem whose complexity properties appear to make the utilisation of a CA impractical. A simulation environment, BrickWorld, is described which comprises a distributed tier of "TraderAgents" and multiple distributed single item auctions (MDAs). The issues associated with the complexity of bundling are evaluated, in particular those arising when attempting to provide useful combinations of items in situations when the multi-dimensionality of the bundle would make it impractical to finish the NP-complete optimisation successfully in the soft real-time setting that is the Grid. Finally, the evaluation strategy presented helps demonstrate that for small bundling problems, a single CA continues to provide a high level of performance, but as the complexity level of the problem increases and the problem becomes distributed a system of MDAs may prove more effective.

[1]  Leslie Lamport,et al.  The Byzantine Generals Problem , 1982, TOPL.

[2]  V. Kumar,et al.  Job Scheduling in the presence of Multiple Resource Requirements , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[3]  Sathish S. Vadhiyar,et al.  A metascheduler for the Grid , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[4]  Francine Berman,et al.  The GrADS Project: Software Support for High-Level Grid Application Development , 2001, Int. J. High Perform. Comput. Appl..

[5]  David C. Parkes,et al.  Rationality and Self-Interest in Peer to Peer Networks , 2003, IPTPS.

[6]  Tuomas Sandholm,et al.  Optimal Winner Determination Algorithms , 2005 .

[7]  D. Cliff,et al.  Zero is Not Enough: On The Lower Limit of Agent Intelligence For Continuous Double Auction Markets† , 1997 .

[8]  Pablo Noriega,et al.  FM96.5 A Java-based Electronic Auction House , 1997, PAAM.

[9]  Y. Shoham,et al.  Resource allocation in competitive multiagent systems , 2003 .

[10]  Rajkumar Buyya,et al.  Libra: a computational economy‐based job scheduling system for clusters , 2004, Softw. Pract. Exp..

[11]  Matthew K. Franklin,et al.  The design and implementation of a secure auction service , 1995, Proceedings 1995 IEEE Symposium on Security and Privacy.

[12]  Yoav Shoham,et al.  Taming the Computational Complexity of Combinatorial Auctions: Optimal and Approximate Approaches , 1999, IJCAI.

[13]  Nicholas R. Jennings,et al.  Optimal clearing algorithms for multi-unit single-item and multi-unit combinatorial auctions with demand/supply function bidding , 2003, ICEC '03.

[14]  Michael P. Wellman,et al.  Self-Confirming Price Prediction for Bidding in Simultaneous Ascending Auctions , 2005, UAI.

[15]  David Abramson,et al.  Nimrod: a tool for performing parametrised simulations using distributed workstations , 1995, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing.

[16]  Michael P. Wellman,et al.  Auction Protocols for Decentralized Scheduling , 2001, Games Econ. Behav..

[17]  Torsten Eymann,et al.  Catallaxy-based Grid markets , 2005, Multiagent Grid Syst..

[18]  Roger Mailler Comparing two approaches to dynamic, distributed constraint satisfaction , 2005, AAMAS '05.

[19]  David C. Parkes,et al.  Specification faithfulness in networks with rational nodes , 2004, PODC '04.

[20]  Scott B. Baden,et al.  Flexible Communication Mechanisms for Dynamic Structured Applications , 1996, IRREGULAR.

[21]  Yoav Shoham,et al.  Learning the Empirical Hardness of Optimization Problems: The Case of Combinatorial Auctions , 2002, CP.

[22]  Yoav Shoham,et al.  Combinatorial Auctions , 2005, Encyclopedia of Wireless Networks.

[23]  Paul F. Syverson,et al.  Fair On-Line Auctions without Special Trusted Parties , 1999, Financial Cryptography.

[24]  S. Raghavan,et al.  Introduction to the Special Issue on Electronic Markets , 2005, Manag. Sci..

[25]  Nicholas R. Jennings,et al.  SouthamptonTAC: Designing a Successful Trading Agent , 2002, ECAI.

[26]  Yu-Chi Ho,et al.  Resource management for large systems: Concepts, algorithms, and an application , 1980 .

[27]  Yoav Shoham,et al.  Towards a universal test suite for combinatorial auction algorithms , 2000, EC '00.

[28]  W. Hall,et al.  Autonomous Agents for Participating in Mulitple On-line Auctions , 2001 .

[29]  Rahul Simha,et al.  A Microeconomic Approach to Optimal Resource Allocation in Distributed Computer Systems , 1989, IEEE Trans. Computers.

[30]  David Levine,et al.  CABOB: A Fast Optimal Algorithm for Combinatorial Auctions , 2001, IJCAI.

[31]  D.C. Parkes,et al.  Distributed implementations of Vickrey-Clarke-Groves mechanisms , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[32]  Rajkumar Buyya,et al.  A taxonomy of market-based resource management systems for utility-driven cluster computing , 2006 .