Bargaining with limited computation: Deliberation equilibrium

We develop a normative theory of interaction-negotiation in particular-among self-interested computationally limited agents where computational actions are game theoretically treated as part of an agent's strategy. We focus on a 2-agent setting where each agent has an intractable individual problem, and there is a potential gain from pooling the problems, giving rise to an intractable joint problem. At any time, an agent can compute to improve its solution to its own problem, its opponent's problem, or the joint problem. At a deadline the agents then decide whether to implement the joint solution, and if so, how to divide its value (or cost). We present a fully normative model for controlling anytime algorithms where each agent has statistical performance profiles which are optimally conditioned on the problem instance as well as on the path of results of the algorithm run so far. Using this model, we introduce a solution concept, which we call deliberation equilibrium. It is the perfect Bayesian equilibrium of the game where deliberation actions are part of each agent's strategy. The equilibria differ based on whether the performance profiles are deterministic or stochastic, whether the deadline is known or not, and whether the proposer is known in advance or not. We present algorithms for finding the equilibria. Finally, we show that there exist instances of the deliberation-bargaining problem where no pure strategy equilibria exist and also instances where the unique equilibrium outcome is not Pareto efficient. Copyright 2001 Elsevier Science B.V.

[1]  Sarit Kraus,et al.  Multiagent Negotiation under Time Constraints , 1995, Artif. Intell..

[2]  Eric Horvitz,et al.  Principles and applications of continual computation , 2001, Artif. Intell..

[3]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[4]  Shlomo Zilberstein,et al.  Monitoring and control of anytime algorithms: A dynamic programming approach , 2001, Artif. Intell..

[5]  A. Rubinstein,et al.  Bargaining and Markets. , 1991 .

[6]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Stuart J. Russell Rationality and Intelligence , 1995, IJCAI.

[8]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[9]  Stuart J. Russell,et al.  Do the right thing - studies in limited rationality , 1991 .

[10]  Tuomas Sandholm,et al.  Computationally Limited Agents in Auctions , 2001 .

[11]  Eric Horvitz,et al.  Reasoning under Varying and Uncertain Resource Constraints , 1988, AAAI.

[12]  Stuart J. Russell,et al.  Principles of Metareasoning , 1989, Artif. Intell..

[13]  B. Stengel,et al.  Efficient Computation of Behavior Strategies , 1996 .

[14]  H. Simon,et al.  Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[15]  D. A. Sprott,et al.  Foundations of Statistical Inference. , 1972 .

[16]  Tuomas Sandholm,et al.  An Implementation of the Contract Net Protocol Based on Marginal Cost Calculations , 1993, AAAI.

[17]  Mihalis Yannakakis,et al.  On complexity as bounded rationality (extended abstract) , 1994, STOC '94.

[18]  A. Rubinstein Modeling Bounded Rationality , 1998 .

[19]  Eduardo Alonso Fernández,et al.  Rules of encounter: designing conventions for automated negotiation among computers , 1995 .

[20]  Simon Parsons,et al.  Do the right thing - studies in limited rationality by Stuart Russell and Eric Wefald, MIT Press, Cambridge, MA, £24.75, ISBN 0-262-18144-4 , 1994, The Knowledge Engineering Review.

[21]  Mark S. Boddy,et al.  Deliberation Scheduling for Problem Solving in Time-Constrained Environments , 1994, Artif. Intell..

[22]  David C. Parkes,et al.  Optimal Auction Design for Agents with Hard Valuation Problems , 1999, Agent Mediated Electronic Commerce.

[23]  Shlomo Zilberstein,et al.  Optimal Composition of Real-Time Systems , 1996, Artif. Intell..

[24]  Tuomas Sandholm,et al.  Issues in Computational Vickrey Auctions , 2000, Int. J. Electron. Commer..

[25]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[26]  Hans M. Amman,et al.  Handbook of Computational Economics , 1996 .

[27]  Larry Samuelson,et al.  Bounded rationality and game theory , 1996 .

[28]  Stuart J. Russell,et al.  Do the right thing , 1991 .

[29]  Eric Horvitz,et al.  Reasoning about beliefs and actions under computational resource constraints , 1987, Int. J. Approx. Reason..

[30]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[31]  H. Simon Rational Decision Making in Business Organizations , 1978 .

[32]  François Charpillet,et al.  Real-Time Problem-Solving with Contract Algorithms , 1999, IJCAI.

[33]  B. Stengel,et al.  COMPUTING EQUILIBRIA FOR TWO-PERSON GAMES , 1996 .

[34]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[35]  Itzhak Gilboa,et al.  Bounded Versus Unbounded Rationality: The Tyranny of the Weak , 1989 .

[36]  A. Mas-Colell,et al.  Microeconomic Theory , 1995 .

[37]  D. Koller,et al.  Efficient Computation of Equilibria for Extensive Two-Person Games , 1996 .

[38]  A. Rubinstein,et al.  The Structure of Nash Equilibrium in Repeated Games with Finite Automata (Now published in Econometrica, 56 (1988), pp.1259-1282.) , 1986 .

[39]  Michael P. Wellman A Market-Oriented Programming Environment and its Application to Distributed Multicommodity Flow Problems , 1993, J. Artif. Intell. Res..

[40]  T. Sandholm,et al.  Costly valuation computation in auctions , 2001 .

[41]  Victor R. Lesser,et al.  Coalitions Among Computationally Bounded Agents , 1997, Artif. Intell..

[42]  Timothy A. Salthouse,et al.  Decision Making and Problem Solving , 1982 .

[43]  Eric B. Baum,et al.  A Bayesian Approach to Relevance in Game Playing , 1997, Artif. Intell..

[44]  Phillippe Jéheil Limited Horizon Forecast in Repeated Alternate Games , 1995 .