Provably Bounded Optimal Agents

Since its inception, arti cial intelligence has relied upon a theoretical foundation centred around perfect rationality as the desired property of intelligent systems. We argue, as others have done, that this foundation is inadequate because it imposes fundamentally unsatis able requirements. As a result, there has arisen a wide gap between theory and practice in AI, hindering progress in the eld. We propose instead a property called bounded optimality. Roughly speaking, an agent is bounded-optimal if its program is a solution to the constrained optimization problem presented by its architecture and the task environment. We show how to construct agents with this property for a simple class of machine architectures in a broad class of real-time environments. We illustrate these results using a simple model of an automated mail sorting facility. We also de ne a weaker property, asymptotic bounded optimality (ABO), that generalizes the notion of optimality in classical complexity theory. We then construct universal ABO programs, i.e., programs that are ABO no matter what real-time constraints are applied. Universal ABO programs can be used as building blocks for more complex systems. We conclude with a discussion of the prospects for bounded optimality as a theoretical basis for AI, and relate it to similar trends in philosophy, economics, and game theory.

[1]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[2]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[3]  John McCarthy,et al.  Programs with common sense , 1960 .

[4]  H. Bandemer Savage, L. J.: Foundations of Statistics. Dover Publ., Inc,. New York 1972. 310 S. , 1974 .

[5]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .

[6]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[8]  H. Simon,et al.  Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[9]  Jon Doyle,et al.  What Is Rational Psychology? Toward a Modern Mental Philosophy , 1983, AI Mag..

[10]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[11]  A. Neyman Bounded complexity justifies cooperation in the finitely repeated prisoners' dilemma , 1985 .

[12]  Christopher Cherniak,et al.  Minimal Rationality , 1986, Computational models of cognition and perception.

[13]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[14]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[15]  Hector J. Levesque,et al.  Expressiveness and tractability in knowledge representation and reasoning 1 , 1987, Comput. Intell..

[16]  Eric Horvitz,et al.  Reasoning about beliefs and actions under computational resource constraints , 1987, Int. J. Approx. Reason..

[17]  Mark S. Boddy,et al.  An Analysis of Time-Dependent Planning , 1988, AAAI.

[18]  J. Doyle,et al.  Artificial Intelligence and Rational Self-Government , 1988 .

[19]  Michael R. Fehling,et al.  Control of problem solving: principles and architecture , 1988, UAI.

[20]  Oren Etzioni,et al.  Tractable Decision-Analytic Control , 1989, KR.

[21]  Eric Horvitz,et al.  Reflection and Action Under Scarce Resources: Theoretical Principles and Empirical Study , 1989, IJCAI.

[22]  Stuart J. Russell,et al.  On Optimal Game-Tree Search using Rational Meta-Reasoning , 1989, IJCAI.

[23]  Othar Hansson,et al.  Heuristic Search as Evidential Reasoning , 2013, UAI 1989.

[24]  A Markovian extension of Valiant's learning model , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[25]  Jon Doyle,et al.  Two Theses of Knowledge Representation: Language Restrictions, Taxonomic Classification, and the Utility of Representation Services , 1991, Artif. Intell..

[26]  Nils J. Nilsson,et al.  Logic and Artificial Intelligence , 1991, Artif. Intell..

[27]  Stuart J. Russell,et al.  Do the right thing - studies in limited rationality , 1991 .

[28]  Shlomo Zilberstein,et al.  Composing Real-Time Systems , 1991, IJCAI.

[29]  Stuart J. Russell,et al.  Principles of Metareasoning , 1989, Artif. Intell..

[30]  Michael P. Wellman,et al.  Planning and Control , 1991 .

[31]  R. Schapire Toward Eecient Agnostic Learning , 1992 .

[32]  Lawrence D. Jackel,et al.  Application of the ANNA neural network chip to high-speed character recognition , 1992, IEEE Trans. Neural Networks.

[33]  Lawrence D. Jackel,et al.  Hardware requirements for neural network pattern classifiers: a case study and implementation , 1992, IEEE Micro.

[34]  David Zuckerman,et al.  Optimal speedup of Las Vegas algorithms , 1993, [1993] The 2nd Israel Symposium on Theory and Computing Systems.

[35]  Mihalis Yannakakis,et al.  On complexity as bounded rationality (extended abstract) , 1994, STOC '94.

[36]  Simon Parsons,et al.  Do the right thing - studies in limited rationality by Stuart Russell and Eric Wefald, MIT Press, Cambridge, MA, £24.75, ISBN 0-262-18144-4 , 1994, The Knowledge Engineering Review.

[37]  Shlomo Zilberstein,et al.  Operational Rationality through Compilation of Anytime Algorithms , 1995, AI Mag..