Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization

We propose a framework for including information-processing bounds in rational analyses. It is an application of bounded optimality (Russell & Subramanian, 1995) to the challenges of developing theories of mechanism and behavior. The framework is based on the idea that behaviors are generated by cognitive mechanisms that are adapted to the structure of not only the environment but also the mind and brain itself. We call the framework computational rationality to emphasize the incorporation of computational mechanism into the definition of rational action. Theories are specified as optimal program problems, defined by an adaptation environment, a bounded machine, and a utility function. Such theories yield different classes of explanation, depending on the extent to which they emphasize adaptation to bounds, and adaptation to some ecology that differs from the immediate local environment. We illustrate this variation with examples from three domains: visual attention in a linguistic task, manual response ordering, and reasoning. We explore the relation of this framework to existing "levels" approaches to explanation, and to other optimality-based modeling approaches.

[1]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[2]  John C. Avise,et al.  Adaptive Specializations, Social Exchange, and the Evolution of Human Intelligence , 2010 .

[3]  Dennis Norris,et al.  Putting it all together: a unified account of word recognition and reaction-time distributions. , 2009, Psychological review.

[4]  R. Schvaneveldt,et al.  Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. , 1971, Journal of experimental psychology.

[5]  Richard L. Lewis,et al.  A new approach to exploring language emergence as boundedly optimal control in the face of environmental and cognitive constraints , 2010 .

[6]  Karl J. Friston,et al.  Integrated Bayesian models of learning and decision making for saccadic eye movements☆ , 2008, Neural Networks.

[7]  R. Bellman Dynamic programming. , 1957, Science.

[8]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[9]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[10]  John E. Laird,et al.  The Soar Cognitive Architecture , 2012 .

[11]  John R. Anderson The Adaptive Character of Thought , 1990 .

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[14]  P. Johnson-Laird,et al.  A theoretical analysis of insight into a reasoning task , 1970 .

[15]  Anne Pier Salverda,et al.  A goal-based perspective on eye movements in visual world studies. , 2011, Acta psychologica.

[16]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[17]  D. Ballard,et al.  Modelling the role of task in the control of gaze , 2009, Visual cognition.

[18]  A. Newell Unified Theories of Cognition , 1990 .

[19]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[20]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[21]  A. Houston,et al.  Integrating function and mechanism. , 2009, Trends in ecology & evolution.

[22]  Richard L. Lewis,et al.  Rational adaptation under task and processing constraints: implications for testing theories of cognition and action. , 2009, Psychological review.

[23]  D. Norris,et al.  How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). , 2012, Psychological bulletin.

[24]  W. Geisler,et al.  Contributions of ideal observer theory to vision research , 2011, Vision Research.

[25]  Jennifer M. Glass,et al.  Concurrent response-selection processes in dual-task performance: Evidence for adaptive executive control of task scheduling. , 1999 .

[26]  Richard L. Lewis,et al.  The Adaptive Nature of Eye Movements in Linguistic Tasks: How Payoff and Architecture Shape Speed-Accuracy Trade-Offs , 2013, Top. Cogn. Sci..

[27]  David L. Kleinman,et al.  The Human as an Optimal Controller and Information Processor , 1969 .

[28]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[29]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[30]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[31]  J. Todd,et al.  The effects of viewing angle, camera angle, and sign of surface curvature on the perception of three-dimensional shape from texture. , 2007, Journal of vision.

[32]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[33]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[34]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[35]  Richard L. Lewis,et al.  Intrinsically Motivated Reinforcement Learning: An Evolutionary Perspective , 2010, IEEE Transactions on Autonomous Mental Development.

[36]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[37]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[38]  H. Pashler The Psychology of Attention , 1997 .

[39]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[40]  Dennis Norris,et al.  The Bayesian reader: explaining word recognition as an optimal Bayesian decision process. , 2006, Psychological review.

[41]  D. Wolpert Probabilistic models in human sensorimotor control. , 2007, Human movement science.

[42]  R. Ratcliff,et al.  A Diffusion Model Account of Criterion Shifts in the Lexical Decision Task. , 2008, Journal of memory and language.

[43]  L. Cosmides,et al.  THE EMERGENCE OF EVOLUTIONARY PSYCHOLOGY: WHAT IS AT STAKE? , 2022 .

[44]  Refractor Vision , 2000, The Lancet.

[45]  J. Neumann,et al.  Theory of Games and Economic Behavior. , 1945 .

[46]  Nick Chater,et al.  A rational analysis of the selection task as optimal data selection. , 1994 .

[47]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[48]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[49]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[50]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[51]  Noam Chomsky Three Factors in Language Design , 2005, Linguistic Inquiry.

[52]  C. L. M. The Psychology of Attention , 1890, Nature.

[53]  Wayne D. Gray,et al.  Topics in Cognitive Science , 2009 .

[54]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[55]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.