Modeling the Brain's Operating System

To make progess in understanding human brain functionality, we will need to understand its basic functions at an abstract level. One way of accomplishing such an integration is to create a model of a human that has a useful amount of complexity. Essentially, one is faced with proposing an embodied “operating system” model that can be tested against human performance. Recently technological advances have been made that allow progress to be made in this direction. Graphics models that simulate extensive human capabilities can be used as platforms from which to develop synthetic models of visuo-motor behavior. Currently such models can capture only a small portion of a full behavioral repertoire, but for the behaviors that they do model, they can describe complete visuo-motor subsystems at a level of detail that can be tested against human performance in realistic environments. This paper outlines one such model and shows both that it can produce interesting new hypotheses as to the role of vision and also that it can enhance our understanding of visual attention.

[1]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[2]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[3]  Richard S. Sutton,et al.  Generalization in ReinforcementLearning : Successful Examples UsingSparse Coarse , 1996 .

[4]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[5]  Mark Humphrys,et al.  Action Selection methods using Reinforcement Learning , 1996 .

[6]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[7]  Jonas Karlsson,et al.  Learning to Solve Multiple Goals , 1997 .

[8]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[9]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[11]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[12]  Dana H. Ballard,et al.  Multiple-Goal Reinforcement Learning with Modular Sarsa(0) , 2003, IJCAI.

[13]  A. Clark.  Being There: Putting Brain, Body, and World Together Again , 1996 .

[14]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[15]  S. Ullman.  Visual routines , 1984, Cognition.

[16]  Roland E. Suri,et al.  Temporal Difference Model Reproduces Anticipatory Neural Activity , 2001, Neural Computation.

[17]  H. Pashler.  The Psychology of Attention , 1997 .

[18]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[19]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[20]  Ralph Hartley,et al.  Experiments with the subsumption architecture , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[21]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[22]  Joanna Bryson,et al.  Modularity and Design in Reactive Intelligence , 2001, IJCAI.

[23]  A. Newell.  Unified Theories of Cognition , 1990 .

[24]  Michael J. Swain,et al.  An Architecture for Vision and Action , 1995, IJCAI.

[25]  Christoph von der Malsburg,et al.  The What and Why of Binding The Modeler’s Perspective , 1999, Neuron.

[26]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[27]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[28]  Maurice Merleau-Ponty.  Phenomenology of Perception , 1964 .

[29]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[30]  Demetri Terzopoulos,et al.  Animat vision: Active vision in artificial animals , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[32]  Dana H. Ballard,et al.  Eye Movements for Reward Maximization , 2003, NIPS.

[33]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.