A biologically inspired working memory framework for robots

The human brain includes a capacity-limited memory system devoted to the short-term retention of task-relevant information. This system is called working memory. Some computational neuroscience accounts of working memory have explained it in terms of interactions between the prefrontal cortex and the mesolimbic dopamine system. Inspired by these models, we have constructed a software toolkit for creating working memory components for robot control systems, based on the proposed mechanisms used by the brain. We report our design for this toolkit, as well as the results of a feasibility study, involving a robotic version of the delayed saccade task, and we discuss future plans to test this framework in the context of more complex tasks.

[1]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[2]  Jonathan D. Cohen,et al.  Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. , 2002, Cerebral cortex.

[3]  B. J. Casey,et al.  Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI , 1994, Human brain mapping.

[4]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Jonathan D. Cohen,et al.  A Biologically Based Computational Model of Working Memory , 1999 .

[6]  Peter A. Tucker,et al.  Primary Memory , 1965, Encyclopedia of Database Systems.

[7]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[8]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Jonathan D. Cohen,et al.  On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory , 2007 .

[10]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[11]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[12]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[13]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[14]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[15]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[16]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[17]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[18]  Jemett L. Desmond,et al.  Semantic encoding and retrieval in the left inferior prefrontal cortex: a functional MRI study of task difficulty and process specificity , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.