PASAR: An integrated model of prediction, anticipation, sensation, attention and response for artificial sensorimotor systems

A wide range of neuroscientific studies suggest the existence of cognitive mechanisms like attention, prediction, anticipation and strong vertical interactions between different hierarchical layers of the brain while performing complex tasks. Despite advances in both cognitive brain research and in the development of brain-inspired artificial cognitive systems, the interplay of these key ingredients of cognition remain largely elusive and unquantified in complex real-world tasks. Furthermore, it has not yet been demonstrated how a self-contained hierarchical cognitive system acting under limited resource constraints can quantifiably benefit from the incorporation of top-down and bottom-up attentional mechanisms. In this context, an open fundamental question is how a data association mechanism can integrate bottom-up sensory information and top-down knowledge. Here, building on the Distributed Adaptive Control (DAC) architecture, we propose a single framework for integrating these different components of cognition and demonstrate the framework's performance in solving real-world and simulated robot tasks. Using the model we quantify the interactions between prediction, anticipation, attention and memory. Our results support the strength of a complete system that incorporates attention, prediction and anticipation mechanisms compared to incomplete systems for real-world and complex tasks. We unveil the relevance of transient memory that underlines the utility of the above mechanisms for intelligent knowledge management in artificial sensorimotor systems. These findings provide concrete predictions for physiological and psychophysical experiments to validate our model in biological cognitive systems.

[1]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[2]  John T. Rickard,et al.  Reformulation of the theory of conceptual spaces , 2007, Inf. Sci..

[3]  Paul F. M. J. Verschure,et al.  An insect-based method for learning landmark reliability using expectation reinforcement in dynamic environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[4]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[5]  Z. Mathews,et al.  Intelligent motor decision: From selective attention to a Bayesian world model , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[8]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Ben J. A. Kröse,et al.  Distributed adaptive control: The self-organization of structured behavior , 1992, Robotics Auton. Syst..

[10]  P. Langley,et al.  Acquisition of hierarchical reactive skills in a unified cognitive architecture , 2009, Cognitive Systems Research.

[11]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[12]  Olaf Sporns,et al.  A Large-scale Neurocomputational Model of Task-oriented Behavior Selection and Working Memory in Prefrontal Cortex , 2006 .

[13]  Barry E. Stein,et al.  The development of a dialogue between cortex and midbrain to integrate multisensory information , 2005, Experimental Brain Research.

[14]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[15]  Ismael Lopez-Juarez,et al.  On the design of intelligent robotic agents for assembly , 2005, Inf. Sci..

[16]  John Porrill,et al.  Adaptive-filter Models of the Cerebellum: Computational Analysis , 2008, The Cerebellum.

[17]  Peter Ford Dominey,et al.  Learning to talk about events from narrated video in a construction grammar framework , 2005, Artif. Intell..

[18]  Sharon Wood,et al.  Representation and purposeful autonomous agents , 2004, Robotics Auton. Syst..

[19]  James S. Albus,et al.  A model of computation and representation in the brain , 2010, Inf. Sci..

[20]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[21]  Peter Gärdenfors,et al.  Conceptual spaces - the geometry of thought , 2000 .

[22]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[24]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[25]  Tirin Moore,et al.  Dynamic sensitivity of area V4 neurons during saccade preparation , 2009, Proceedings of the National Academy of Sciences.

[26]  Y. Bar-Shalom Tracking and data association , 1988 .

[27]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[28]  S Cerutti,et al.  The dynamic behaviour of the evoked magnetoencephalogram detected through parametric identification. , 1992, Journal of biomedical engineering.

[29]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[30]  S. Hochstein,et al.  The reverse hierarchy theory of visual perceptual learning , 2004, Trends in Cognitive Sciences.

[31]  Paul F. M. J. Verschure,et al.  Unifying perceptual and behavioral learning with a correlative subspace learning rule , 2010, Neurocomputing.

[32]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[33]  P. Roelfsema,et al.  Bottom-Up Dependent Gating of Frontal Signals in Early Visual Cortex , 2008, Science.

[34]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[35]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[36]  E. Knudsen Instructed learning in the auditory localization pathway of the barn owl , 2002, Nature.

[37]  Stephen Grossberg,et al.  A neuromorphic model of spatial lookahead planning , 2011, Neural Networks.

[38]  D. Sparks,et al.  Sensorimotor integration in the primate superior colliculus. I. Motor convergence. , 1987, Journal of neurophysiology.

[39]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[40]  Paul F. M. J. Verschure,et al.  Social cooperation and competition in the mixed reality space eXperience Induction Machine XIM , 2009, Virtual Reality.

[41]  Paul F. M. J. Verschure,et al.  IQR: a distributed system for real-time real-world neuronal simulation , 2002, Neurocomputing.

[42]  B. Stein,et al.  The Merging of the Senses , 1993 .

[43]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[44]  Norbert Krüger,et al.  Symbols as Self-emergent Entities in an Optimization Process of Feature Extraction and Predictions , 2006, Biological Cybernetics.

[45]  Paul F. M. J. Verschure,et al.  Insect-Like mapless navigation based on head direction cells and contextual learning using chemo-visual sensors , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[47]  Paul F. M. J. Verschure,et al.  A Novel Brain-Based Approach for Multi-Modal Multi- Target Tracking in a Mixed Reality Space , 2007 .

[48]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[49]  J. Krichmar,et al.  Sensory integration and remapping in a model of the medial temporal lobe during maze navigation by a brain-based device. , 2007, Journal of integrative neuroscience.

[50]  J. B. Collins,et al.  Efficient gating in data association with multivariate Gaussian distributed states , 1992 .

[51]  Lorenzo Magnani,et al.  Abducing chances in hybrid humans as decision makers , 2009, Inf. Sci..

[52]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[53]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[54]  Pat Langley,et al.  A design for the ICARUS architecture , 1991, SGAR.

[55]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[56]  Kamel Mekhnacha,et al.  Bayesian Programming , 2013 .

[57]  Paul F. M. J. Verschure,et al.  A real-world rational agent: unifying old and new AI , 2003, Cogn. Sci..

[58]  Imoleayo Abel,et al.  Hierarchical Attentive Multiple Models for Execution and Recognition of Actions through Training Inverse and Forward Models Explorationally , 2012 .

[59]  Michael E. Hasselmo,et al.  A Model of Prefrontal Cortical Mechanisms for Goal-directed Behavior , 2005, Journal of Cognitive Neuroscience.

[60]  Haim Sompolinsky,et al.  A Hebbian learning rule mediates asymmetric plasticity in aligning sensory representations. , 2008, Journal of neurophysiology.

[61]  Matthew M. Botvinick,et al.  Anticipation of cognitive demand during decision-making , 2009, Psychological research.

[62]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[63]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[64]  P. Verschure,et al.  Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation , 2010, Journal of NeuroEngineering and Rehabilitation.

[65]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[66]  S. Treue Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[67]  Paul F. M. J. Verschure,et al.  Environmentally mediated synergy between perception and behaviour in mobile robots , 2003, Nature.

[68]  J. Fuster Inferotemporal units in selective visual attention and short-term memory. , 1990, Journal of neurophysiology.

[69]  M. Pinsk,et al.  Push-pull mechanism of selective attention in human extrastriate cortex. , 2004, Journal of neurophysiology.

[70]  Lawrence W. Stark,et al.  Top-down guided eye movements , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[71]  Christoph S. Herrmann,et al.  Anticipation of natural stimuli modulates EEG dynamics: physiology and simulation , 2008, Cognitive Neurodynamics.

[72]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[73]  Richard J. Duro,et al.  On the potential contributions of hybrid intelligent approaches to Multicomponent Robotic System development , 2010, Inf. Sci..

[74]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[75]  Seungho Lee,et al.  Decision field theory extensions for behavior modeling in dynamic environment using Bayesian belief network , 2008, Inf. Sci..

[76]  S. Sastry,et al.  A polynomial-time approximation algorithm for joint probabilistic data association , 2005, Proceedings of the 2005, American Control Conference, 2005..

[77]  J. S. Nairne Remembering over the short-term: the case against the standard model. , 2002, Annual review of psychology.

[78]  S Cerutti,et al.  Analysis of the neuromagnetic data on the frequency responsivity of the human brain: a progress report. , 1991, Clinical physics and physiological measurement : an official journal of the Hospital Physicists' Association, Deutsche Gesellschaft fur Medizinische Physik and the European Federation of Organisations for Medical Physics.

[79]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.