Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors

The current paper proposes a novel model for integrative learning of proactive visual attention and sensory-motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive object-related visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.

[1]  Richard A Andersen,et al.  Forward estimation of movement state in posterior parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[2]  R. Steinman,et al.  Temporal coordination of the human head and eye during a natural sequential tapping task , 2001, Vision Research.

[3]  L. Carlton.  Processing visual feedback information for movement control. , 1981, Journal of experimental psychology. Human perception and performance.

[4]  Andrew McCallum,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .

[5]  Susan L. Denham,et al.  Modelling attention in individual cells leads to a system with realistic saccade behaviours , 2009, Cognitive Neurodynamics.

[6]  R. Johansson,et al.  Eye–hand coordination in a sequential target contact task , 2009, Experimental Brain Research.

[7]  Yuqiao Gu,et al.  A neural network model of attention-modulated neurodynamics , 2007, Cognitive Neurodynamics.

[8]  M. Iacoboni.  Imitation, empathy, and mirror neurons. , 2009, Annual review of psychology.

[9]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[10]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[11]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[12]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[13]  J Saarinen,et al.  Self-Organized Formation of Colour Maps in a Model Cortex , 1985, Perception.

[14]  J Paillard,et al.  Fast and slow feedback loops for the visual correction of spatial errors in a pointing task: a reappraisal. , 1996, Canadian journal of physiology and pharmacology.

[15]  Maja J. Matarić,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .

[16]  T Moore,et al.  Control of eye movements and spatial attention. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[17]  D. Gitelman,et al.  Covert Visual Spatial Orienting and Saccades: Overlapping Neural Systems , 2000, NeuroImage.

[18]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[19]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[20]  J. Fuster.  Prefrontal Cortex , 2018 .

[21]  G. Rizzolatti,et al.  Action for perception: a motor-visual attentional effect. , 1999 .

[22]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[23]  G. Rizzolatti,et al.  Space and selective attention , 1994 .

[24]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[25]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[26]  M. Land,et al.  The effects of skill on the eye–hand span during musical sight–reading , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  D. Perrett,et al.  Neural Representation for the Perception of the Intentionality of Actions , 2000, Brain and Cognition.

[28]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[29]  A. Borst.  Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[30]  D. V. von Cramon,et al.  Functional organization of the lateral premotor cortex: fMRI reveals different regions activated by anticipation of object properties, location and speed. , 2001, Brain research. Cognitive brain research.

[31]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[32]  K. Doya,et al.  Memorizing oscillatory patterns in the analog neuron network , 1989, International 1989 Joint Conference on Neural Networks.

[33]  J. Assad,et al.  Dissociation of visual, motor and predictive signals in parietal cortex during visual guidance , 1999, Nature Neuroscience.

[34]  R. Beer.  Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[35]  J D Crawford,et al.  Spatial transformations for eye-hand coordination. , 2004, Journal of neurophysiology.

[36]  R. Mizen.  The embodied mind. , 2009, The Journal of analytical psychology.

[37]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[38]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[39]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[40]  C. Prablanc,et al.  Neural control of on-line guidance of hand reaching movements. , 2003, Progress in brain research.

[41]  R. Johansson,et al.  Evidence for the involvement of the posterior parietal cortex in coordination of fingertip forces for grasp stability in manipulation. , 2003, Journal of neurophysiology.

[42]  Ravi S. Menon,et al.  Human fMRI evidence for the neural correlates of preparatory set , 2002, Nature Neuroscience.

[43]  M. Posner,et al.  Attentional networks , 1994, Trends in Neurosciences.

[44]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[45]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[46]  R. J. Seitz,et al.  A fronto‐parietal circuit for object manipulation in man: evidence from an fMRI‐study , 1999, The European journal of neuroscience.

[47]  Minho Lee,et al.  Biologically motivated vergence control system using human-like selective attention model , 2006, Neurocomputing.

[48]  D. Ballard,et al.  Goal-directed arm movements change eye-head coordination , 1996, Experimental Brain Research.

[49]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[50]  G. Rizzolatti,et al.  Spatial attention and eye movements , 2004, Experimental Brain Research.

[51]  John K. Tsotsos.  Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[52]  Rajesh P. N. Rao,et al.  An Active Vision Architecture Based on Iconic Representations , 1995, Artif. Intell..

[53]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[54]  Takashi Hanakawa,et al.  Connectivity and signal intensity in the parieto-occipital cortex predicts top-down attentional effect in visual masking: An fMRI study based on individual differences , 2009, NeuroImage.

[55]  G. Mettaa,et al.  A developmental approach to visually-guided reaching in artificial systems , 1999 .

[56]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[57]  J. D. Crawford,et al.  Spatial Transformations for Eye–Hand Coordination , 2004 .

[58]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[59]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[60]  Howard Poizner,et al.  The interaction of visual and proprioceptive inputs in pointing to actual and remembered targets , 2004, Experimental Brain Research.

[61]  G. Rizzolatti,et al.  Action for perception: a motor-visual attentional effect. , 1999, Journal of experimental psychology. Human perception and performance.

[62]  Minho Lee,et al.  Stereo saliency map considering affective factors and selective motion analysis in a dynamic environment , 2008, Neural Networks.

[63]  J. Vercher,et al.  Online control of the direction of rapid reaching movements , 2004, Experimental Brain Research.

[64]  Jun Tani,et al.  Development of hierarchical structures for actions and motor imagery: a constructivist view from synthetic neuro-robotics study , 2009, Psychological research.

[65]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[66]  D. Pandya,et al.  Parietal, temporal, and occipita projections to cortex of the superior temporal sulcus in the rhesus monkey: A retrograde tracer study , 1994, The Journal of comparative neurology.

[67]  M. Goodale,et al.  Visual control of reaching movements without vision of the limb , 2004, Experimental Brain Research.

[68]  Dario Floreano,et al.  Enactive Robot Vision , 2008, Adapt. Behav..

[69]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[70]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[71]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[72]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[73]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[74]  Gunnar Rätsch,et al.  Support Vector Machines and Kernels for Computational Biology , 2008, PLoS Comput. Biol..

[75]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[76]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.