Learning to Look: A Dynamic Neural Fields Architecture for Gaze Shift Generation

Looking is one of the most basic and fundamental goal-directed behaviors. The neural circuitry that generates gaze shifts towards target objects is adaptive and compensates for changes in the sensorimotor plant. Here, we present a neural-dynamic architecture, which enables an embodied agent to direct its gaze towards salient objects in its environment. The sensorimotor mapping, which is needed to accurately plan the gaze shifts, is initially learned and is constantly updated by a gain adaptation mechanism. We implemented the architecture in a simulated robotic agent and demonstrated autonomous map learning and adaptation in an embodied setting.

[1]  Clayton E Curtis,et al.  Obligatory adaptation of saccade gains. , 2008, Journal of neurophysiology.

[2]  D. Sparks,et al.  Conceptual issues related to the role of the superior colliculus in the control of gaze , 1999, Current Opinion in Neurobiology.

[3]  Peter Ford Dominey,et al.  A model of the cerebellum in adaptive control of saccadic gain , 1996, Biological cybernetics.

[4]  S. Grossberg,et al.  A neural model of saccadic eye movement control explains task-specific adaptation , 1999, Vision Research.

[5]  Gregor Schöner,et al.  Saccadic motor planning by integrating visual information and pre-information on neural dynamic fields , 1995, Biological Cybernetics.

[6]  A. Fuchs,et al.  Saccadic gain modification: visual error drives motor adaptation. , 1998, Journal of neurophysiology.

[7]  Gregor Schöner,et al.  The time course of saccadic decision making: Dynamic field theory , 2006, Neural Networks.

[8]  F. Rösler,et al.  Spatial Updating Depends on Gaze Direction Even after Loss of Vision , 2012, The Journal of Neuroscience.

[9]  L. Optican,et al.  Model of the control of saccades by superior colliculus and cerebellum. , 1999, Journal of neurophysiology.

[10]  R. Klein,et al.  A Model of Saccade Initiation Based on the Competitive Integration of Exogenous and Endogenous Signals in the Superior Colliculus , 2001, Journal of Cognitive Neuroscience.

[11]  D. Pélisson,et al.  Sensorimotor adaptation of saccadic eye movements , 2010, Neuroscience & Biobehavioral Reviews.

[12]  J. Mayhew,et al.  Learning and Maintaining Saccadic Accuracy: A Model of BrainstemCerebellar Interactions , 1994, Journal of Cognitive Neuroscience.

[13]  G. Schöner The Cambridge Handbook of Computational Psychology: Dynamical Systems Approaches to Cognition , 2008 .

[14]  Christian Quaia,et al.  Distributed Model of Collicular and Cerebellar Function during Saccades , 2002, Annals of the New York Academy of Sciences.

[15]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[16]  A. Fuchs,et al.  The characteristics and neuronal substrate of saccadic eye movement plasticity , 2004, Progress in Neurobiology.

[17]  Denis Pélisson,et al.  A role for the parietal cortex in sensorimotor adaptation of saccades. , 2014, Cerebral cortex.

[18]  Stephan K. U. Zibner,et al.  Using Dynamic Field Theory to extend the embodiment stance toward higher cognition , 2013 .

[19]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[20]  José Pedro Segundo,et al.  Locking, intermittency, and bifurcations in a periodically driven pacemaker neuron: Poincaré maps and biological implications , 1988, Biological Cybernetics.

[21]  A. Berthoz,et al.  From brainstem to cortex: Computational models of saccade generation circuitry , 2005, Progress in Neurobiology.