Learning the Optimal Control of Coordinated Eye and Head Movements

Various optimality principles have been proposed to explain the characteristics of coordinated eye and head movements during visual orienting behavior. At the same time, researchers have suggested several neural models to underly the generation of saccades, but these do not include online learning as a mechanism of optimization. Here, we suggest an open-loop neural controller with a local adaptation mechanism that minimizes a proposed cost function. Simulations show that the characteristics of coordinated eye and head movements generated by this model match the experimental data in many aspects, including the relationship between amplitude, duration and peak velocity in head-restrained and the relative contribution of eye and head to the total gaze shift in head-free conditions. Our model is a first step towards bringing together an optimality principle and an incremental local learning mechanism into a unified control scheme for coordinated eye and head movements.

[1]  C. Harris On the optimal control of behaviour: a stochastic perspective , 1998, Journal of Neuroscience Methods.

[2]  J. Stahl,et al.  Overlapping gaze shifts reveal timing of an eye–head gate , 2005, Experimental Brain Research.

[3]  E. Bizzi,et al.  Eye-Head Coordination in Monkeys: Evidence for Centrally Patterned Organization , 1971, Science.

[4]  L C Populin,et al.  Human Gaze Shifts to Acoustic and Visual Targets , 2002, Annals of the New York Academy of Sciences.

[5]  Christian Quaia,et al.  Distributed model of control of saccades by superior colliculus and cerebellum , 1998, Neural Networks.

[6]  J J Plorde,et al.  Rapid horizontal gaze movement in the monkey. , 1995, Journal of neurophysiology.

[7]  A Textbook of Neuroanatomy, M.A. Patestas, L.P. Gartner (Eds.). Blackwell Publishing (2006), ISBN: 1-4051-0340-X , 2007 .

[8]  Michael D. Gordon,et al.  Regularized Least Absolute Deviations Regression and an Efficient Algorithm for Parameter Tuning , 2006, Sixth International Conference on Data Mining (ICDM'06).

[9]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[10]  P. Morasso,et al.  Mechanisms underlying recovery of eye-head coordination following bilateral labyrinthectomy in monkeys , 1973, Experimental Brain Research.

[11]  A. Grantyn,et al.  Neural network simulations of the primate oculomotor system. V. Eye–head gaze shifts , 2010, Biological Cybernetics.

[12]  Masahiko Fujita,et al.  Selective and delay adaptation of human saccades. , 2002, Brain research. Cognitive brain research.

[13]  E. Blum,et al.  The Mathematical Theory of Optimal Processes. , 1963 .

[14]  J. W. Wolfe,et al.  Time-Optimal Control of Saccadic Eye Movements , 1987, IEEE Transactions on Biomedical Engineering.

[15]  Eliana M. Klier,et al.  The superior colliculus encodes gaze commands in retinal coordinates , 2001, Nature Neuroscience.

[16]  Javier F. Medina,et al.  Timing Mechanisms in the Cerebellum: Testing Predictions of a Large-Scale Computer Simulation , 2000, The Journal of Neuroscience.

[17]  Hanspeter A Mallot,et al.  Head and eye movements and the role of memory limitations in a visual search paradigm. , 2008, Journal of vision.

[18]  R. Wurtz,et al.  Reversible inactivation of monkey superior colliculus. II. Maps of saccadic deficits. , 1998, Journal of neurophysiology.

[19]  W. Becker The neurobiology of saccadic eye movements. Metrics. , 1989, Reviews of oculomotor research.

[20]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[21]  L. Optican,et al.  Slow saccades in spinocerebellar degeneration. , 1976, Archives of neurology.

[22]  A. Fuchs,et al.  The characteristics and neuronal substrate of saccadic eye movement plasticity , 2004, Progress in Neurobiology.

[23]  E. Freedman Coordination of the eyes and head during visual orienting , 2008, Experimental Brain Research.

[24]  Cornelius Weber,et al.  A neural model for the adaptive control of saccadic eye movements , 2009, 2009 International Joint Conference on Neural Networks.

[25]  A. Straube,et al.  The Effect of Cerebellar Midline Lesions on Eye Movements , 1995 .

[26]  P. Dean,et al.  The cerebellar microcircuit as an adaptive filter: experimental and computational evidence , 2010, Nature Reviews Neuroscience.

[27]  R. Tomlinson,et al.  Combined eye-head gaze shifts in the primate. II. Interactions between saccades and the vestibuloocular reflex. , 1986, Journal of neurophysiology.

[28]  Robijanto Soetedjo,et al.  Complex Spike Activity of Purkinje Cells in the Oculomotor Vermis during Behavioral Adaptation of Monkey Saccades , 2006, The Journal of Neuroscience.

[29]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[30]  A. Bastian Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[31]  R. Shadmehr,et al.  Temporal Discounting of Reward and the Cost of Time in Motor Control , 2010, The Journal of Neuroscience.

[32]  Adonis K Moschovakis,et al.  Optimal Control of Gaze Shifts , 2009, The Journal of Neuroscience.

[33]  R. Wurtz,et al.  Reversible inactivation of monkey superior colliculus. I. Curvature of saccadic trajectory. , 1998, Journal of neurophysiology.

[34]  K. Cullen,et al.  Quantitative analysis of abducens neuron discharge dynamics during saccadic and slow eye movements. , 1999, Journal of neurophysiology.

[35]  Shigeru Tanaka,et al.  A spiking network model for passage-of-time representation in the cerebellum , 2007, The European journal of neuroscience.

[36]  Robert H Wurtz,et al.  Saccade-related spread of activity across superior colliculus may arise from asymmetry of internal connections. , 2006, Journal of neurophysiology.

[37]  M. Kawato,et al.  Change in neuronal firing patterns in the process of motor command generation for the ocular following response. , 2001, Journal of neurophysiology.

[38]  A. K. Moschovakis,et al.  Neural network simulations of the primate oculomotor system , 2004, Biological Cybernetics.

[39]  A. Poznyak,et al.  The Maximum Principle , 2012 .

[40]  D. Sparks,et al.  Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys. , 1997, Journal of neurophysiology.

[41]  Christian Quaia,et al.  Distributed Model of Collicular and Cerebellar Function during Saccades , 2002, Annals of the New York Academy of Sciences.

[42]  R. Wurtz,et al.  The Neurobiology of Saccadic Eye Movements , 1989 .

[43]  H. Collewijn,et al.  Binocular co‐ordination of human horizontal saccadic eye movements. , 1988, The Journal of physiology.

[44]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[45]  Edward G. Freedman,et al.  Interactions between eye and head control signals can account for movement kinematics , 2001, Biological Cybernetics.

[46]  Guy Wallis,et al.  The prototype effect revisited: Evidence for an abstract feature model of face recognition. , 2008, Journal of vision.

[47]  E. Keller Accommodative vergence in the alert monkey. Motor unit analysis. , 1973, Vision research.

[48]  S. Gielen,et al.  A quantitative analysis of generation of saccadic eye movements by burst neurons. , 1981, Journal of neurophysiology.

[49]  Robert E. Dorsey,et al.  Genetic algorithms for estimation problems with multiple optima , 1995 .

[50]  Kuniharu Arai,et al.  A model of the saccade-generating system that accounts for trajectory variations produced by competing visual stimuli , 2004, Biological Cybernetics.

[51]  C. Harris,et al.  The Spectral Main Sequence of Human Saccades , 1999, The Journal of Neuroscience.

[52]  P. Thier,et al.  Saccadic Dysmetria and Adaptation after Lesions of the Cerebellar Cortex , 1999, The Journal of Neuroscience.

[53]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[54]  Peter König,et al.  Human eye-head co-ordination in natural exploration , 2007, Network.

[55]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[56]  D. Robinson,et al.  The vestibulo‐ocular reflex during human saccadic eye movements. , 1986, The Journal of physiology.

[57]  Christopher T. Noto,et al.  Temporal characteristics of error signals driving saccadic gain adaptation in the macaque monkey. , 2000, Journal of neurophysiology.

[58]  Irene Gottlob,et al.  Physiology and pathology of eye–head coordination , 2007, Progress in Retinal and Eye Research.

[59]  D. Guitton,et al.  Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. , 1987, Journal of neurophysiology.

[60]  Lance M. Optican,et al.  Superior colliculus cell types and models of saccade generation , 1994, Current Opinion in Neurobiology.

[61]  A. Opstal,et al.  Human eye-head coordination in two dimensions under different sensorimotor conditions , 1997, Experimental Brain Research.

[62]  D. Zambarbieri,et al.  Eye-head coordination toward auditory and visual targets in humans. , 1997, Journal of vestibular research : equilibrium & orientation.

[63]  T. Kitama,et al.  An Anatomical Substrate for the Spatiotemporal Transformation , 1998, The Journal of Neuroscience.

[64]  S. Grossberg,et al.  A Neural Model of Multimodal Adaptive Saccadic Eye Movement Control by Superior Colliculus , 1997, The Journal of Neuroscience.

[65]  Eye-head gaze shifts , 2011 .

[66]  D. Sparks,et al.  The Primate Superior Colliculus and the Control of Saccadic Eye Movements , 2003 .

[67]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[68]  L. Bittner L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, E. F. Mishechenko, The Mathematical Theory of Optimal Processes. VIII + 360 S. New York/London 1962. John Wiley & Sons. Preis 90/– , 1963 .

[69]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[70]  L. M. Sonneborn,et al.  The Bang-Bang Principle for Linear Control Systems , 1964 .

[71]  Edward G. Freedman,et al.  Coordination of the eyes and head: movement kinematics , 2000, Experimental Brain Research.

[72]  D L Sparks,et al.  Activity of cells in the deeper layers of the superior colliculus of the rhesus monkey: evidence for a gaze displacement command. , 1997, Journal of neurophysiology.

[73]  J. V. Van Gisbergen,et al.  Skewness of saccadic velocity profiles: a unifying parameter for normal and slow saccades. , 1987, Vision research.

[74]  David L. Sparks,et al.  ■ REVIEW : The Primate Superior Colliculus and the Control of Saccadic Eye Movements , 1996 .

[75]  J. Bradshaw,et al.  Hypometric primary saccades and increased variability in visually-guided saccades in Huntington’s disease , 2003, Neuropsychologia.

[76]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[77]  Florentin Wörgötter,et al.  ISO Learning Approximates a Solution to the Inverse-Controller Problem in an Unsupervised Behavioral Paradigm , 2003, Neural Computation.

[78]  J. J. Eggermont,et al.  Reconstruction of neural control signals for saccades based on an inverse method , 1985, Vision Research.

[79]  D. Munoz,et al.  Gaze control in the cat: studies and modeling of the coupling between orienting eye and head movements in different behavioral tasks. , 1990, Journal of neurophysiology.

[80]  R. Tomlinson,et al.  Combined eye-head gaze shifts in the primate. I. Metrics. , 1986, Journal of neurophysiology.

[81]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[82]  E. Bizzi,et al.  Effect of load disturbances during centrally initiated movements. , 1978, Journal of neurophysiology.