Adaptive Control of Saccades via Internal Feedback

Ballistic movements like saccades require the brain to generate motor commands without the benefit of sensory feedback. Despite this, saccades are remarkably accurate. Theory suggests that this accuracy arises because the brain relies on an internal forward model that monitors the motor commands, predicts their sensory consequences, and corrects eye trajectory midflight. If control of saccades relies on a forward model, then the forward model should adapt whenever its predictions fail to match sensory feedback at the end of the movement. Using optimal feedback control theory, we predicted how this adaptation should alter saccade trajectories. We trained subjects on a paradigm in which the horizontal target jumped vertically during the saccade. With training, the final position of the saccade moved toward the second target. However, saccades became increasingly curved, i.e., suboptimal, as oculomotor commands were corrected on-line to steer the eye toward the second target. The adaptive response had two components: (1) the motor commands that initiated the saccades changed slowly, aiming the saccade closer to the jumped target. The adaptation of these earliest motor commands displayed little forgetting during the rest periods. (2) Late in saccade trajectory, another adaptive response steered it still closer to the jumped target, producing curvature. Adaptation of these late motor commands showed near-complete forgetting during the rest periods. The two components adapted at different timescales, with the late-acting component displaying much faster rates. It appears that in controlling saccades, the brain relies on an internal feedback that has the characteristics of a fast-adapting forward model.

[1]  A. L. Yarbus Eye movements during the examination of complicated objects. , 1961, Biofizika.

[2]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[3]  D. Robinson,et al.  Absence of a stretch reflex in extraocular muscles of the monkey. , 1971, Journal of neurophysiology.

[4]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[5]  D G Cogan,et al.  Ocular motor abnormalities in hereditary cerebellar ataxia. , 1976, Brain : a journal of neurology.

[6]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[7]  T. Vilis,et al.  Characteristics of saccadic dysmetria in monkeys during reversible lesions of medial cerebellar nuclei. , 1981, Journal of neurophysiology.

[8]  D. Sparks,et al.  Corollary discharge provides accurate eye position information to the oculomotor system. , 1983, Science.

[9]  A. Fuchs,et al.  Fatigue resistance of human extraocular muscles. , 1983, Journal of neurophysiology.

[10]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[11]  D. A. Robinson The systems approach to the oculomotor system , 1986, Vision Research.

[12]  C. Kennard,et al.  Predictive eye saccades are different from visually triggered saccades , 1987, Vision Research.

[13]  H. Deubel ADAPTIVITY OF GAIN AND DIRECTION IN OBLIQUE SACCADES1 , 1987 .

[14]  H. Collewijn,et al.  Binocular co‐ordination of human horizontal saccadic eye movements. , 1988, The Journal of physiology.

[15]  K. Ohtsuka,et al.  Burst discharges of mossy fibers in the oculomotor vermis of macaque monkeys during saccadic eye movements , 1992, Neuroscience Research.

[16]  A. Fuchs,et al.  Role of the caudal fastigial nucleus in saccade generation. II. Effects of muscimol inactivation. , 1993, Journal of neurophysiology.

[17]  A. Fuchs,et al.  Role of the caudal fastigial nucleus in saccade generation. I. Neuronal discharge pattern. , 1993, Journal of neurophysiology.

[18]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[19]  Heiner Deubel,et al.  Rapid gain adaptation affects the dynamics of saccadic eye movements in humans , 1995, Vision Research.

[20]  Focal attentional level while tracking a smoothly moving target influences saccadic dynamics , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[21]  K Ohtsuka,et al.  Transcranial magnetic stimulation over the posterior cerebellum during visually guided saccades in man. , 1995, Brain : a journal of neurology.

[22]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[23]  W. T. Thach,et al.  Cerebellar ataxia: abnormal control of interaction torques across multiple joints. , 1996, Journal of neurophysiology.

[24]  N J Gandhi,et al.  Endpoint accuracy in saccades interrupted by stimulation in the omnipause region in monkey , 1996, Visual Neuroscience.

[25]  R H Wurtz,et al.  Activity of neurons in monkey superior colliculus during interrupted saccades. , 1996, Journal of neurophysiology.

[26]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[27]  H. Kawakami,et al.  Molecular features of the CAG repeats of spinocerebellar ataxia 6 (SCA6). , 1997, Human molecular genetics.

[28]  P. van Donkelaar,et al.  Eye-hand interactions during goal-directed pointing movements. , 1997, Neuroreport.

[29]  J. A. Domingo,et al.  Quantal organization of reflex and conditioned eyelid responses. , 1997, Journal of neurophysiology.

[30]  A. Fuchs,et al.  Characteristics of saccadic gain adaptation in rhesus macaques. , 1997, Journal of neurophysiology.

[31]  R J Leigh,et al.  Properties of horizontal saccades accompanied by blinks. , 1998, Journal of neurophysiology.

[32]  H. Sawa,et al.  Neuropathological and molecular studies of spinocerebellar ataxia type 6 (SCA6) , 1998, Acta Neuropathologica.

[33]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[34]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[35]  D. Zee,et al.  Effects of lesions of the oculomotor vermis on eye movements in primate: saccades. , 1998, Journal of neurophysiology.

[36]  N. J. Gandhi,et al.  Activity of the brain stem omnipause neurons during saccades perturbed by stimulation of the primate superior colliculus. , 1999, Journal of neurophysiology.

[37]  L. Optican,et al.  Model of the control of saccades by superior colliculus and cerebellum. , 1999, Journal of neurophysiology.

[38]  Christopher T. Noto,et al.  Characteristics of simian adaptation fields produced by behavioral changes in saccade size and direction. , 1999, Journal of neurophysiology.

[39]  Kaoru Yoshida,et al.  Saccade-related inhibitory input to pontine omnipause neurons: an intracellular study in alert cats. , 1999, Journal of neurophysiology.

[40]  H. Siebner,et al.  Trigeminal sensory input elicited by electric or magnetic stimulation interferes with the central motor drive to the intrinsic hand muscles , 1999, Clinical Neurophysiology.

[41]  P. Thier,et al.  Saccadic Dysmetria and Adaptation after Lesions of the Cerebellar Cortex , 1999, The Journal of Neuroscience.

[42]  Á. Esteban A neurophysiological approach to brainstem reflexes. Blink reflex , 1999, Neurophysiologie Clinique/Clinical Neurophysiology.

[43]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[44]  I. Kanazawa,et al.  Clinical, neuropathological, and molecular study in two families with spinocerebellar ataxia type 6 (SCA6) , 1999, Journal of neurology, neurosurgery, and psychiatry.

[45]  J. Rothwell,et al.  Patterned ballistic movements triggered by a startle in healthy humans , 1999, The Journal of physiology.

[46]  A J Van Opstal,et al.  Blink-perturbed saccades in monkey. II. Superior colliculus activity. , 2000, Journal of neurophysiology.

[47]  Christian Quaia,et al.  Extent of compensation for variations in monkey saccadic eye movements , 2000, Experimental Brain Research.

[48]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[49]  J. Yelnik,et al.  Involvement of the cerebellar thalamus in human saccade adaptation , 2001, The European journal of neuroscience.

[50]  R. Dolan,et al.  Psychology: Reward value of attractiveness and gaze , 2001, Nature.

[51]  H. Deubel,et al.  Cerebellar lesions impair rapid saccade amplitude adaptation , 2001, Neurology.

[52]  M. Mauk,et al.  A Mechanism for Savings in the Cerebellum , 2001, The Journal of Neuroscience.

[53]  Christian Quaia,et al.  Distributed Model of Collicular and Cerebellar Function during Saccades , 2002, Annals of the New York Academy of Sciences.

[54]  K. Hoffmann,et al.  Neural Mechanisms of Saccadic Suppression , 2002, Science.

[55]  Anthony R. Dickinson,et al.  Eye-hand coordination: saccades are faster when accompanied by a coordinated arm movement. , 2002, Journal of neurophysiology.

[56]  Michael I. Jordan,et al.  Sensorimotor adaptation of speech I: Compensation and adaptation. , 2002, Journal of speech, language, and hearing research : JSLHR.

[57]  Boris Barbour,et al.  Temporal Organization of Activity in the Cerebellar Cortex: A Manifesto for Synchrony , 2002, Annals of the New York Academy of Sciences.

[58]  Masahiko Fujita,et al.  Selective and delay adaptation of human saccades. , 2002, Brain research. Cognitive brain research.

[59]  A. Fuchs,et al.  Cerebellar Influences on Saccade Plasticity , 2002, Annals of the New York Academy of Sciences.

[60]  Liang Li,et al.  Tactile, acoustic and vestibular systems sum to elicit the startle reflex , 2002, Neuroscience & Biobehavioral Reviews.

[61]  Kaoru Yoshida,et al.  Saccadic dysmetria following inactivation of the primate fastigial oculomotor region , 2002, Neuroscience Letters.

[62]  C. Scudder,et al.  Adaptive modification of saccade size produces correlated changes in the discharges of fastigial nucleus neurons. , 2003, Journal of neurophysiology.

[63]  O. Hikosaka,et al.  Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus , 2003, The Journal of Neuroscience.

[64]  J. Movshon,et al.  Neuronal Adaptation to Visual Motion in Area MT of the Macaque , 2003, Neuron.

[65]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[66]  A. Opstal,et al.  Transfer of short-term adaptation in human saccadic eye movements , 2004, Experimental Brain Research.

[67]  H. Kornhuber,et al.  Natural and drug-induced variations of velocity and duration of human saccadic eye movements: Evidence for a control of the neural pulse generator by local feedback , 2004, Biological Cybernetics.

[68]  Stefano Ramat,et al.  Ocular oscillations generated by coupling of brainstem excitatory and inhibitory saccadic burst neurons , 2004 .

[69]  K. Honjo,et al.  Quantitative assessment of cerebral blood flow in genetically confirmed spinocerebellar ataxia type 6. , 2004, Archives of neurology.

[70]  J. A. Gisbergen,et al.  An analysis of curvature in fast and slow human saccades , 2004, Experimental Brain Research.

[71]  Dora E. Angelaki,et al.  Neurons compute internal models of the physical laws of motion , 2004, Nature.

[72]  Kaoru Yoshida,et al.  Memory of Learning Facilitates Saccadic Adaptation in the Monkey , 2004, The Journal of Neuroscience.

[73]  Lance M. Optican,et al.  Recovery of saccadic dysmetria following localized lesions in monkey superior colliculus , 2004, Experimental Brain Research.

[74]  D. Sparks,et al.  Deficits in saccades and fixation during muscimol inactivation of the caudal fastigial nucleus in the rhesus monkey. , 2004, Journal of neurophysiology.

[75]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[76]  Ka-Chun Siu,et al.  Saccadic Output Is Influenced by Limb Kinetics During Eye—Hand Coordination , 2004, Journal of motor behavior.

[77]  A. Fuchs,et al.  The characteristics and neuronal substrate of saccadic eye movement plasticity , 2004, Progress in Neurobiology.

[78]  A. Fuchs,et al.  Discharge of monkey nucleus reticularis tegmenti pontis neurons changes during saccade adaptation. , 2005, Journal of neurophysiology.

[79]  Wolfram Schultz,et al.  Rewarding properties of visual stimuli , 2005, Experimental Brain Research.

[80]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[81]  L. Chelazzi,et al.  The urgency to look: Prompt saccades to the benefit of perception , 2005, Vision Research.

[82]  J. Mayhew,et al.  How Visual Stimuli Activate Dopaminergic Neurons at Short Latency , 2005, Science.

[83]  Lance M Optican,et al.  Sensorimotor Transformation for Visually Guided Saccades , 2005, Annals of the New York Academy of Sciences.

[84]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[85]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[86]  A. Berthoz,et al.  From brainstem to cortex: Computational models of saccade generation circuitry , 2005, Progress in Neurobiology.

[87]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[88]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[89]  R. Shadmehr,et al.  Why Does the Brain Predict Sensory Consequences of Oculomotor Commands? Optimal Integration of the Predicted and the Actual Sensory Feedback , 2006, The Journal of Neuroscience.

[90]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[91]  S. Itohara,et al.  Memory trace of motor learning shifts transsynaptically from cerebellar cortex to nuclei for consolidation , 2006, Neuroscience.

[92]  M. Mauk,et al.  Learning-Induced Plasticity in Deep Cerebellar Nucleus , 2006, The Journal of Neuroscience.

[93]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[94]  T. Ebner,et al.  Force field effects on cerebellar Purkinje cell discharge with implications for internal models , 2006, Nature Neuroscience.

[95]  M. Frens,et al.  Saccade adaptation in Williams-Beuren Syndrome. , 2006, Investigative ophthalmology & visual science.

[96]  Stephen V. Shepherd,et al.  Social status gates social attention in monkeys , 2006, Current Biology.

[97]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[98]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[99]  Cengizhan Ozturk,et al.  Real-Time Magnetic Resonance Imaging–Guided Endovascular Recanalization of Chronic Total Arterial Occlusion in a Swine Model , 2006, Circulation.

[100]  Jay A. Edelman,et al.  Antisaccade velocity, but not latency, results from a lack of saccade visual guidance , 2006, Vision Research.

[101]  Benjamin Y Hayden,et al.  Economic principles motivating social attention in humans , 2007, Proceedings of the Royal Society B: Biological Sciences.

[102]  Albert F Fuchs,et al.  Activity changes in monkey superior colliculus during saccade adaptation. , 2007, Journal of neurophysiology.

[103]  Nava Rubin,et al.  Brain areas selective for both observed and executed movements. , 2007, Journal of neurophysiology.

[104]  Shun-ichi Amari,et al.  A computational study of synaptic mechanisms of partial memory transfer in cerebellar vestibulo-ocular-reflex learning , 2008, Journal of Computational Neuroscience.

[105]  David M Milstein,et al.  The Influence of Expected Value on Saccadic Preparation , 2007, The Journal of Neuroscience.

[106]  J. O'Doherty,et al.  Neural coding of reward-prediction error signals during classical conditioning with attractive faces. , 2007, Journal of neurophysiology.

[107]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[108]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[109]  O. Hikosaka Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement , 2007, Annals of the New York Academy of Sciences.

[110]  M. Doherty,et al.  The control of attention to faces. , 2007, Journal of vision.

[111]  A. Chauvin,et al.  Control of sensorimotor variability by consequences. , 2007, Journal of neurophysiology.

[112]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[113]  K. Johnston,et al.  Neurophysiology and neuroanatomy of reflexive and voluntary saccades in non-human primates , 2008, Brain and Cognition.

[114]  Reza Shadmehr,et al.  Changes in Control of Saccades during Gain Adaptation , 2008, The Journal of Neuroscience.

[115]  Sarah E. Criscimagna-Hemminger,et al.  Consolidation Patterns of Human Motor Memory , 2008, The Journal of Neuroscience.

[116]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[117]  Y. Shinoda,et al.  Neural circuits for triggering saccades in the brainstem. , 2008, Progress in brain research.

[118]  Peter Thier,et al.  Cerebellar-dependent motor learning is based on pruning a Purkinje cell population response , 2008, Proceedings of the National Academy of Sciences.

[119]  L. Optican,et al.  Mechanism of interrupted saccades in patients with late-onset Tay-Sachs disease. , 2008, Progress in brain research.

[120]  P. Thier,et al.  Reduced saccadic resilience and impaired saccadic adaptation due to cerebellar disease , 2007, The European journal of neuroscience.

[121]  Kaoru Yoshida,et al.  Premotor inhibitory neurons carry signals related to saccade adaptation in the monkey. , 2008, Journal of neurophysiology.

[122]  Joseph J. Paton,et al.  Moment-to-Moment Tracking of State Value in the Amygdala , 2008, The Journal of Neuroscience.

[123]  R. Shadmehr,et al.  The intrinsic value of visual information affects saccade velocities , 2009, Experimental Brain Research.

[124]  Konrad Paul Kording,et al.  Relevance of error: what drives motor adaptation? , 2009, Journal of neurophysiology.

[125]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[126]  R. Shadmehr,et al.  Cerebellar Contributions to Adaptive Control of Saccades in Humans , 2009, The Journal of Neuroscience.

[127]  A. V. van Opstal,et al.  Differential effects of reflex blinks on saccade perturbations in humans. , 2010, Journal of neurophysiology.

[128]  C. Busettini,et al.  Macaque pontine omnipause neurons play no direct role in the generation of eye blinks. , 2010, Journal of neurophysiology.