Reinforcing saccadic amplitude variability.

Saccadic endpoint variability is often viewed as the outcome of neural noise occurring during sensorimotor processing. However, part of this variability might result from operant learning. We tested this hypothesis by reinforcing dispersions of saccadic amplitude distributions, while maintaining constant their medians. In a first experiment we reinforced the least frequent saccadic amplitudes to increase variability, and then reinforced the central part of the amplitude distributions to reduce variability. The target was placed at a constant distance from the fovea after the saccade to maintain the postsaccadic visual signal constant and an auditory reinforcement was delivered depending on saccadic amplitude. The second experiment tested the effects of the contingency. We reinforced high levels of variability in 4 participants, whereas 4 other participants were assigned to a yoked control group. On average, saccadic amplitude standard deviations were doubled while the medians remained mostly unchanged in the experimental participants in both experiments, and variability returned to baseline level when low variability was reinforced. In the control group no consistent changes in amplitude distributions were observed. These results, showing that variability can be reinforced, challenge the idea of a stochastic neural noise. We instead propose that selection processes constrain saccadic amplitude distributions.

[1]  Katharina Havermann,et al.  The influence of the consistency of postsaccadic visual errors on saccadic adaptation. , 2010, Journal of neurophysiology.

[2]  Angel R. Martinez,et al.  Computational Statistics Handbook with MATLAB , 2001 .

[3]  B. Skinner,et al.  Giving up the ghost , 1981, Behavioral and Brain Sciences.

[4]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[5]  F R Robinson,et al.  Visual error is the stimulus for saccade gain adaptation. , 2001, Brain research. Cognitive brain research.

[6]  A. Neuringer Can people behave "randomly?": The role of feedback. , 1986 .

[7]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[8]  L. Dell’Osso,et al.  Saccadic system plasticity in humans , 1978, Annals of neurology.

[9]  A. Neuringer,et al.  Reinforcing variability in adolescents with autism. , 2000, Journal of applied behavior analysis.

[10]  D. B. Henson,et al.  Investigation into corrective saccadic eye movements for refixation amplitudes of 10 degrees and below , 1979, Vision Research.

[11]  P. Sturmey,et al.  Schedule-Induced and Operant Mechanisms that Influence Response Variability: A Review and Implications for Future Investigations , 2007 .

[12]  D M Baer,et al.  Social control of form diversity and the emergence of new forms in children's blockbuilding. , 1973, Journal of applied behavior analysis.

[13]  R. P. Ingvaldsen,et al.  Modern views on motor skill learning are not ‘representative’! , 1997 .

[14]  R. Krauzlis,et al.  Effects of learning on smooth pursuit during transient disappearance of a visual target. , 2003, Journal of neurophysiology.

[15]  Eileen Kowler,et al.  The control of saccadic adaptation: implications for the scanning of natural visual scenes , 2000, Vision Research.

[16]  A. Neuringer,et al.  Modifying Behavioral Variability in Moderately Depressed Students , 2003, Behavior modification.

[17]  Alicia Grunow,et al.  Learning to vary and varying to learn , 2002, Psychonomic bulletin & review.

[18]  G. Kommerell,et al.  Adaptive programming of phasic and tonic components in saccadic eye movements. Investigations of patients with abducens palsy. , 1976, Investigative ophthalmology.

[19]  A. Fuchs,et al.  Saccadic gain modification: visual error drives motor adaptation. , 1998, Journal of neurophysiology.

[20]  A. Neuringer Choosing to Vary and Repeat , 1992 .

[21]  A. Machado Operant conditioning of behavioral variability using a percentile reinforcement schedule. , 1989, Journal of the experimental analysis of behavior.

[22]  F. Robinson,et al.  Non-visual information does not drive saccade gain adaptation in monkeys , 2002, Brain Research.

[23]  J. Pretz,et al.  Can the promise of reward increase creativity? , 1998, Journal of personality and social psychology.

[24]  A. Fuchs,et al.  The characteristics and neuronal substrate of saccadic eye movement plasticity , 2004, Progress in Neurobiology.

[25]  G. Galbicka Shaping in the 21st century: Moving percentile schedules into applied settings. , 1994, Journal of applied behavior analysis.

[26]  A. Neuringer,et al.  Variability is an operant. , 1985 .

[27]  R. J. Beers The Sources of Variability in Saccadic Eye Movements , 2007 .

[28]  A. Chauvin,et al.  Control of sensorimotor variability by consequences. , 2007, Journal of neurophysiology.

[29]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[30]  A. Neuringer Operant Variability and the Power of Reinforcement. , 2009 .

[31]  P. D. Stokes Learned variability , 1995 .

[32]  Scott E. Bevans,et al.  Effect of visual error size on saccade adaptation in monkey. , 2003, Journal of neurophysiology.

[33]  J. Maes,et al.  Human operant learning under concurrent reinforcement of response variability , 2006 .

[34]  D. Pélisson,et al.  Sensorimotor adaptation of saccadic eye movements , 2010, Neuroscience & Biobehavioral Reviews.

[35]  K. Campbell,et al.  A neural correlate of response bias in monkey caudate nucleus , 2022 .

[36]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[37]  C. Harris,et al.  Does saccadic undershoot minimize saccadic flight-time? A Monte-Carlo study , 1995, Vision Research.

[38]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[39]  R. Carpenter,et al.  The influence of urgency on decision time , 2000, Nature Neuroscience.

[40]  R. J. Beers Correction: Saccadic Eye Movements Minimize the Consequences of Motor Noise , 2008 .

[41]  A. Neuringer Reinforced variation and selection , 1993 .

[42]  佐藤 真琴,et al.  Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement , 2002 .

[43]  L. Madelain,et al.  Operant conditioning of the visual smooth pursuit in young infants , 1999, Behavioural Processes.

[44]  J W Donahoe,et al.  A selectionist approach to reinforcement. , 1993, Journal of the experimental analysis of behavior.

[45]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[46]  A. Neuringer,et al.  Reinforced variability and operant learning. , 2000, Journal of experimental psychology. Animal behavior processes.

[47]  S. C. Mclaughlin Parametric adjustment in saccadic eye movements , 1967 .

[48]  P. Balsam,et al.  An optimal period for setting sustained variability levels , 2001, Psychonomic bulletin & review.

[49]  D. Blough The reinforcement of least-frequent interresponse times. , 1966, Journal of the experimental analysis of behavior.

[50]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[51]  A. Neuringer Operant variability: Evidence, functions, and theory , 2002, Psychonomic bulletin & review.

[52]  K. Lattal,et al.  Variation, repetition, and choice. , 2005, Journal of the experimental analysis of behavior.

[53]  O. Hikosaka,et al.  Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus , 2003, The Journal of Neuroscience.

[54]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[55]  A. Machado Behavioral variability and frequency-dependent selection. , 1992, Journal of the experimental analysis of behavior.

[56]  Richard N. Aslin,et al.  Saccadic localization of visual targets by the very young human infant , 1975 .

[57]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[58]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[59]  L. Optican,et al.  Adaptive response to ocular muscle weakness in human pursuit and saccadic eye movements. , 1985, Journal of neurophysiology.

[60]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[61]  P. N. Chase,et al.  Effects of response variability on the sensitivity of rule-governed behavior. , 1990, Journal of the experimental analysis of behavior.

[62]  M. Kautz,et al.  Response acquisition under targeted percentile schedules: a continuing quandary for molar models of operant behavior. , 1993, Journal of the experimental analysis of behavior.

[63]  L. Chelazzi,et al.  The urgency to look: Prompt saccades to the benefit of perception , 2005, Vision Research.

[64]  A. Machado Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. , 1997, Journal of the experimental analysis of behavior.

[65]  Laurent Madelain,et al.  Saccadic adaptation: reinforcement can drive motor adaptation , 2010 .

[66]  Kae Nakamura,et al.  Role of Dopamine in the Primate Caudate Nucleus in Reward Modulation of Saccades , 2006, The Journal of Neuroscience.

[67]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[68]  L. Optican,et al.  Slow saccades in spinocerebellar degeneration. , 1976, Archives of neurology.

[69]  S Lebedev,et al.  Square-root relations between main saccadic parameters. , 1996, Investigative ophthalmology & visual science.

[70]  A. Hendrickson,et al.  A qualitative and quantitative analysis of the human fovea during development , 1986, Vision Research.

[71]  Robijanto Soetedjo,et al.  Distinct short-term and long-term adaptation to reduce saccade size in monkey. , 2006, Journal of neurophysiology.

[72]  K. Pryor,et al.  The creative porpoise: training for novel behavior. , 1969, Journal of the experimental analysis of behavior.

[73]  R. Shadmehr,et al.  The intrinsic value of visual information affects saccade velocities , 2009, Experimental Brain Research.