Decoding go/no-go decisions from eye movements.

Neural activity in brain areas involved in the planning and execution of eye movements predicts the outcome of an upcoming perceptual decision. Many real-world decisions, such as whether to swing at a baseball pitch, are accompanied by characteristic eye-movement behavior. Here we ask whether human eye-movement kinematics can sensitively predict decision outcomes in a go/no-go task requiring rapid interceptive hand movements. Observers (n = 45) viewed a moving target that passed through or missed a designated strike box. Critically, the target disappeared briefly after launch, and observers had to predict the target's trajectory, withholding a hand movement if it missed (no-go) or intercepting inside the strike box (go). We found that go/no-go decisions were reflected in distinct eye-movement responses on a trial-by-trial basis: Eye-position error and targeting-saccade dynamics predicted decision outcome with 76% accuracy across conditions. Model prediction accuracy was related to observers' decision accuracy across different levels of task difficulty and sensory-signal strength. Our findings suggest that eye movements provide a sensitive and continuous readout of internal neural decision-making processes and reflect decision-task requirements in human observers.

[1]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[2]  Shun-nan Yang,et al.  Supplementary eye field activity reflects a decision rule governing smooth pursuit but not the decision. , 2010, Journal of neurophysiology.

[3]  Maureen A. Hagan,et al.  Only Coherent Spiking in Posterior Parietal Cortex Coordinates Looking and Reaching , 2012, Neuron.

[4]  Andreas K. Engel,et al.  Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making , 2009, Current Biology.

[5]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[6]  Max Kuhn,et al.  Building Predictive Models in R Using the caret Package , 2008 .

[7]  J. Gold,et al.  Distinct Representations of a Perceptual Decision and the Associated Oculomotor Plan in the Monkey Lateral Intraparietal Area , 2011, The Journal of Neuroscience.

[8]  J D Crawford,et al.  Spatial transformations for eye-hand coordination. , 2004, Journal of neurophysiology.

[9]  Miriam Spering,et al.  Eye movement accuracy determines natural interception strategies. , 2016, Journal of vision.

[10]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[13]  Alex R. Wade,et al.  An Oculomotor Decision Process Revealed by Functional Magnetic Resonance Imaging , 2006, The Journal of Neuroscience.

[14]  Michele A. Basso,et al.  Modulation of neuronal activity by target uncertainty , 1997, Nature.

[15]  M. Siegel,et al.  Motor cortex activity predicts response alternation during sensorimotor decisions , 2016, Nature Communications.

[16]  W T Newsome,et al.  Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task. , 2001, Journal of neurophysiology.

[17]  M. Platt,et al.  Neural correlates of decisions , 2002, Current Opinion in Neurobiology.

[18]  J. F. Soechting,et al.  Target Interception: Hand–Eye Coordination and Strategies , 2007, The Journal of Neuroscience.

[19]  Timothy D. Hanks,et al.  Perceptual Decision Making in Rodents, Monkeys, and Humans , 2017, Neuron.

[20]  Jos J. Adam,et al.  Reaction time latencies of eye and hand movements in single- and dual-task conditions , 2004, Experimental Brain Research.

[21]  M. Sommer,et al.  Neuronal correlates of visual time perception at brief timescales , 2013, Proceedings of the National Academy of Sciences.

[22]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[23]  W. Newsome,et al.  Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Eli Brenner,et al.  Accumulating visual information for action. , 2017, Progress in brain research.

[25]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[26]  Jeff B. Pelz,et al.  Predictive eye movements in natural vision , 2011, Experimental Brain Research.

[27]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[28]  Kathryn Bonnen,et al.  Beyond Trial-Based Paradigms: Continuous Behavior, Ongoing Neural Activity, and Natural Stimuli , 2018, The Journal of Neuroscience.

[29]  E. McSorley,et al.  Saccadic eye movements as an index of perceptual decision-making , 2009, Experimental Brain Research.

[30]  D. Ballard,et al.  Goal-directed arm movements change eye-head coordination , 1996, Experimental Brain Research.

[31]  John H R Maunsell,et al.  Potential confounds in estimating trial-to-trial correlations between neuronal response and behavior using choice probabilities. , 2012, Journal of neurophysiology.

[32]  Martin V. Butz,et al.  It's in the eyes: Planning precise manual actions before execution. , 2016, Journal of vision.

[33]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[34]  L. Selen,et al.  Deliberation in the Motor System: Reflex Gains Track Evolving Evidence Leading to a Decision , 2012, The Journal of Neuroscience.

[35]  Sung Jun Joo,et al.  Decision-related perturbations of decision-irrelevant eye movements , 2016, Proceedings of the National Academy of Sciences.

[36]  M. Hayhoe Vision and Action. , 2017, Annual review of vision science.

[37]  J Randall Flanagan,et al.  Different gaze strategies during eye versus hand tracking of a moving target , 2018, Scientific Reports.

[38]  Anthony R. Dickinson,et al.  Eye-hand coordination: saccades are faster when accompanied by a coordinated arm movement. , 2002, Journal of neurophysiology.

[39]  J. Gold,et al.  The Basal Ganglia’s Contributions to Perceptual Decision Making , 2013, Neuron.

[40]  Timothy J. Pleskac,et al.  Neural correlates of evidence accumulation in a perceptual decision task. , 2011, Journal of neurophysiology.

[41]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[42]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[43]  A. Bahill,et al.  Why can't batters keep their eyes on the ball? , 1984 .

[44]  Gerald N. Pho,et al.  Task-dependent representations of stimulus and choice in mouse parietal cortex , 2017 .

[45]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[46]  Hakwan Lau,et al.  A Role for the Superior Colliculus in Decision Criteria , 2018, Neuron.

[47]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[48]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[49]  J. Badler,et al.  Trajectory interpretation by supplementary eye field neurons during ocular baseball. , 2005, Journal of neurophysiology.

[50]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[51]  Guillaume Leclercq,et al.  Accounting for direction and speed of eye motion in planning visually guided manual tracking. , 2013, Journal of neurophysiology.

[52]  Il Memming Park,et al.  Functional dissection of signal and noise in MT and LIP during decision-making , 2017, Nature Neuroscience.

[53]  M. Missal,et al.  What triggers catch-up saccades during visual tracking? , 2002, Journal of Neurophysiology.

[54]  Eun Jung Hwang,et al.  Spatial and Temporal Eye–Hand Coordination Relies on the Parietal Reach Region , 2014, The Journal of Neuroscience.

[55]  Jeffrey D Schall,et al.  Macrocircuits: Decision Networks This Review Comes from a Themed Issue on Macrocircuits Decide That — Categorization and Stimulus Selection , 2022 .

[56]  Shun-Nan Yang,et al.  Contrasting the roles of the supplementary and frontal eye fields in ocular decision making. , 2014, Journal of neurophysiology.

[57]  R. Andersen,et al.  Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits , 2009, Neuron.

[58]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[59]  J. Lappin,et al.  The detection of coherence in moving random-dot patterns , 1976, Vision Research.

[60]  Jing Chen,et al.  Role of motor execution in the ocular tracking of self-generated movements. , 2016, Journal of neurophysiology.