Reaction Time Correlations during Eye–Hand Coordination: Behavior and Modeling

During coordinated eye–hand movements, saccade reaction times (SRTs) and reach reaction times (RRTs) are correlated in humans and monkeys. Reaction times (RTs) measure the degree of movement preparation and can correlate with movement speed and accuracy. However, RTs can also reflect effector nonspecific influences, such as motivation and arousal. We use a combination of behavioral psychophysics and computational modeling to identify plausible mechanisms for correlations in SRTs and RRTs. To disambiguate nonspecific mechanisms from mechanisms specific to movement coordination, we introduce a dual-task paradigm in which a reach and a saccade are cued with a stimulus onset asynchrony (SOA). We then develop several variants of integrate-to-threshold models of RT, which postulate that responses are initiated when the neural activity encoding effector-specific movement preparation reaches a threshold. The integrator models formalize hypotheses about RT correlations and make predictions for how each RT should vary with SOA. To test these hypotheses, we trained three monkeys to perform the eye–hand SOA task and analyzed their SRTs and RRTs. In all three subjects, RT correlations decreased with increasing SOA duration. Additionally, mean SRT decreased with decreasing SOA, revealing facilitation of saccades with simultaneous reaches, as predicted by the model. These results are not consistent with the predictions of the models with common modulation or common input but are compatible with the predictions of a model with mutual excitation between two effector-specific integrators. We propose that RT correlations are not simply attributable to motivation and arousal and are a signature of coordination.

[1]  Jennifer A. Mather,et al.  Orienting to Targets by Looking and Pointing: Parallels and Interactions in Ocular and Manual Performance , 1985 .

[2]  C. C. A. M. Gielen,et al.  Coordination of fast eye and arm movements in a tracking task , 2004, Experimental Brain Research.

[3]  J D Crawford,et al.  Spatial transformations for eye-hand coordination. , 2004, Journal of neurophysiology.

[4]  Henry Szechtman,et al.  Longlasting consequences of chronic treatment with the dopamine agonist quinpirole for the undrugged behavior of rats , 1993, Behavioural Brain Research.

[5]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[6]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[8]  A. Riehle,et al.  The predictive value for performance speed of preparatory changes in neuronal activity of the monkey motor and premotor cortex , 1993, Behavioural Brain Research.

[9]  Pierre Jolicœur,et al.  All-or-none bottleneck versus capacity sharing accounts of the psychological refractory period phenomenon , 2002, Psychological research.

[10]  Anders Ledberg,et al.  Neurobiological Models of Two-Choice Decision Making Can Be Reduced to a One-Dimensional Nonlinear Diffusion Equation , 2008, PLoS Comput. Biol..

[11]  J. Todd,et al.  Reaction To Multiple Stimuli... , 2012 .

[12]  J. Deutsch Perception and Communication , 1958, Nature.

[13]  Leanne Boucher,et al.  Stopping eye and hand movements: Are the processes independent? , 2007, Perception & psychophysics.

[14]  J. D. Fisk,et al.  The organization of eye and limb movements during unrestricted reaching to targets in contralateral and ipsilateral visual space , 2004, Experimental Brain Research.

[15]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[16]  Xiao-Jing Wang,et al.  Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks , 2006, Nature Neuroscience.

[17]  M. Jeannerod,et al.  The coordination of eye, head, and arm movements during reaching at a single visual target , 2004, Experimental Brain Research.

[18]  W. G. Koster,et al.  The psychological refractory period , 1966 .

[19]  C. L. M. The Psychology of Attention , 1890, Nature.

[20]  H Bekkering,et al.  Coordinated control of eye and hand movements in dynamic reaching. , 2002, Human movement science.

[21]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[22]  Philip L. Smith Psychophysically principled models of visual simple reaction time. , 1995 .

[23]  M. Jeannerod,et al.  Optimal response of eye and hand motor systems in pointing at a visual target , 1979, Biological Cybernetics.

[24]  Klaus-Peter Hoffmann,et al.  Target selection in eye–hand coordination: Do we reach to where we look or do we look to where we reach? , 2005, Experimental Brain Research.

[25]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[26]  D. McCormick Cholinergic and noradrenergic modulation of thalamocortical processing , 1989, Trends in Neurosciences.

[27]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[28]  B. Fischer,et al.  Eye-hand-coordination in man: A reaction time study , 1986, Biological Cybernetics.

[29]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[30]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[31]  K. Hoffmann,et al.  Influence of arm movements on saccades in humans , 2000, The European journal of neuroscience.

[32]  Louise S. Delicato,et al.  Acetylcholine contributes through muscarinic receptors to attentional modulation in V1 , 2008, Nature.

[33]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[34]  K. Vahala Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[35]  E. T. Klemmer Simple reaction time as a function of time uncertainty. , 1957, Journal of experimental psychology.

[36]  M. C. Smith,et al.  Theories of the psychological refractory period. , 1967, Psychological bulletin.

[37]  Michael E. Hasselmo,et al.  Unraveling the attentional functions of cortical cholinergic inputs: interactions between signal-driven and cognitive modulation of signal detection , 2005, Brain Research Reviews.

[38]  I. Stilitz,et al.  Conditional Probability and Components of RT in the Variable Foreperiod Experiment , 1972, The Quarterly journal of experimental psychology.

[39]  D. Navon,et al.  Queuing or Sharing? A Critical Evaluation of the Single-Bottleneck Notion , 2002, Cognitive Psychology.

[40]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[41]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[42]  D P Carey,et al.  Eye–hand coordination: Eye to hand or hand to eye? , 2000, Current Biology.

[43]  A. Diederich Intersensory facilitation of reaction time: evaluation of counter and diffusion coactivation models , 1995 .

[44]  Joshua C. Brumberg,et al.  A quantitative population model of whisker barrels: Re-examining the Wilson-Cowan equations , 1996, Journal of Computational Neuroscience.

[45]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[47]  R S Nickerson,et al.  Response Time to the Second of Two Successive Signals as a Function of Absolute and Relative Duration of Intersignal Interval , 1965, Perceptual and motor skills.

[48]  Ruth Maulucci,et al.  Visually triggered eye-arm movements in man , 2004, Experimental Brain Research.

[49]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[50]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[51]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[52]  Jos J. Adam,et al.  Reaction time latencies of eye and hand movements in single- and dual-task conditions , 2004, Experimental Brain Research.

[53]  Daniel J Amittt Effective neurons and attractor neural networks in cortical environment , 1992 .

[54]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[55]  Honeycutt,et al.  Stochastic Runge-Kutta algorithms. I. White noise. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[56]  J I Gold,et al.  On diffusion processes with variable drift rates as models for decision making during learning , 2008, New journal of physics.

[57]  Rafal Bogacz,et al.  Parameterization of connectionist models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[58]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[59]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[60]  A. Welford THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[61]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.