Eye-hand coordination during target selection in a pop-out visual search.

We examined the coordination of saccades and reaches in a visual search task in which monkeys were rewarded for reaching to an odd-colored target among distractors. Eye movements were unconstrained, and monkeys typically made one or more saccades before initiating a reach. Target selection for reaching and saccades was highly correlated with the hand and eyes landing near the same final stimulus both for correct reaches to the target and for incorrect reaches to a distractor. Incorrect reaches showed a bias in target selection: they were directed to the distractor in the same hemifield as the target more often than to other distractors. A similar bias was seen in target selection for the initial saccade in correct reaching trials with multiple saccades. We also examined the temporal coupling of saccades and reaches. In trials with a single saccade, a reaching movement was made after a fairly stereotyped delay. In multiple-saccade trials, a reach to the target could be initiated near or even before the onset of the final target-directed saccade. In these trials, the initial trajectory of the reach was often directed toward the fixated distractor before veering toward the target around the time of the final saccade. In virtually all cases, the eyes arrived at the target before the hand, and remained fixated until reach completion. Overall, these results are consistent with flexible temporal coupling of saccade and reach initiation, but fairly tight coupling of target selection for the two types of action.

[1]  Nava Rubin,et al.  Perceptual Completion across the Vertical Meridian and the Role of Early Visual Cortex , 2002, Neuron.

[2]  U. Sailer,et al.  Spatial and temporal aspects of eye-hand coordination across different tasks , 2000, Experimental Brain Research.

[3]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  K. Nakayama,et al.  Target selection in visual search as revealed by movement trajectories , 2008, Vision Research.

[5]  Bijan Pesaran,et al.  Free choice activates a decision circuit between frontal and parietal cortex , 2008, Nature.

[6]  H. Wilson,et al.  Dynamics of travelling waves in visual perception , 2001, Nature.

[7]  W T Newsome,et al.  Interhemispheric connections of visual cortex in the owl monkey, Aotus trivirgatus, and the bushbaby, Galago senegalensis , 1980, The Journal of comparative neurology.

[8]  Uta Sailer,et al.  Global effect of a nearby distractor on targeting eye and hand movements. , 2002, Journal of experimental psychology. Human perception and performance.

[9]  J. Kalaska,et al.  Simultaneous encoding of multiple potential reach directions in dorsal premotor cortex. , 2002, Journal of neurophysiology.

[10]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[11]  Jeffrey D. Schall,et al.  Neural basis of saccade target selection in frontal eye field during visual search , 1993, Nature.

[12]  L H Snyder,et al.  Saccade-related activity in the parietal reach region. , 2000, Journal of neurophysiology.

[13]  R. Andersen,et al.  Target Selection Signals for Arm Reaching in the Posterior Parietal Cortex , 2007, The Journal of Neuroscience.

[14]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[15]  W. Helsen,et al.  Coupling of Eye, Finger, Elbow, and Shoulder Movements During Manual Aiming , 2000, Journal of motor behavior.

[16]  S. Tipper,et al.  Reaching into cluttered visual environments: spatial and temporal influences of distracting objects. , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[17]  E. Keller,et al.  Short-term priming, concurrent processing, and saccade curvature during a target selection task in the monkey , 2001, Vision Research.

[18]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[19]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[20]  J. D. Fisk,et al.  The organization of eye and limb movements during unrestricted reaching to targets in contralateral and ipsilateral visual space , 2004, Experimental Brain Research.

[21]  S. Tipper,et al.  Reaching into cluttered visual environments: spatial and temporal influences of distracting objects. , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[22]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[23]  D. Elliott,et al.  Movement Trajectories in the Presence of a Distracting Stimulus: Evidence for a Response Activation Model of Selective Reaching , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[24]  H Bekkering,et al.  Coordinated control of eye and hand movements in dynamic reaching. , 2002, Human movement science.

[25]  J Tanji,et al.  Visually guided saccade versus eye-hand reach: contrasting neuronal activity in the cortical supplementary and frontal eye fields. , 1996, Journal of neurophysiology.

[26]  J. Findlay Saccade Target Selection During Visual Search , 1997, Vision Research.

[27]  Joo-Hyun Song,et al.  Target selection for visually-guided reaching in macaque , 2010 .

[28]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[29]  Peter H Schiller,et al.  Neural mechanisms underlying target selection with saccadic eye movements. , 2005, Progress in brain research.

[30]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[31]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[32]  Ken Nakayama,et al.  Automatic adjustment of visuomotor readiness. , 2007, Journal of vision.

[33]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[34]  K. Nakayama,et al.  Role of focal attention on latencies and trajectories of visually guided manual pointing. , 2006, Journal of vision.

[35]  A P Georgopoulos,et al.  Effects of optic flow in motor cortex and area 7a. , 2001, Journal of neurophysiology.

[36]  Eugene McSorley,et al.  Saccade target selection in visual search: accuracy improves when more distractors are present. , 2003, Journal of vision.

[37]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[38]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[39]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[40]  P. Cavanagh,et al.  A unilateral field advantage for detecting repeated elements , 2008, Perception & psychophysics.

[41]  Jos J. Adam,et al.  Interference between saccadic eye and goal-directed hand movements , 2004, Experimental Brain Research.

[42]  Joan N. Vickers,et al.  How far ahead do we look when required to step on specific locations in the travel path during locomotion? , 2002, Experimental Brain Research.

[43]  Anthony R. Dickinson,et al.  Eye-hand coordination: saccades are faster when accompanied by a coordinated arm movement. , 2002, Journal of neurophysiology.

[44]  Byounghoon Kim,et al.  Saccade Target Selection in the Superior Colliculus: A Signal Detection Theory Approach , 2008, The Journal of Neuroscience.

[45]  J. T. Massey,et al.  Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. , 1981, Journal of neurophysiology.

[46]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  N. P. Bichot,et al.  Priming in Macaque Frontal Cortex during Popout Visual Search: Feature-Based Facilitation and Location-Based Inhibition of Return , 2002, The Journal of Neuroscience.

[48]  Hansjörg Scherberger,et al.  Target selection for reaching and saccades share a similar behavioral reference frame in the macaque. , 2003, Journal of neurophysiology.

[49]  M. Hayhoe,et al.  Look-ahead fixations: anticipatory eye movements in natural tasks , 2007, Experimental Brain Research.

[50]  A. Georgopoulos Higher order motor control. , 1991, Annual review of neuroscience.

[51]  Klaus-Peter Hoffmann,et al.  Target selection in eye–hand coordination: Do we reach to where we look or do we look to where we reach? , 2005, Experimental Brain Research.

[52]  K. Nakayama,et al.  Fixation offset facilitates saccades and manual reaching for single but not multiple target displays , 2007, Experimental Brain Research.

[53]  M. Bravo,et al.  The role of attention in different visual-search tasks , 1992, Perception & psychophysics.

[54]  S. Tipper,et al.  Reaching affects saccade trajectories , 2000, Experimental Brain Research.

[55]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[56]  Uta Sailer,et al.  Implications of distracter effects for the organization of eye movements, hand movements, and perception. , 2002, Progress in brain research.

[57]  R. McPeek Incomplete suppression of distractor-related activity in the frontal eye field results in curved saccades. , 2010, Journal of neurophysiology.

[58]  J. F. Soechting,et al.  The Duncker illusion and eye-hand coordination. , 2001, Journal of neurophysiology.

[59]  N. P. Bichot,et al.  Saccade target selection in macaque during feature and conjunction visual search , 1999, Visual Neuroscience.

[60]  Paul Cisek,et al.  Neural activity in primary motor and dorsal premotor cortex in reaching tasks with the contralateral versus ipsilateral arm. , 2003, Journal of neurophysiology.

[61]  E. Keller,et al.  Saccade target selection in the superior colliculus during a visual search task. , 2002, Journal of neurophysiology.

[62]  P. Cisek Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.

[63]  H. Bekkering,et al.  Visual Search Is Modulated by Action Intentions , 2002, Psychological science.

[64]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[65]  Robert M. McPeek,et al.  Properties of saccadic responses in monkey when multiple competing visual stimuli are present. , 2004, Journal of neurophysiology.

[66]  M. Goldberg,et al.  Activity in the Lateral Intraparietal Area Predicts the Goal and Latency of Saccades in a Free-Viewing Visual Search Task , 2006, The Journal of Neuroscience.

[67]  Robert M. McPeek,et al.  Saccades require focal attention and are facilitated by a short-term memory system , 1999, Vision Research.

[68]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[69]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[70]  G. Innocenti,et al.  Interchange of callosal and association projections in the developing visual cortex , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  S P Tipper,et al.  Action-based mechanisms of attention. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[72]  K. Hoffmann,et al.  Neurons in the primate superior colliculus coding for arm movements in gaze-related coordinates. , 2000, Journal of neurophysiology.

[73]  H. Bekkering,et al.  Ocular gaze is anchored to the target of an ongoing pointing movement. , 2000, Journal of neurophysiology.

[74]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[75]  D. Boussaoud,et al.  Hand position modulates saccadic activity in the frontal eye field , 2008, Behavioural Brain Research.

[76]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[77]  Daniel Baldauf,et al.  The Posterior Parietal Cortex Encodes in Parallel Both Goals for Double-Reach Sequences , 2008, The Journal of Neuroscience.

[78]  R. Andersen,et al.  Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans , 2007, Neuron.

[79]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[80]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[81]  M. Paré,et al.  Temporal processing of saccade targets in parietal cortex area LIP during visual search. , 2007, Journal of neurophysiology.

[82]  Jitendra Malik,et al.  Local figure-ground cues are valid for natural images. , 2007, Journal of vision.

[83]  B. Julesz,et al.  Texton gradients: The texton theory revisited , 2004, Biological Cybernetics.

[84]  C. Erkelens,et al.  Coordination of hand movements and saccades: evidence for a common and a separate pathway , 2004, Experimental Brain Research.

[85]  D. Rosenbaum,et al.  Hand path priming in manual obstacle avoidance: evidence that the dorsal stream does not only control visually guided actions in real time. , 2007, Journal of experimental psychology. Human perception and performance.

[86]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[87]  Robert M. McPeek,et al.  Deficits in saccade target selection after inactivation of superior colliculus , 2004, Nature Neuroscience.

[88]  C. C. A. M. Gielen,et al.  Coordination of fast eye and arm movements in a tracking task , 2004, Experimental Brain Research.

[89]  R. Wurtz,et al.  Signal transformations from cerebral cortex to superior colliculus for the generation of saccades , 2001, Vision Research.

[90]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[91]  Robert M McPeek,et al.  Reversal of a distractor effect on saccade target selection after superior colliculus inactivation. , 2008, Journal of neurophysiology.

[92]  J. Tanji,et al.  Neuronal activity in the primate prefrontal cortex in the process of motor selection based on two behavioral rules. , 2000, Journal of neurophysiology.

[93]  K. Hoffmann,et al.  Anatomical distribution of arm-movement-related neurons in the primate superior colliculus and underlying reticular formation in comparison with visual and saccadic cells , 1997, Experimental Brain Research.

[94]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[95]  T. Ebner,et al.  Neuronal specification of direction and distance during reaching movements in the superior precentral premotor area and primary motor cortex of monkeys. , 1993, Journal of neurophysiology.

[96]  Robert M McPeek,et al.  Competition between saccade goals in the superior colliculus produces saccade curvature. , 2003, Journal of neurophysiology.

[97]  F Bremmer,et al.  Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. , 1998, Journal of neurophysiology.

[98]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[99]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[100]  Iain D Gilchrist,et al.  Saccade selection in visual search: evidence for spatial frequency specific between-item interactions , 1999, Vision Research.