Independent selection of eye and hand targets suggests effector-specific attentional mechanisms

Both eye and hand movements bind visual attention to their target locations during movement preparation. However, it remains contentious whether eye and hand targets are selected jointly by a single selection system, or individually by independent systems. To unravel the controversy, we investigated the deployment of visual attention – a proxy of motor target selection – in coordinated eye-hand movements. Results show that attention builds up in parallel both at the eye and the hand target. Importantly, the allocation of attention to one effector’s motor target was not affected by the concurrent preparation of the other effector’s movement at any time during movement preparation. This demonstrates that eye and hand targets are represented in separate, effector-specific maps of action-relevant locations. The eye-hand synchronisation that is frequently observed on the behavioral level must emerge from mutual influences of the two effector systems at later, post-attentional processing stages.

[1]  Bijan Pesaran,et al.  Spike-field activity in parietal area LIP during coordinated reach and saccade movements , 2011, Journal of neurophysiology.

[2]  H. Deubel,et al.  Selective Dorsal and Ventral Processing: Evidence for a Common Attentional Mechanism in Reaching and Perception , 1998 .

[3]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[4]  James W Bisley,et al.  The what, where, and why of priority maps and their interactions with visual working memory , 2015, Annals of the New York Academy of Sciences.

[5]  H. Deubel,et al.  Independent Allocation of Attention to Eye and Hand Targets in Coordinated Eye-Hand Movements , 2011, Psychological science.

[6]  Mazyar Fallah,et al.  Effector‐based attention systems , 2017, Annals of the New York Academy of Sciences.

[7]  R. McPeek,et al.  The eye dominates in guiding attention during simultaneous eye and hand movements. , 2011, Journal of vision.

[8]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[9]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[10]  Joo-Hyun Song,et al.  Eye-hand coordination during target selection in a pop-out visual search. , 2009, Journal of neurophysiology.

[11]  R. M. Siegel,et al.  Neurons of area 7 activated by both visual stimuli and oculomotor behavior , 2004, Experimental Brain Research.

[12]  D. Boussaoud,et al.  Hand position modulates saccadic activity in the frontal eye field , 2008, Behavioural Brain Research.

[13]  H. Bekkering,et al.  Ocular gaze is anchored to the target of an ongoing pointing movement. , 2000, Journal of neurophysiology.

[14]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[15]  M. Goldberg,et al.  The role of the parietal cortex in the neural processing of saccadic eye movements. , 2003, Advances in neurology.

[16]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[17]  Martin Rolfs,et al.  Attention in Active Vision: A Perspective on Perceptual Continuity Across Saccades , 2015, Perception.

[18]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[19]  Michael E. Goldberg,et al.  Physiology of the frontal eye fields , 1984, Trends in Neurosciences.

[20]  Anthony R. Dickinson,et al.  Non-spatial, motor-specific activation in posterior parietal cortex , 2002, Nature Neuroscience.

[21]  L H Snyder,et al.  Nonspatial saccade-specific activation in area LIP of monkey parietal cortex. , 2003, Journal of neurophysiology.

[22]  Jos J. Adam,et al.  Interference between saccadic eye and goal-directed hand movements , 2004, Experimental Brain Research.

[23]  Eric A. Yttri,et al.  Lesions of cortical area LIP affect reach onset only when the reach is accompanied by a saccade, revealing an active eye–hand coordination circuit , 2013, Proceedings of the National Academy of Sciences.

[24]  Pascal Fries,et al.  Neuronal Synchronization in Human Posterior Parietal Cortex during Reach Planning , 2010, The Journal of Neuroscience.

[25]  H. Deubel,et al.  Delayed Saccades, but Not Delayed Manual Aiming Movements, Require Visual Attention Shifts , 2003, Annals of the New York Academy of Sciences.

[26]  Martin Rolfs,et al.  Reach preparation enhances visual performance and appearance , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[28]  Lawrence H Snyder,et al.  The Responses of Visual Neurons in the Frontal Eye Field Are Biased for Saccades , 2009, The Journal of Neuroscience.

[29]  Klaus-Peter Hoffmann,et al.  Target selection in eye–hand coordination: Do we reach to where we look or do we look to where we reach? , 2005, Experimental Brain Research.

[30]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[31]  I. Toni,et al.  Spatial and effector processing in the human parietofrontal network for reaches and saccades. , 2009, Journal of neurophysiology.

[32]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[33]  Y. Nakayama,et al.  The history of JOV of 10 years , 2008, J. Vis..

[34]  Jos J. Adam,et al.  Oculomotor interference during manual response preparation: evidence from the response-cueing paradigm , 2010, Attention, perception & psychophysics.

[35]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[36]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[37]  R. McPeek,et al.  Neural correlates of target selection for reaching movements in superior colliculus. , 2015, Journal of neurophysiology.

[38]  Lynn Huestegge,et al.  Talking while looking: On the encapsulation of output system representations , 2014, Cognitive Psychology.

[39]  M. Corbetta,et al.  Sensory-motor mechanisms in human parietal cortex underlie arbitrary visual decisions , 2008, Nature Neuroscience.

[40]  D. Heeger,et al.  Specificity of Human Cortical Areas for Reaches and Saccades , 2007, The Journal of Neuroscience.

[41]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[42]  Maureen A. Hagan,et al.  Only Coherent Spiking in Posterior Parietal Cortex Coordinates Looking and Reaching , 2012, Neuron.

[43]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[44]  J Tanji,et al.  Visually guided saccade versus eye-hand reach: contrasting neuronal activity in the cortical supplementary and frontal eye fields. , 1996, Journal of neurophysiology.

[45]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Marzio Gerbella,et al.  Projections to the superior colliculus from inferior parietal, ventral premotor, and ventrolateral prefrontal areas involved in controlling goal-directed hand actions in the macaque. , 2014, Cerebral cortex.

[47]  Joo-Hyun Song,et al.  Deficits in reach target selection during inactivation of the midbrain superior colliculus , 2011, Proceedings of the National Academy of Sciences.

[48]  Paul B. Johnson,et al.  Cortical networks for visual reaching: physiological and anatomical organization of frontal and parietal lobe arm regions. , 1996, Cerebral cortex.