Combined visual attention and finger movement effects on human brain representations

Abstract. Sensory and motor systems interact in complex ways; visual attention modifies behavior, neural encoding, and brain activation; and dividing attention with simultaneous tasks may impede performance while producing specific brain activation patterns. We hypothesized that combining voluntary movement with visual attention would yield unique brain representations differing from those occurring for movement or visual attention alone. Hemodynamic signals in humans were obtained with functional magnetic resonance imaging (MRI) while participants performed one of four tasks that required only a repetitive finger movement, only attending to the color of a visual stimulus, simultaneous finger movement and visual attention, or no movement and no visual attention. The movement-alone task yielded brain activation in structures commonly engaged during voluntary movement, including the primary motor cortex, supplementary motor area, and cerebellum. Visual attention alone resulted in sparse cerebral cortical and substantial bilateral cerebellar activation. Simultaneous performance of visual attention and finger movements yielded widespread cerebral cortical, cerebellar, and other subcortical activation, in many of the same sites activated for the movement or attention tasks. However, the movement-related plus attention-related activation extended beyond the movement-alone or attention-alone activation sites, indicating a novel activation pattern related to the combined performance of attention and movement. Additionally, the conjoint effects of visual attention and movement upon brain activation were probably not simple gain effects, since we found activation-related interactions in the left superior parietal lobule, the right fusiform gyrus, and left insula, indicating a potent combinatory role for visual attention and movement for activation patterns in the human brain. In conclusion, performing visual attention and movement tasks simultaneously, even though the tasks had no specific interrelationship, resulted in novel activation patterns not predicted by performing movements or visual attention alone.

[1]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[2]  M. Posner Cognitive neuropsychology and the problem of selective attention. , 1985, Electroencephalography and clinical neurophysiology. Supplement.

[3]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[4]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[5]  Karl J. Friston,et al.  Comparing Functional (PET) Images: The Assessment of Significant Change , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[6]  H Pashler,et al.  Shifting visual attention and selecting motor responses: distinct attentional mechanisms. , 1991, Journal of experimental psychology. Human perception and performance.

[7]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  E. Cabanis,et al.  The Human Brain: Surface, Three-Dimensional Sectional Anatomy and Mri , 1991 .

[9]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[11]  Scott T. Grafton,et al.  Human functional anatomy of visually guided finger movements. , 1992, Brain : a journal of neurology.

[12]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[13]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[14]  Michel Desmurget,et al.  The effect of viewing the static hand prior to movement onset on pointing kinematics and variability , 1994, Experimental Brain Research.

[15]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[16]  Arthur W. Toga,et al.  A Probabilistic Atlas of the Human Brain: Theory and Rationale for Its Development The International Consortium for Brain Mapping (ICBM) , 1995, NeuroImage.

[17]  R. Passingham,et al.  Relation between cerebral activity and force in the motor areas of the human brain. , 1995, Journal of neurophysiology.

[18]  Jonathan D. Cohen,et al.  Interference and Facilitation Effects during Selective Attention: An H2 15O PET Study of Stroop Task Performance , 1995, NeuroImage.

[19]  J. A. Frost,et al.  Somatotopic mapping of the human primary motor cortex with functional magnetic resonance imaging , 1995, Neurology.

[20]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[21]  M. Corbetta,et al.  Superior Parietal Cortex Activation During Spatial Attention Shifts and Visual Feature Conjunction , 1995, Science.

[22]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[23]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[24]  S. Grossberg The Attentive Brain , 1995 .

[25]  J. Donoghue,et al.  Shared neural substrates controlling hand movements in human motor cortex. , 1995, Science.

[26]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[27]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[28]  P. Strick,et al.  Motor areas of the medial wall: a review of their location and functional activation. , 1996, Cerebral cortex.

[29]  Scott T. Grafton,et al.  Functional anatomy of pointing and grasping in humans. , 1996, Cerebral cortex.

[30]  K. Nakayama,et al.  Priming of popout: II. Role of position , 1996 .

[31]  Karl J. Friston,et al.  Quantitative Comparison of Functional Magnetic Resonance Imaging with Positron Emission Tomography Using a Force-Related Paradigm , 1996, NeuroImage.

[32]  G. Schlaug,et al.  Cerebral activation covaries with movement rate , 1996, Neuroreport.

[33]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[34]  Karl J. Friston,et al.  Detecting Activations in PET and fMRI: Levels of Inference and Power , 1996, NeuroImage.

[35]  M. Hallett,et al.  Frequency-Dependent Changes of Regional Cerebral Blood Flow during Finger Movements , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[36]  A. Treisman,et al.  Voluntary Attention Modulates fMRI Activity in Human MT–MST , 1997, Neuron.

[37]  R. Passingham,et al.  The left parietal cortex and motor attention , 1997, Neuropsychologia.

[38]  Richard S. J. Frackowiak,et al.  Anatomy of motor learning. I. Frontal cortex and attention to action. , 1997, Journal of neurophysiology.

[39]  C D Frith,et al.  Space-based and object-based visual attention: shared and specific neural domains. , 1997, Brain : a journal of neurology.

[40]  Scott T. Grafton,et al.  Attention and stimulus characteristics determine the locus of motor-sequence encoding. A PET study. , 1997, Brain : a journal of neurology.

[41]  Richard S. J. Frackowiak,et al.  Functional localization of the system for visuospatial attention using positron emission tomography. , 1997, Brain : a journal of neurology.

[42]  M. Hallett,et al.  The role of posterior parietal cortex in visually guided reaching movements in humans , 1997, Experimental Brain Research.

[43]  Scott T. Grafton,et al.  Motor task difficulty and brain activity: investigation of goal-directed reciprocal aiming using positron emission tomography. , 1997, Journal of neurophysiology.

[44]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[45]  H Shibasaki,et al.  Role of the primary auditory cortex in auditory selective attention studied by whole-head neuromagnetometer. , 1998, Brain research. Cognitive brain research.

[46]  Scott T. Grafton,et al.  Motor subcircuits mediating the control of movement velocity: a PET study. , 1998, Journal of neurophysiology.

[47]  M. Corbetta Functional anatomy of visual attention in the human brain: Studies with positron emission tomography. , 1998 .

[48]  B. Stein Neural mechanisms for synthesizing sensory information and producing adaptive behaviors , 1998, Experimental Brain Research.

[49]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[50]  X. Hu,et al.  4 T-fMRI study of nonspatial shifting of selective attention: cerebellar and parietal contributions. , 1998, Journal of neurophysiology.

[51]  Lacquaniti,et al.  Visuo‐motor transformations for arm reaching , 1998, The European journal of neuroscience.

[52]  C. Spence,et al.  Cross-modal links in spatial attention. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[53]  H. Breiter,et al.  A functional magnetic resonance imaging study of auditory vigilance with low and high information processing demands. , 1998, Neuropsychology.

[54]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[55]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[56]  Karl J. Friston,et al.  How Many Subjects Constitute a Study? , 1999, NeuroImage.

[57]  H. Bekkering,et al.  Integration of visual and somatosensory target information in goal-directed eye and arm movements , 1999, Experimental Brain Research.

[58]  Visual attention modifies human hand movement representations , 1999 .

[59]  Joel R. Meyer,et al.  A large-scale distributed network for covert spatial attention: further anatomical delineation based on stringent behavioural and cognitive controls. , 1999, Brain : a journal of neurology.

[60]  Jonathan E. Jennings,et al.  An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex. , 1999, Cerebral cortex.

[61]  N. Kanwisher,et al.  The Generality of Parietal Involvement in Visual Attention , 1999, Neuron.

[62]  J. Donoghue,et al.  Gaze Direction Modulates Finger Movement Activation Patterns in Human Cerebral Cortex , 1999, The Journal of Neuroscience.

[63]  Alan C. Evans,et al.  Three-Dimensional MRI Atlas of the Human Cerebellum in Proportional Stereotaxic Space , 1999, NeuroImage.

[64]  John H. R. Maunsell,et al.  Attention to both space and feature modulates neuronal responses in macaque area V4. , 2000, Journal of neurophysiology.

[65]  R. Engle,et al.  Working-memory capacity, proactive interference, and divided attention: limits on long-term memory retrieval. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[66]  D. Gitelman,et al.  Covert Visual Spatial Orienting and Saccades: Overlapping Neural Systems , 2000, NeuroImage.

[67]  H. Bekkering,et al.  Ocular gaze is anchored to the target of an ongoing pointing movement. , 2000, Journal of neurophysiology.

[68]  G. Orban,et al.  Attention to Speed of Motion, Speed Discrimination, and Task Difficulty: An fMRI Study , 2000, NeuroImage.

[69]  R. Dell’Acqua,et al.  Visual encoding of patterns is subject to dual-task interference , 2000, Memory & cognition.

[70]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[71]  R. Miall,et al.  The role of proprioception and attention in a visuomotor adaptation task , 2000, Experimental Brain Research.

[72]  R. Elliott,et al.  Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. , 2000, Cerebral cortex.

[73]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[74]  M. Rushworth,et al.  Complementary localization and lateralization of orienting and motor attention , 2001, Nature Neuroscience.

[75]  M. Goodale,et al.  Visual control of reaching movements without vision of the limb , 2004, Experimental Brain Research.