Biasing the brain’s attentional set: I. Cue driven deployments of intersensory selective attention

Brain activity associated with directing attention to one of two possible sensory modalities was examined using high-density mapping of human event-related potentials. The deployment of selective attention was based on visually presented symbolic cue-words instructing subjects on a trial-by-trial basis, which sensory modality to attend. We measured the spatio-temporal pattern of activation in the approximately 1 second period between the cue-instruction and a subsequent compound auditory-visual imperative stimulus. This allowed us to assess the flow of processing across brain regions involved in deploying and sustaining inter-sensory selective attention, prior to the actual selective processing of the compound audio-visual target stimulus. Activity over frontal and parietal areas showed sensory specific increases in activation during the early part of the anticipatory period (~230 ms), probably representing the activation of fronto-parietal attentional deployment systems for top-down control of attention. In the later period preceding the arrival of the “to-be-attended” stimulus, sustained differential activity was seen over fronto-central regions and parieto-occipital regions, suggesting the maintenance of sensory-specific biased attentional states that would allow for subsequent selective processing. Although there was clear sensory biasing in this late sustained period, it was also clear that both sensory systems were being prepared during the cue-target period. These late sensory-specific biasing effects were also accompanied by sustained activations over frontal cortices that also showed both common and sensory specific activation patterns, suggesting that maintenance of the biased state includes top-down inputs from generators in frontal cortices, some of which are sensory-specific regions. These data support extensive interactions between sensory, parietal and frontal regions during processing of cue information, deployment of attention, and maintenance of the focus of attention in anticipation of impending attentionally relevant input.

[1]  R. Knight,et al.  Prefrontal cortex regulates inhibition and excitation in distributed neural networks. , 1999, Acta psychologica.

[2]  Giovanni Galfano,et al.  Nonspatial attentional shifts between audition and vision. , 2002, Journal of experimental psychology. Human perception and performance.

[3]  R. Näätänen,et al.  Intermodal selective attention. II. Effects of attentional load on processing of auditory and visual stimuli in central space. , 1992, Electroencephalography and clinical neurophysiology.

[4]  Alan C. Evans,et al.  Dissociation of human mid-dorsolateral from posterior dorsolateral frontal cortex in memory processing. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[5]  S. Hillyard,et al.  Cross-modal selective attention effects on retinal, myogenic, brainstem, and cerebral evoked potentials. , 1990, Psychophysiology.

[6]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[7]  B R Rosen,et al.  Modulation of auditory and visual cortex by selective attention is modality-dependent. , 1996, Neuroreport.

[8]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[9]  津田 敏雄,et al.  Contingent negative variation , 1984 .

[10]  Alan C. Evans,et al.  Auditory Attention to Space and Frequency Activates Similar Cerebral Systems , 1999, NeuroImage.

[11]  M. E. Raichle,et al.  PET Studies of Auditory and Phonological Processing: Effects of Stimulus Characteristics and Task Demands , 1995, Journal of Cognitive Neuroscience.

[12]  T. Shallice,et al.  Frontal lesions and sustained attention , 1987, Neuropsychologia.

[13]  A R McIntosh,et al.  The neural correlates of intentional learning of verbal materials: a PET study in humans. , 1996, Brain research. Cognitive brain research.

[14]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[15]  T. Allison,et al.  Modulation of human extrastriate visual processing by selective attention to colours and words. , 1998, Brain : a journal of neurology.

[16]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[17]  A. Kok,et al.  Effects of inter- and intramodal selective attention to non-spatial visual stimuli: an event-related potential analysis , 1998, Biological Psychology.

[18]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[19]  S H Curry,et al.  Brain event-related potentials as indicators of early selective processes in auditory target localization. , 1983, Psychophysiology.

[20]  S A Hillyard,et al.  Spatial gradients of visual attention: behavioral and electrophysiological evidence. , 1988, Electroencephalography and clinical neurophysiology.

[21]  Alan C. Evans,et al.  Functional activation of the human frontal cortex during the performance of verbal working memory tasks. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[22]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[23]  M. Corbetta,et al.  A PET study of visuospatial attention , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[25]  D. Lindsley,et al.  Slow potential shifts of human brain during forewarned reaction. , 1981, Electroencephalography and clinical neurophysiology.

[26]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory: The impairment of auditory–verbal short-term storage , 1990 .

[27]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  P. Goldman-Rakic,et al.  Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. , 1998, Journal of neurophysiology.

[29]  M. Corbetta,et al.  Human cortical mechanisms of visual attention during orienting and search. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[30]  J. Rauschecker,et al.  Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans , 1999, Nature Neuroscience.

[31]  C. Frith,et al.  Prefrontal dysfunction in depressed patients performing a complex planning task: a study using positron emission tomography , 1997, Psychological Medicine.

[32]  G. V. Simpson,et al.  Parieto‐occipital ∼1 0Hz activity reflects anticipatory state of visual attention mechanisms , 1998 .

[33]  J. Jonides,et al.  Neuroimaging analyses of human working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Alan C. Evans,et al.  Planning and Spatial Working Memory: a Positron Emission Tomography Study in Humans , 1996, The European journal of neuroscience.

[35]  末綱 太,et al.  29.脳血管障害者のContingent Negative Variation (CNV) : 特に精神機能障害との関連について(脳卒中 : 高次, 精神機能)(第21回日本リハビリテーション医学会総会) , 1984 .

[36]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[37]  C. Spence,et al.  On measuring selective attention to an expected sensory modality , 1997, Perception & psychophysics.

[38]  Edward E. Smith,et al.  The Role of Parietal Cortex in Verbal Working Memory , 1998, The Journal of Neuroscience.

[39]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[40]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[41]  Cristina Lucchetti,et al.  Attention-related neurons in the supplementary eye field of the macaque monkey , 2006, Experimental Brain Research.

[42]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[43]  P S Goldman-Rakic,et al.  Association of Storage and Processing Functions in the Dorsolateral Prefrontal Cortex of the Nonhuman Primate , 1999, The Journal of Neuroscience.

[44]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[45]  Alan A. Wilson,et al.  Neuroanatomical correlates of encoding in episodic memory: levels of processing effect. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Olivier Bertrand,et al.  Scalp Current Density Mapping: Value and Estimation from Potential Data , 1987, IEEE Transactions on Biomedical Engineering.

[47]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[48]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[49]  L. McEvoy,et al.  High resolution evoked potential imaging of the cortical dynamics of human working memory. , 1996, Electroencephalography and clinical neurophysiology.

[50]  M. Posner,et al.  Attentional networks , 1994, Trends in Neurosciences.

[51]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[52]  P. Roland,et al.  Activation of Multi‐modal Cortical Areas Underlies Short‐term Memory , 1996, The European journal of neuroscience.

[53]  John J. Foxe,et al.  Visual activation of frontal cortex: segregation from occipital activity. , 2001, Brain research. Cognitive brain research.

[54]  R. Hari,et al.  Effect of stimulus repetition on negative sustained potentials elicited by auditory and visual stimuli in the human EEG , 1978, Biological Psychology.

[55]  S. Hillyard,et al.  Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. , 1999, Brain research. Cognitive brain research.

[56]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[57]  P F Liddle,et al.  The role of the left prefrontal cortex in verbal processing: semantic processing or willed action? , 1994, Neuroreport.

[58]  Gregory V. Simpson,et al.  Biasing the brain’s attentional set: II. Effects of selective intersensory attentional deployments on subsequent sensory processing , 2005, Experimental Brain Research.

[59]  P. Roland Cortical regulation of selective attention in man. A regional cerebral blood flow study. , 1982, Journal of neurophysiology.

[60]  T. Shallice Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[61]  Kensuke Sekihara,et al.  Activation of Lateral Extrastriate Areas during Orthographic Processing of Japanese Characters Studied with fMRI , 1999, NeuroImage.

[62]  K. Alho,et al.  Intermodal selective attention: evidence for processing in tonotopic auditory fields. , 1993, Psychophysiology.

[63]  E K Warrington,et al.  The anatomical localisation of selective impairment of auditory verbal short-term memory. , 1971, Neuropsychologia.

[64]  P. Michie,et al.  Different Variants of Endogenous Negative Brain Potentials in Performance Situations: A Review and Classification , 1979 .

[65]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[66]  John J. Foxe,et al.  Task switching: a high-density electrical mapping study , 2003, NeuroImage.

[67]  P. Goldman-Rakic,et al.  Segregation of working memory functions within the dorsolateral prefrontal cortex , 2000, Experimental Brain Research.

[68]  Edward E. Smith,et al.  PET Evidence for an Amodal Verbal Working Memory System , 1996, NeuroImage.

[69]  S. Hillyard,et al.  Identification of early visual evoked potential generators by retinotopic and topographic analyses , 1994 .

[70]  G. R Mangun,et al.  Shifting visual attention in space: an electrophysiological analysis using high spatial resolution mapping , 2000, Clinical Neurophysiology.

[71]  R. Dolan,et al.  Neural systems engaged by planning: a PET study of the Tower of London task , 1996, Neuropsychologia.

[72]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[73]  P. Cavanagh,et al.  Cortical fMRI activation produced by attentive tracking of moving targets. , 1998, Journal of neurophysiology.

[74]  S. Petersen,et al.  Hemispheric Specialization in Human Dorsal Frontal Cortex and Medial Temporal Lobe for Verbal and Nonverbal Memory Encoding , 1998, Neuron.

[75]  E. Miller,et al.  Prospective Coding for Objects in Primate Prefrontal Cortex , 1999, The Journal of Neuroscience.

[76]  S. Hillyard,et al.  Evidence for effects of selective attention in the mid-latency range of the human auditory event-related potential. , 1987, Electroencephalography and clinical neurophysiology. Supplement.

[77]  H G Vaughan,et al.  The scalp topography of potentials in auditory and visual Go/NoGo tasks. , 1977, Electroencephalography and clinical neurophysiology.

[78]  A. Owen Cognitive planning in humans: Neuropsychological, neuroanatomical and neuropharmacological perspectives , 1997, Progress in Neurobiology.

[79]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[80]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[81]  J. Knott,et al.  Regarding the American Electroencephalographic Society guidelines for standard electrode position nomenclature: a commentary on the proposal to change the 10-20 electrode designators. , 1993, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[82]  John J. Foxe,et al.  Attention-dependent suppression of distracter visual input can be cross-modally cued as indexed by anticipatory parieto-occipital alpha-band oscillations. , 2001, Brain research. Cognitive brain research.

[83]  G. V. Simpson,et al.  Anticipatory Biasing of Visuospatial Attention Indexed by Retinotopically Specific α-Bank Electroencephalography Increases over Occipital Cortex , 2000, The Journal of Neuroscience.

[84]  P. Roland,et al.  Bilateral activation of fronto-parietal networks by incrementing demand in a working memory task. , 1997, Cerebral cortex.

[85]  John J. Foxe,et al.  Don't think of a white bear: An fMRI investigation of the effects of sequential instructional sets on cortical activity in a task‐switching paradigm , 2004, Human brain mapping.

[86]  Bruce Bridgeman,et al.  Space-independent modality-driven attentional capture in auditory, tactile and visual systems , 2004, Experimental Brain Research.

[87]  William E. Semple,et al.  Functional localization of sustained attention: Comparison to sensory stimulation in the absence of instruction , 1988 .

[88]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[89]  E. Schröger,et al.  ERP effects of intermodal attention and cross-modal links in spatial attention. , 1998, Psychophysiology.

[90]  Leslie G. Ungerleider,et al.  An area specialized for spatial working memory in human frontal cortex. , 1998, Science.

[91]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[92]  John J. Foxe,et al.  The case for feedforward multisensory convergence during early cortical processing , 2005, Neuroreport.

[93]  Edward E. Smith,et al.  Dissociation of Storage and Rehearsal in Verbal Working Memory: Evidence From Positron Emission Tomography , 1996 .

[94]  T. Robbins,et al.  Dissociating executive mechanisms of task control following frontal lobe damage and Parkinson's disease. , 1998, Brain : a journal of neurology.

[95]  The modality specificity of the slow negative wave. , 1980, Psychophysiology.

[96]  Scott T. Grafton,et al.  Neural Evidence Linking Visual Object Enumeration and Attention , 1999, Journal of Cognitive Neuroscience.

[97]  John J. Foxe,et al.  The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. , 2002, Brain research. Cognitive brain research.

[98]  John J. Foxe,et al.  Visual Perceptual Learning in Human Object Recognition Areas: A Repetition Priming Study Using High-Density Electrical Mapping , 2001, NeuroImage.

[99]  John J. Foxe,et al.  Activation Timecourse of Ventral Visual Stream Object-recognition Areas: High Density Electrical Mapping of Perceptual Closure Processes , 2000, Journal of Cognitive Neuroscience.

[100]  C. Frith,et al.  A fronto-parietal network for rapid visual information processing: a PET study of sustained attention and working memory , 1996, Neuropsychologia.

[101]  Edward E. Smith,et al.  Verbal Working Memory Load Affects Regional Brain Activation as Measured by PET , 1997, Journal of Cognitive Neuroscience.

[102]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[103]  R. Töpper,et al.  Role of the Posterior Parietal Cortex in Spatial Hearing , 2002, The Journal of Neuroscience.

[104]  K. Alho,et al.  Processing of auditory stimuli during auditory and visual attention as revealed by event-related potentials. , 1994, Psychophysiology.

[105]  I. THE ATTENTION SYSTEM OF THE HUMAN BRAIN , 2002 .

[106]  Michael Petrides,et al.  Nonspatial conditional learning impaired in patients with unilateral frontal but not unilateral temporal lobe excisions , 1990, Neuropsychologia.

[107]  M. Tervaniemi,et al.  Selective tuning of the left and right auditory cortices during spatially directed attention. , 1999, Brain research. Cognitive brain research.

[108]  N C Andreasen,et al.  The neuropsychology of the prefrontal cortex. , 1993, Archives of neurology.

[109]  M. Raichle,et al.  Localization of a human system for sustained attention by positron emission tomography , 1991, Nature.

[110]  Nigel Harvey,et al.  Non-Informative Effects of Stimuli Functioning as Cues , 1980, The Quarterly journal of experimental psychology.

[111]  M. Azuma,et al.  Properties and distribution of auditory neurons in the dorsolateral prefrontal cortex of the alert monkey , 1984, Brain Research.

[112]  R. Dolan,et al.  Dissociating prefrontal and hippocampal function in episodic memory encoding , 1997, Nature.

[113]  Skyler Dean,et al.  Mind's Eye , 1973 .

[114]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[115]  K. Alho,et al.  Intermodal selective attention. I. Effects on event-related potentials to lateralized auditory and visual stimuli. , 1992, Electroencephalography and clinical neurophysiology.

[116]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[117]  Michael D. Rugg,et al.  Word and Nonword Repetition Within- and Across-Modality: An Event-Related Potential Study , 1995, Journal of Cognitive Neuroscience.

[118]  R. Morris,et al.  Neural correlates of planning ability: Frontal lobe activation during the tower of London test , 1993, Neuropsychologia.

[119]  J. Pernier,et al.  ERP Manifestations of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution , 1999, Journal of Cognitive Neuroscience.

[120]  M. Corbetta,et al.  Areas Involved in Encoding and Applying Directional Expectations to Moving Objects , 1999, The Journal of Neuroscience.

[121]  J. Grafman,et al.  Multiple visuospatial working memory buffers: Evidence from spatiotemporal patterns of brain activity , 1997, Neuropsychologia.

[122]  R Kawashima,et al.  Positron-emission tomography studies of cross-modality inhibition in selective attentional tasks: closing the "mind's eye". , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[123]  Jemett L. Desmond,et al.  Semantic encoding and retrieval in the left inferior prefrontal cortex: a functional MRI study of task difficulty and process specificity , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[124]  R. Andersen,et al.  Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. , 1996, Journal of neurophysiology.

[125]  A. Nobre,et al.  The dynamics of shifting visuospatial attention revealed by event-related potentials , 2000, Neuropsychologia.