Top–Down Activation of Spatiotopic Sensory Codes in Perceptual and Working Memory Search

A critical requirement of an efficient cognitive system is the selection and prioritization of relevant information. This occurs when selecting specific items from our sensory inputs, which then receive preferential status at subsequent levels of processing. Many everyday tasks also require us to select internal representations, such as a relevant item from memory. We show that both of these types of search are underpinned by the spatiotopic activation of sensory codes, using both fMRI and MEG data. When individuals searched for perceived and remembered targets, the MEG data highlighted a sensor level electrophysiological effect that reflects the contralateral organization of the visual system—namely, the N2pc. The fMRI data were used to identify a network of frontoparietal areas common to both types of search, as well as the early visual areas activated by the search display. We then combined fMRI and MEG data to explore the temporal dynamics of functional connections between the frontoparietal network and the early visual areas. Searching for a target item resulted in significantly enhanced phase–phase coupling between the frontoparietal network and the visual areas contralateral to the perceived or remembered location of that target. This enhancement of spatially specific phase–phase coupling occurred before the N2pc effect and was significantly associated with it on a trial-by-trial basis. The combination of these two imaging modalities suggests that perceptual and working memory search are underpinned by the synchronization of a frontoparietal network and the relevant sensory cortices.

[1]  Jöran Lepsien,et al.  Searching for Targets within the Spatial Layout of Visual Short-Term Memory , 2009, The Journal of Neuroscience.

[2]  M. Eimer,et al.  Electrophysiological markers of visual dimension changes and response changes. , 2008, Journal of experimental psychology. Human perception and performance.

[3]  M. Eimer The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[4]  W. Klimesch Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[5]  L. Chelazzi Serial attention mechanisms in visual search: A critical look at the evidence , 1999, Psychological research.

[6]  Daniel J. Mitchell,et al.  Human Neuroscience , 2022 .

[7]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[8]  P. Fries Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[9]  C. Gerloff,et al.  Enhancing cognitive performance with repetitive transcranial magnetic stimulation at human individual alpha frequency , 2003, The European journal of neuroscience.

[10]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[11]  John Jonides,et al.  Common and distinct neural correlates of perceptual and memorial selection , 2009, NeuroImage.

[12]  T. Womelsdorf,et al.  The role of neuronal synchronization in selective attention , 2007, Current Opinion in Neurobiology.

[13]  Martin Eimer,et al.  Spatial Attention Can Be Allocated Rapidly and in Parallel to New Visual Objects , 2014, Current Biology.

[14]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[15]  J. Saiki,et al.  [Perceptual judgments of novel contour shapes and hierarchical descriptions of geometrical properties]. , 2003, Shinrigaku kenkyu : The Japanese journal of psychology.

[16]  Mark W. Woolrich,et al.  MEG beamforming using Bayesian PCA for adaptive data covariance matrix regularization , 2011, NeuroImage.

[17]  Karl J. Friston,et al.  A Study of Analysis Parameters That Influence the Sensitivity of Event-Related fMRI Analyses , 2000, NeuroImage.

[18]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[19]  Mark W. Woolrich,et al.  Electrophysiological measures of resting state functional connectivity and their relationship with working memory capacity in childhood , 2015, Developmental science.

[20]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[21]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[22]  R. VanRullen,et al.  An oscillatory mechanism for prioritizing salient unattended stimuli , 2012, Trends in Cognitive Sciences.

[23]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[24]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[25]  N Osaka,et al.  Individual differences in working memory and the peak alpha frequency shift on magnetoencephalography. , 1999, Brain research. Cognitive brain research.

[26]  Rainer Goebel,et al.  Common neural substrates for visual working memory and attention , 2007, NeuroImage.

[27]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[28]  E. Miller,et al.  Response to Comment on "Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices" , 2007, Science.

[29]  Hermann J. Müller,et al.  Sources of Top–Down Control in Visual Search , 2009, Journal of Cognitive Neuroscience.

[30]  Martin Eimer,et al.  An electrophysiological measure of access to representations in visual working memory. , 2010, Psychophysiology.

[31]  Jeremy M Wolfe,et al.  Journal of Experimental Psychology : General The Role of Object Categories in Hybrid Visual and Memory Search , 2014 .

[32]  Galina Ivanova,et al.  Multiple circular-circular correlation coefficients for the quantification of phase synchronization processes in the brain , 2013, Biomedizinische Technik. Biomedical engineering.

[33]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[34]  Stefanie I. Becker,et al.  Distinct neural networks for target feature versus dimension changes in visual search, as revealed by EEG and fMRI , 2014, NeuroImage.

[35]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[36]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[37]  Jeffrey D Schall,et al.  Nonhuman primate event-related potentials indexing covert shifts of attention , 2007, Proceedings of the National Academy of Sciences.

[38]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[39]  Giles L. Colclough,et al.  Cognitive Training Enhances Intrinsic Brain Connectivity in Childhood , 2015, The Journal of Neuroscience.

[40]  Roy Luria,et al.  Orienting attention to objects in visual short-term memory , 2009, Neuropsychologia.

[41]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[42]  Harald Hampel,et al.  Common capacity-limited neural mechanisms of selective attention and spatial working memory encoding , 2011, The European journal of neuroscience.

[43]  R. Todd Constable,et al.  Similar and dissociable mechanisms for attention to internal versus external information , 2009, NeuroImage.

[44]  Mark G. Stokes,et al.  Attention Biases Visual Activity in Visual Short-term Memory , 2014, Journal of Cognitive Neuroscience.

[45]  J. Schoffelen,et al.  University of Birmingham Occipital alpha activity during stimulus processing gates the information flow to object-selective cortex , 2014 .

[46]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[47]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[48]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[49]  M. Corbetta,et al.  Superior Parietal Cortex Activation During Spatial Attention Shifts and Visual Feature Conjunction , 1995, Science.

[50]  Fei Guo,et al.  Neural Representations of Contextual Guidance in Visual Search of Real-World Scenes , 2013, The Journal of Neuroscience.

[51]  Timothy Edward John Behrens,et al.  Frontoparietal Structural Connectivity Mediates the Top-Down Control of Neuronal Synchronization Associated with Selective Attention , 2015, PLoS biology.

[52]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[53]  I. A. Clark,et al.  Attention Restores Discrete Items to Visual Short-Term Memory , 2013, Psychological science.

[54]  Arno Villringer,et al.  Visual Feature and Conjunction Searches of Equal Difficulty Engage Only Partially Overlapping Frontoparietal Networks , 2002, NeuroImage.

[55]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[56]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[57]  P. Fries Rhythms for Cognition: Communication through Coherence , 2015, Neuron.

[58]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[59]  Mark W. Woolrich,et al.  Inferring task-related networks using independent component analysis in magnetoencephalography , 2012, NeuroImage.

[60]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[61]  N. Kanwisher,et al.  Visual attention: Insights from brain imaging , 2000, Nature Reviews Neuroscience.

[62]  A. Nobre,et al.  Spatial selection of features within perceived and remembered objects , 2009, NeuroImage.

[63]  A. Engel,et al.  Neuronal Synchronization along the Dorsal Visual Pathway Reflects the Focus of Spatial Attention , 2008, Neuron.

[64]  Elaine J. Anderson,et al.  Overlapping functional anatomy for working memory and visual search , 2009, Experimental Brain Research.

[65]  Theodore P. Zanto,et al.  Causal role of the prefrontal cortex in top-down modulation of visual processing and working memory , 2011, Nature Neuroscience.

[66]  A. Treisman,et al.  Conjunction search revisited. , 1990, Journal of experimental psychology. Human perception and performance.

[67]  M. Corbetta,et al.  Top-Down Control of Human Visual Cortex by Frontal and Parietal Cortex in Anticipatory Visual Spatial Attention , 2008, The Journal of Neuroscience.

[68]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[69]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[70]  M. Eimer The neural basis of attentional control in visual search , 2014, Trends in Cognitive Sciences.

[71]  Jöran Lepsien,et al.  Purely endogenous capture of attention by task-defining features proceeds independently from spatial attention , 2010, NeuroImage.

[72]  Mark Woolrich,et al.  The Neural Dynamics of Fronto-Parietal Networks in Childhood Revealed using Magnetoencephalography , 2014, Cerebral cortex.

[73]  O. Jensen,et al.  Alpha Oscillations Serve to Protect Working Memory Maintenance against Anticipated Distracters , 2012, Current Biology.

[74]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[75]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .