How visual working memory handles distraction: cognitive mechanisms and electrophysiological correlates

ABSTRACT The ability to selectively encode relevant information (filtering ability) is crucial to make best use of the severely limited space that visual working memory (VWM) provides. This review considers why filtering ability is important, how it is measured, and it discusses how filtering might be implemented computationally at the cognitive and neuronal level. Based on theoretical considerations, we explore the possibility that filtering ability involves not only the suppression of irrelevant, but also the enhancement of relevant information – functions that might be implemented by different brain mechanisms; and we review behavioural and electrophysiological data in light of the various resulting model versions. We also highlight that filtering is better understood as coordinated brain network activity, rather than being the function of a single region. Broadcasting of control signals from prefrontal cortex appears critical in upholding information in posterior cortical areas in the absence of distractors. The very same ability might also support selective processing of relevant information in the presence of distractors. These ideas provide a novel explanation for the relation between filtering ability and VWM capacity and thereby (re-)establish a central role of filtering ability in general VWM functioning.

[1]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[2]  P. Goldman-Rakic Development of cortical circuitry and cognitive function. , 1987, Child Development.

[3]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[4]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[5]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[6]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[7]  P. Goldman-Rakic,et al.  Segregation of working memory functions within the dorsolateral prefrontal cortex , 2000, Experimental Brain Research.

[8]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[9]  E Pellouchoud,et al.  Neurophysiological signals of working memory in normal aging. , 2001, Brain research. Cognitive brain research.

[10]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[11]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[12]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[13]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[14]  Manuel Schabus,et al.  Theta coupling in the human electroencephalogram during a working memory task , 2004, Neuroscience Letters.

[15]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[16]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[17]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[18]  Manuel Schabus,et al.  Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[20]  Robert T. Knight,et al.  Top-down Enhancement and Suppression of the Magnitude and Speed of Neural Activity , 2005, Journal of Cognitive Neuroscience.

[21]  P. Jolicoeur,et al.  Fundamental properties of the N2pc as an index of spatial attention: effects of masking. , 2006, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[22]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[23]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[24]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[25]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[26]  Edward Awh,et al.  The bouncer in the brain , 2008, Nature Neuroscience.

[27]  K. Müller,et al.  Robustly estimating the flow direction of information in complex physical systems. , 2007, Physical review letters.

[28]  M. Carrasco,et al.  How spatial and feature-based attention affect the gain and tuning of population responses , 2009, Vision Research.

[29]  E. Vogel,et al.  Human Variation in Overriding Attentional Capture , 2009, The Journal of Neuroscience.

[30]  Vincent Di Lollo,et al.  Electrophysiological Indices of Target and Distractor Processing in Visual Search , 2009, Journal of Cognitive Neuroscience.

[31]  A. Karim,et al.  Brain Oscillatory Substrates of Visual Short-Term Memory Capacity , 2009, Current Biology.

[32]  Edward Awh,et al.  Statistical learning induces discrete shifts in the allocation of working memory resources. , 2010, Journal of experimental psychology. Human perception and performance.

[33]  W. Klimesch,et al.  Control mechanisms in working memory: A possible function of EEG theta oscillations , 2010, Neuroscience & Biobehavioral Reviews.

[34]  E. Vogel,et al.  Quantity, not quality: the relationship between fluid intelligence and working memory capacity , 2010, Psychonomic bulletin & review.

[35]  Nicolas Robitaille,et al.  Distinguishing between lateralized and nonlateralized brain activity associated with visual short-term memory: fMRI, MEG, and EEG evidence from the same observers , 2010, NeuroImage.

[36]  Bradley Voytek,et al.  Prefrontal cortex and basal ganglia contributions to visual working memory , 2010, Proceedings of the National Academy of Sciences.

[37]  P. Roelfsema,et al.  Different States in Visual Working Memory: When It Guides Attention and When It Does Not , 2022 .

[38]  Nikolaus Weiskopf,et al.  Causal evidence for frontal involvement in memory target maintenance by posterior brain areas during distracter interference of visual working memory , 2011, Proceedings of the National Academy of Sciences.

[39]  E. Vogel,et al.  Visual Search Demands Dictate Reliance upon Working Memory Storage , 2011 .

[40]  Steven L. Bressler,et al.  Wiener–Granger Causality: A well established methodology , 2011, NeuroImage.

[41]  C. Bundesen,et al.  A neural theory of visual attention and short-term memory (NTVA) , 2011, Neuropsychologia.

[42]  Hubert D. Zimmer,et al.  What Does Ipsilateral Delay Activity Reflect? Inferences from Slow Potentials in a Lateralized Visual Working Memory Task , 2011, Journal of Cognitive Neuroscience.

[43]  E. Vogel,et al.  Individual Differences in Recovery Time From Attentional Capture , 2011, Psychological science.

[44]  Hubert D. Zimmer,et al.  Successful training of filtering mechanisms in multiple object tracking does not transfer to filtering mechanisms in a visual working memory task: Behavioral and electrophysiological evidence , 2012, Neuropsychologia.

[45]  Rodrigo F. Salazar,et al.  Content-Specific Fronto-Parietal Synchronization During Visual Working Memory , 2012, Science.

[46]  O. Jensen,et al.  Alpha Oscillations Serve to Protect Working Memory Maintenance against Anticipated Distracters , 2012, Current Biology.

[47]  T. Braver The variable nature of cognitive control: a dual mechanisms framework , 2012, Trends in Cognitive Sciences.

[48]  J. Theeuwes,et al.  Top-down versus bottom-up attentional control: a failed theoretical dichotomy , 2012, Trends in Cognitive Sciences.

[49]  C. Constantinidis,et al.  Early involvement of prefrontal cortex in visual bottom up attention , 2012, Nature Neuroscience.

[50]  Gregor M. Hörzer,et al.  Theta coupling between V4 and prefrontal cortex predicts visual short-term memory performance , 2012, Nature Neuroscience.

[51]  Arthur P. Shimamura,et al.  The role of the prefrontal cortex in dynamic filtering , 2000, Psychobiology.

[52]  H. Müller,et al.  Salience-Based Selection: Attentional Capture by Distractors Less Salient Than the Target , 2013, PloS one.

[53]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[54]  J. Gottlieb,et al.  Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe , 2012, Nature Neuroscience.

[55]  Ali Jannati,et al.  Tracking target and distractor processing in fixed-feature visual search: evidence from human electrophysiology. , 2013, Journal of experimental psychology. Human perception and performance.

[56]  Hubert D Zimmer,et al.  Think spatial: the representation in mental rotation is nonvisual. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[57]  T. Robbins,et al.  Inhibition and impulsivity: Behavioral and neural basis of response control , 2013, Progress in Neurobiology.

[58]  E. Vogel,et al.  Neural Limits to Representing Objects Still within View , 2013, The Journal of Neuroscience.

[59]  John M. Gaspar,et al.  Suppression of Salient Objects Prevents Distraction in Visual Search , 2014, The Journal of Neuroscience.

[60]  Joy J. Geng,et al.  Attentional Mechanisms of Distractor Suppression , 2014 .

[61]  P. Uhlhaas,et al.  Working memory and neural oscillations: alpha–gamma versus theta–gamma codes for distinct WM information? , 2014, Trends in Cognitive Sciences.

[62]  Hubert D. Zimmer,et al.  Intercommunication Between Prefrontal and Posterior Brain Regions for Protecting Visual Working Memory From Distractor Interference , 2014, Psychological science.

[63]  Julio C. Martinez-Trujillo,et al.  Sharp emergence of feature-selective sustained activity along the dorsal visual pathway , 2014, Nature Neuroscience.

[64]  J. King,et al.  Working memory load and distraction: dissociable effects of visual maintenance and cognitive control , 2014, Attention, perception & psychophysics.

[65]  E. Vogel,et al.  Working memory and fluid intelligence: Capacity, attention control, and secondary memory retrieval , 2014, Cognitive Psychology.

[66]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[67]  Andreas Nieder,et al.  Complementary Roles for Primate Frontal and Parietal Cortex in Guarding Working Memory from Distractor Stimuli , 2014, Neuron.

[68]  H. Zimmer,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Fast and Careless or Careful and Slow ? Apparent Holistic Processing in Mental Rotation Is Explained by Speed-Accuracy Trade-Offs , 2014 .

[69]  B. Postle,et al.  The cognitive neuroscience of working memory. , 2007, Annual review of psychology.

[70]  Keisuke Fukuda,et al.  α Power Modulation and Event-Related Slow Wave Provide Dissociable Correlates of Visual Working Memory , 2015, The Journal of Neuroscience.

[71]  Stephen M. Emrich,et al.  Re-evaluating the relationships among filtering activity, unnecessary storage, and visual working memory capacity , 2015, Cognitive, affective & behavioral neuroscience.

[72]  N. P. Bichot,et al.  A Source for Feature-Based Attention in the Prefrontal Cortex , 2015, Neuron.

[73]  Edward Awh,et al.  The contralateral delay activity as a neural measure of visual working memory , 2016, Neuroscience & Biobehavioral Reviews.

[74]  U. Mayr,et al.  Early selection versus late correction: Age-related differences in controlling working memory contents. , 2016, Psychology and aging.

[75]  David J. Prime,et al.  Inability to suppress salient distractors predicts low visual working memory capacity , 2016, Proceedings of the National Academy of Sciences.

[76]  M. R. Riley,et al.  Role of Prefrontal Persistent Activity in Working Memory , 2016, Front. Syst. Neurosci..

[77]  Joram van Driel,et al.  Proactive, but Not Reactive, Distractor Filtering Relies on Local Modulation of Alpha Oscillatory Activity , 2016, Journal of Cognitive Neuroscience.

[78]  A. Nieder,et al.  Cell-type-specific modulation of targets and distractors by dopamine D1 receptors in primate prefrontal cortex , 2016, Nature Communications.

[79]  Roy Luria,et al.  Neural and Behavioral Evidence for an Online Resetting Process in Visual Working Memory , 2016, The Journal of Neuroscience.

[80]  C. Olivers,et al.  Posterior α EEG Dynamics Dissociate Current from Future Goals in Working Memory-Guided Visual Search , 2017, The Journal of Neuroscience.

[81]  Stephen M. Emrich,et al.  Attention Mediates the Flexible Allocation of Visual Working Memory Resources , 2017, Journal of experimental psychology. Human perception and performance.

[82]  J. Wolfe,et al.  Five factors that guide attention in visual search , 2017, Nature Human Behaviour.

[83]  P. Roelfsema,et al.  The Distributed Nature of Working Memory , 2017, Trends in Cognitive Sciences.

[84]  Keisuke Fukuda,et al.  Visual working memory buffers information retrieved from visual long-term memory , 2017, Proceedings of the National Academy of Sciences.

[85]  Gregory J. Christie,et al.  Signal Enhancement, Not Active Suppression, Follows the Contingent Capture of Visual Attention , 2017, Journal of experimental psychology. Human perception and performance.

[86]  Hermann J. Müller,et al.  Attentional capture in visual search: Capture and post-capture dynamics revealed by EEG , 2017, NeuroImage.

[87]  Shih-Cheng Yen,et al.  Mixed selectivity morphs population codes in prefrontal cortex , 2017, Nature Neuroscience.

[88]  Heleen A. Slagter,et al.  Protecting visual short-term memory during maintenance: Attentional modulation of target and distractor representations , 2017, Scientific Reports.

[89]  Stephen M. Emrich,et al.  More Than a Filter: Feature-Based Attention Regulates the Distribution of Visual Working Memory Resources , 2017, Journal of experimental psychology. Human perception and performance.

[90]  Eren Gunseli,et al.  Local and interregional alpha EEG dynamics dissociate between memory for search and memory for recognition , 2017, NeuroImage.

[91]  Robert T. Knight,et al.  Bidirectional Frontoparietal Oscillatory Systems Support Working Memory , 2017, Current Biology.

[92]  Ayala S Allon,et al.  Compensation mechanisms that improve distractor filtering are short-lived , 2017, Cognition.

[93]  Steven J. Luck,et al.  The Role of Inhibition in Avoiding Distraction by Salient Stimuli , 2018, Trends in Cognitive Sciences.

[94]  Jan Theeuwes,et al.  Statistical Regularities Modulate Attentional Capture , 2018, Journal of experimental psychology. Human perception and performance.

[95]  Hermann J Müller,et al.  Region-based shielding of visual search from salient distractors: Target detection is impaired with same- but not different-dimension distractors , 2018, Attention, perception & psychophysics.

[96]  Edward Awh,et al.  The role of alpha oscillations in spatial attention: limited evidence for a suppression account. , 2019, Current opinion in psychology.

[97]  Stefan Pollmann,et al.  Biasing Allocations of Attention via Selective Weighting of Saliency Signals: Behavioral and Neuroimaging Evidence for the Dimension-Weighting Account. , 2018, Current topics in behavioral neurosciences.

[98]  Heinrich René Liesefeld,et al.  Estimating the Timing of Cognitive Operations With MEG/EEG Latency Measures: A Primer, a Brief Tutorial, and an Implementation of Various Methods , 2018, Front. Neurosci..

[99]  Joram van Driel,et al.  Priority Switches in Visual Working Memory are Supported by Frontal Delta and Posterior Alpha Interactions , 2018, Cerebral cortex.

[100]  Edward Awh,et al.  Contralateral Delay Activity Indexes Working Memory Storage, Not the Current Focus of Spatial Attention , 2018, Journal of Cognitive Neuroscience.

[101]  Nicholas Gaspelin,et al.  Inhibition as a potential resolution to the attentional capture debate. , 2019, Current opinion in psychology.

[102]  Andreas Nieder,et al.  Structuring of Abstract Working Memory Content by Fronto-parietal Synchrony in Primate Cortex , 2018, Neuron.

[103]  David Aagten-Murphy,et al.  Functions of Memory Across Saccadic Eye Movements. , 2018, Current topics in behavioral neurosciences.

[104]  Stephen M. Emrich,et al.  Electrophysiological correlates of the flexible allocation of visual working memory resources , 2019, Scientific Reports.

[105]  Hermann J Müller,et al.  A theoretical attempt to revive the serial/parallel-search dichotomy , 2019, Attention, Perception, & Psychophysics.

[106]  H. Müller,et al.  Current directions in visual working memory research: An introduction and emerging insights. , 2019, British journal of psychology.

[107]  Joy J Geng,et al.  Template-to-distractor distinctiveness regulates visual search efficiency. , 2019, Current opinion in psychology.

[108]  Heinrich René Liesefeld,et al.  Learning to suppress salient distractors in the target dimension: Region-based inhibition is persistent and transfers to distractors in a nontarget dimension. , 2019, Journal of experimental psychology. Learning, memory, and cognition.

[109]  Loong Fah Cheong,et al.  Time-invariant working memory representations in the presence of code-morphing in the lateral prefrontal cortex , 2019, Nature Communications.

[110]  Edward K Vogel,et al.  Neural Evidence for the Contribution of Active Suppression During Working Memory Filtering , 2019, Cerebral cortex.

[111]  Jan Theeuwes,et al.  Statistical regularities induce spatial as well as feature-specific suppression. , 2019, Journal of experimental psychology. Human perception and performance.

[112]  Christian N. L. Olivers,et al.  Oscillatory Mechanisms of Preparing for Visual Distraction , 2019, Journal of Cognitive Neuroscience.

[113]  L. Chelazzi,et al.  Getting rid of visual distractors: the why, when, how, and where. , 2019, Current opinion in psychology.

[114]  H. Müller,et al.  Distractor handling via dimension weighting. , 2019, Current opinion in psychology.

[115]  A. Sterr,et al.  Dynamic regulation of interregional cortical communication by slow brain oscillations during working memory , 2019, Nature Communications.

[116]  Klaus Oberauer,et al.  Working Memory and Attention – A Conceptual Analysis and Review , 2019, Journal of cognition.

[117]  H. Müller,et al.  Two good reasons to say 'change!' - ensemble representations as well as item representations impact standard measures of VWM capacity. , 2018, British journal of psychology.

[118]  Ayala S Allon,et al.  Filtering performance in visual working memory is improved by reducing early spatial attention to the distractors. , 2019, Psychophysiology.

[119]  Nicole Hakim,et al.  Perturbing Neural Representations of Working Memory with Task-irrelevant Interruption , 2019, Journal of Cognitive Neuroscience.

[120]  Dirk Kerzel,et al.  Capture by Context Elements, Not Attentional Suppression of Distractors, Explains the PD with Small Search Displays , 2020, Journal of Cognitive Neuroscience.

[121]  Jason M. Scimeca,et al.  Causal Evidence for a Role of Theta and Alpha Oscillations in the Control of Working Memory , 2020, Current Biology.

[122]  Christian N. L. Olivers,et al.  Oscillatory Control over Representational States in Working Memory , 2019, Trends in Cognitive Sciences.

[123]  P. Sauseng,et al.  Cognitive Control: Brain Oscillations Coordinate Human Working Memory , 2020, Current Biology.