Protecting visual short-term memory during maintenance: Attentional modulation of target and distractor representations

In the presence of distraction, attentional filtering is a key predictor of efficient information storage in visual short-term memory (VSTM). Yet, the role of attention in distractor filtering, and the extent to which attentional filtering continues to protect information during post-perceptual stages of VSTM, remains largely unknown. In the current study, we investigated the role of spatial attention in distractor filtering during VSTM encoding and maintenance. Participants performed a change detection task with varying distractor load. Attentional deployment to target and distractor locations was tracked continuously by means of Steady-State Visual Evoked Potentials (SSVEPs). Analyses revealed that attention strongly modulated the amplitude of the second harmonic SSVEP response, with larger amplitudes at target compared to distractor locations. These attentional modulations commenced during encoding, and remained present during maintenance. Furthermore, the amount of attention paid to distractor locations was directly related to behavioral distractor costs: Individuals who paid more attention to target compared to distractor locations during VSTM maintenance generally suffered less from the presence of distractors. Together, these findings support an important role of spatial attention in distractor filtering at multiple stages of VSTM, and highlight the usefulness of SSVEPs in continuously tracking attention to multiple locations during VSTM.

[1]  Rosanne L Rademaker,et al.  The impact of interference on short-term memory for visual orientation. , 2015, Journal of experimental psychology. Human perception and performance.

[2]  Eelke Spaak,et al.  The Importance of Single-Trial Analyses in Cognitive Neuroscience , 2016, Trends in Cognitive Sciences.

[3]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[4]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[5]  Arno Villringer,et al.  A Physiological Correlate of the “Zoom Lens” of Visual Attention , 2003, The Journal of Neuroscience.

[6]  V. Lamme,et al.  V4 Activity Predicts the Strength of Visual Short-Term Memory Representations , 2009, The Journal of Neuroscience.

[7]  Edward K Vogel,et al.  Tuning in by tuning out distractions , 2016, Proceedings of the National Academy of Sciences.

[8]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[9]  P. Cavanagh,et al.  Flexible cognitive resources: competitive content maps for attention and memory , 2013, Trends in Cognitive Sciences.

[10]  Jan Theeuwes,et al.  Spatial working memory effects in early visual cortex , 2010, Brain and Cognition.

[11]  Jan Theeuwes,et al.  No functional role of attention-based rehearsal in maintenance of spatial working memory representations. , 2009, Acta psychologica.

[12]  Fiona McNab,et al.  Dissociating Distractor-Filtering at Encoding and During Maintenance , 2014, Journal of experimental psychology. Human perception and performance.

[13]  J Artieda,et al.  Topography of cortical activation differs for fundamental and harmonic frequencies of the steady-state visual-evoked responses. An EEG and PET H215O study. , 2007, Cerebral cortex.

[14]  Michi Matsukura,et al.  Location-specific effects of attention during visual short-term memory maintenance. , 2014, Journal of experimental psychology. Human perception and performance.

[15]  Alessandra S. Souza,et al.  In search of the focus of attention in working memory: 13 years of the retro-cue effect , 2016, Attention, perception & psychophysics.

[16]  D. E. Irwin,et al.  Attention on our mind: the role of spatial attention in visual working memory. , 2011, Acta psychologica.

[17]  N. Lavie Attention, Distraction, and Cognitive Control Under Load , 2010 .

[18]  Jonathan T. Mall,et al.  Visual selective attention is equally functional for individuals with low and high working memory capacity: Evidence from accuracy and eye movements , 2014, Attention, perception & psychophysics.

[19]  Marvin M. Chun,et al.  When a Thought Equals a Look: Refreshing Enhances Perceptual Memory , 2008, Journal of Cognitive Neuroscience.

[20]  Smith-Kettlewell Neural correlates of object-based attention , 2002 .

[21]  Mark W. Woolrich,et al.  Memory load modulates graded changes in distracter filtering , 2015, Front. Hum. Neurosci..

[22]  Rhodri Cusack,et al.  Strength of retinotopic representation of visual memories is modulated by strategy. , 2014, Cerebral cortex.

[23]  H. Karnath,et al.  Keeping Memory Clear and Stable—The Contribution of Human Basal Ganglia and Prefrontal Cortex to Working Memory , 2010, The Journal of Neuroscience.

[24]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[25]  Hedderik van Rijn,et al.  Dissociable mechanisms underlying individual differences in visual working memory capacity , 2014, NeuroImage.

[26]  James W Bisley,et al.  The what, where, and why of priority maps and their interactions with visual working memory , 2015, Annals of the New York Academy of Sciences.

[27]  Søren K. Andersen,et al.  Effects of Feature-selective and Spatial Attention at Different Stages of Visual Processing , 2011, Journal of Cognitive Neuroscience.

[28]  R. Engle,et al.  Working memory capacity and the scope and control of attention , 2015, Attention, Perception, & Psychophysics.

[29]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[30]  Mark G. Stokes,et al.  Attention Modulates Maintenance of Representations in Visual Short-term Memory , 2012, Journal of Cognitive Neuroscience.

[31]  John K. Tsotsos,et al.  Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Adam C. Riggall,et al.  Distributed Patterns of Activity in Sensory Cortex Reflect the Precision of Multiple Items Maintained in Visual Short-Term Memory , 2013, The Journal of Neuroscience.

[33]  Matthias M. Müller,et al.  Attentional Selection of Feature Conjunctions Is Accomplished by Parallel and Independent Selection of Single Features , 2015, The Journal of Neuroscience.

[34]  J Jonides,et al.  The where and how of attention-based rehearsal in spatial working memory. , 2004, Brain research. Cognitive brain research.

[35]  Harri Valpola,et al.  Denoising Source Separation , 2005, J. Mach. Learn. Res..

[36]  Kerry Hourigan,et al.  Wake transition of a rolling sphere , 2011, J. Vis..

[37]  Bradley R Postle,et al.  The cognitive neuroscience of visual short-term memory , 2015, Current Opinion in Behavioral Sciences.

[38]  Søren K. Andersen,et al.  Attentional bias of competitive interactions in neuronal networks of early visual processing in the human brain , 2008, NeuroImage.

[39]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[40]  Emanuele Lo Gerfo,et al.  Augmenting distractor filtering via transcranial magnetic stimulation of the lateral occipital cortex , 2016, Cortex.

[41]  O. Jensen,et al.  Alpha Oscillations Serve to Protect Working Memory Maintenance against Anticipated Distracters , 2012, Current Biology.

[42]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[43]  Edward Awh,et al.  The Role of Spatial Selective Attention in Working Memory for Locations: Evidence from Event-Related Potentials , 2000, Journal of Cognitive Neuroscience.

[44]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[45]  J. Jonides,et al.  Rehearsal in spatial working memory. , 1998, Journal of experimental psychology. Human perception and performance.

[46]  Edward F. Ester,et al.  Restoring Latent Visual Working Memory Representations in Human Cortex , 2016, Neuron.

[47]  P. Uhlhaas,et al.  Working memory and neural oscillations: alpha–gamma versus theta–gamma codes for distinct WM information? , 2014, Trends in Cognitive Sciences.

[48]  Joram van Driel,et al.  Proactive, but Not Reactive, Distractor Filtering Relies on Local Modulation of Alpha Oscillatory Activity , 2016, Journal of Cognitive Neuroscience.

[49]  Gregory McCarthy,et al.  Electrophysiological Correlates of Refreshing: Event-related Potentials Associated with Directing Reflective Attention to Face, Scene, or Word Representations , 2015, Journal of Cognitive Neuroscience.

[50]  Marcia Grabowecky,et al.  Differential Roles of Frequency-following and Frequency-doubling Visual Responses Revealed by Evoked Neural Harmonics , 2011, Journal of Cognitive Neuroscience.

[51]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[52]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[53]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[54]  David J. Prime,et al.  Inability to suppress salient distractors predicts low visual working memory capacity , 2016, Proceedings of the National Academy of Sciences.

[55]  Kimron L. Shapiro,et al.  The role of biased competition in visual short-term memory , 2011, Neuropsychologia.

[56]  Annabelle Blangero,et al.  Electrophysiological indices of surround suppression in humans. , 2015, Journal of neurophysiology.

[57]  Ronald R. Peeters,et al.  Attentional priorities and access to short-term memory: Parietal interactions , 2012, NeuroImage.

[58]  Tirin Moore,et al.  Persistent Spatial Information in the Frontal Eye Field during Object-Based Short-Term Memory , 2012, The Journal of Neuroscience.

[59]  A. Gazzaley Influence of early attentional modulation on working memory , 2011, Neuropsychologia.

[60]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[61]  Edmund Wascher,et al.  Mechanisms of target localization in visual change detection: An interplay of gating and filtering , 2013, Behavioural Brain Research.

[62]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[63]  N. Cowan,et al.  Visual working memory depends on attentional filtering , 2006, Trends in Cognitive Sciences.

[64]  E. Vogel,et al.  Interactions between attention and working memory , 2006, Neuroscience.

[65]  E. Vogel,et al.  Individual Differences in Recovery Time From Attentional Capture , 2011, Psychological science.

[66]  P. Sauseng,et al.  Neural correlates of visuo-spatial working memory encoding—An EEG study , 2011, Neuroscience Letters.

[67]  Frank Tong,et al.  Spatial specificity of working memory representations in the early visual cortex. , 2014, Journal of vision.

[68]  Kartik K. Sreenivasan,et al.  Selective Attention Supports Working Memory Maintenance by Modulating Perceptual Processing of Distractors , 2007, Journal of Cognitive Neuroscience.

[69]  Marcia K. Johnson,et al.  A brief thought can modulate activity in extrastriate visual areas: Top-down effects of refreshing just-seen visual stimuli , 2007, NeuroImage.

[70]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[71]  Pieter R Roelfsema,et al.  Early Visual Cortex as a Multiscale Cognitive Blackboard. , 2016, Annual review of vision science.

[72]  Michael X. Cohen,et al.  Rhythmic entrainment source separation: Optimizing analyses of neural responses to rhythmic sensory stimulation , 2016, NeuroImage.

[73]  Edward Awh,et al.  The bouncer in the brain , 2008, Nature Neuroscience.

[74]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[75]  E. Vogel,et al.  Human Variation in Overriding Attentional Capture , 2009, The Journal of Neuroscience.

[76]  Ben M. Crittenden,et al.  Distinct Mechanisms for Distractor Suppression and Target Facilitation , 2016, The Journal of Neuroscience.

[77]  Gennadiy Gurariy,et al.  The steady-state visual evoked potential reveals neural correlates of the items encoded into visual working memory , 2014, Neuropsychologia.

[78]  John T Serences,et al.  Neural mechanisms of information storage in visual short-term memory , 2016, Vision Research.

[79]  T. Egner,et al.  Working memory as internal attention: Toward an integrative account of internal and external selection processes , 2012, Psychonomic Bulletin & Review.

[80]  Y. Saalmann,et al.  Rhythmic Sampling within and between Objects despite Sustained Attention at a Cued Location , 2013, Current Biology.

[81]  H. Spekreijse,et al.  Large capacity storage of integrated objects before change blindness , 2003, Vision Research.

[82]  Hiroshi Handa,et al.  A Neural Correlate of Working Memory in the Monkey Primary Visual Cortex , 2017 .

[83]  A. Nobre,et al.  Markers of preparatory attention predict visual short-term memory performance , 2011, Neuropsychologia.

[84]  G. Mangun,et al.  Signal enhancement and suppression during visual–spatial selective attention , 2010, Brain Research.

[85]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[86]  Kartik K. Sreenivasan,et al.  Evidence for working memory storage operations in perceptual cortex , 2014, Cognitive, affective & behavioral neuroscience.

[87]  Marcia K. Johnson,et al.  Top–Down Enhancement and Suppression of Activity in Category-selective Extrastriate Cortex from an Act of Reflective Attention , 2009, Journal of Cognitive Neuroscience.