Dissecting the neural focus of attention reveals distinct processes for spatial attention and object-based storage in visual working memory

Working memory (WM) maintains relevant information in an accessible state, and is composed of an active focus of attention and passive offline storage. Here, we dissect the focus of attention by showing that distinct neural signals index the online storage of objects and sustained spatial attention. We recorded EEG activity during two tasks that employed identical stimulus displays while the relative demands for object storage and spatial attention varied. Across four experiments, we found dissociable delay-period signatures for an attention task (which only required spatial attention) and WM task (which invoked both spatial attention and object storage). Although both tasks required active maintenance of spatial information, only the WM task elicited robust contralateral delay activity that was sensitive to the number of items in the array. Thus, we argue that the focus of attention is maintained via the combined operation of distinct processes for covert spatial orienting and object-based storage.

[1]  Elkan G. Akyürek,et al.  Dynamic hidden states underlying working memory guided behaviour , 2017, Nature Neuroscience.

[2]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[3]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[4]  E. Vogel,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004 .

[5]  Edward Awh,et al.  Alpha-Band Oscillations Enable Spatially and Temporally Resolved Tracking of Covert Spatial Attention , 2017, Psychological science.

[6]  Edward K Vogel,et al.  Neural Evidence for the Contribution of Active Suppression During Working Memory Filtering , 2019, Cerebral cortex.

[7]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[8]  Sarah Shomstein,et al.  Visual Short-Term Memory Activity in Parietal Lobe Reflects Cognitive Processes beyond Attentional Selection , 2018, The Journal of Neuroscience.

[9]  E. Vogel,et al.  Shape and color conjunction stimuli are represented as bound objects in visual working memory , 2011, Neuropsychologia.

[10]  P. Goldman-Rakic,et al.  Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task , 1993, Nature.

[11]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[12]  G. Thut,et al.  Mechanisms of selective inhibition in visual spatial attention are indexed by α‐band EEG synchronization , 2007, The European journal of neuroscience.

[13]  John Jonides,et al.  Processes of Working Memory in Mind and Brain , 2005 .

[14]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[15]  K. Oberauer Access to information in working memory: exploring the focus of attention. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[16]  C. Phillips,et al.  Cross-Modal Decoding of Neural Patterns Associated with Working Memory: Evidence for Attention-Based Accounts of Working Memory. , 2016, Cerebral cortex.

[17]  Keisuke Fukuda,et al.  Distinct neural mechanisms for spatially lateralized and spatially global visual working memory representations. , 2016, Journal of neurophysiology.

[18]  Melonie Williams,et al.  Directed forgetting and directed remembering in visual working memory. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[19]  John J. Foxe,et al.  Increases in alpha oscillatory power reflect an active retinotopic mechanism for distracter suppression during sustained visuospatial attention. , 2006, Journal of neurophysiology.

[20]  David W. Sutterer,et al.  The topography of alpha-band activity tracks the content of spatial working memory. , 2016, Journal of neurophysiology.

[21]  Markus Siegel,et al.  Neural substrates of cognitive capacity limitations , 2011, Proceedings of the National Academy of Sciences.

[22]  D. Ruchkin,et al.  Working memory and preparation elicit different patterns of slow wave event-related brain potentials. , 1995, Psychophysiology.

[23]  Nelson Cowan,et al.  A Neural Region of Abstract Working Memory , 2011, Journal of Cognitive Neuroscience.

[24]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[25]  R. Knight,et al.  The functional role of cross-frequency coupling , 2010, Trends in Cognitive Sciences.

[26]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[27]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[28]  R. Luria,et al.  Integration of Distinct Objects in Visual Working Memory Depends on Strong Objecthood Cues Even for Different-Dimension Conjunctions. , 2016, Cerebral cortex.

[29]  Edward K. Vogel,et al.  Contralateral Delay Activity Tracks Fluctuations in Working Memory Performance , 2018, Journal of Cognitive Neuroscience.

[30]  Maria V. Sanchez-Vives,et al.  Hyperpolarization-activated graded persistent activity in the prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[31]  Nick Berggren,et al.  Does Contralateral Delay Activity Reflect Working Memory Storage or the Current Focus of Spatial Attention within Visual Working Memory? , 2016, Journal of Cognitive Neuroscience.

[32]  Adam C. Riggall,et al.  Reactivation of latent working memories with transcranial magnetic stimulation , 2016, Science.

[33]  Jason T. Arita,et al.  A cuing study of the N2pc component: An index of attentional deployment to objects rather than spatial locations , 2009, Brain Research.

[34]  S. Steinhauer,et al.  The Pupillary Response in Cognitive Psychophysiology and Schizophrenia a , 1992, Annals of the New York Academy of Sciences.

[35]  N. Cowan An embedded-processes model of working memory , 1999 .

[36]  W. Medendorp,et al.  Modulations in oscillatory activity with amplitude asymmetry can produce cognitively relevant event-related responses , 2009, Proceedings of the National Academy of Sciences.

[37]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[38]  E. Vogel,et al.  Working memory and fluid intelligence: Capacity, attention control, and secondary memory retrieval , 2014, Cognitive Psychology.

[39]  Roy Luria,et al.  Neural and Behavioral Evidence for an Online Resetting Process in Visual Working Memory , 2016, The Journal of Neuroscience.

[40]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[41]  Keisuke Fukuda,et al.  α Power Modulation and Event-Related Slow Wave Provide Dissociable Correlates of Visual Working Memory , 2015, The Journal of Neuroscience.

[42]  W. Klimesch Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[43]  Edward Awh,et al.  Alpha-Band Activity Reveals Spontaneous Representations of Spatial Position in Visual Working Memory , 2017, Current Biology.

[44]  M. Chun Visual working memory as visual attention sustained internally over time , 2011, Neuropsychologia.

[45]  Andrew Hollingworth,et al.  The relationship between visual attention and visual working memory encoding: A dissociation between covert and overt orienting. , 2016, Journal of experimental psychology. Human perception and performance.

[46]  Klaus Oberauer,et al.  Neural Evidence for a Distinction between Short-term Memory and the Focus of Attention , 2012, Journal of Cognitive Neuroscience.

[47]  E. Vogel,et al.  Neural Measures of Individual Differences in Selecting and Tracking Multiple Moving Objects , 2008, The Journal of Neuroscience.

[48]  Á. Pascual-Leone,et al.  α-Band Electroencephalographic Activity over Occipital Cortex Indexes Visuospatial Attention Bias and Predicts Visual Target Detection , 2006, The Journal of Neuroscience.

[49]  Manuel Schabus,et al.  A shift of visual spatial attention is selectively associated with human EEG alpha activity , 2005, The European journal of neuroscience.

[50]  Edward Awh,et al.  The contralateral delay activity as a neural measure of visual working memory , 2016, Neuroscience & Biobehavioral Reviews.

[51]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[52]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[53]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[54]  M. Stokes ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework , 2015, Trends in Cognitive Sciences.

[55]  A. Karim,et al.  Brain Oscillatory Substrates of Visual Short-Term Memory Capacity , 2009, Current Biology.

[56]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[57]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.