For whom the bell tolls: periodic reactivation of sensory cortex in the gamma band as a substrate of visual working memory maintenance

Working memory (WM) is central to human cognition as it allows information to be kept online over brief periods of time and facilitates its usage in cognitive operations (Luck and Vogel, 2013). How this information maintenance actually is implemented is still a matter of debate. Several independent theories of WM, derived, respectively, from behavioral studies and neural considerations, advance the idea that items in WM decay over time and must be periodically reactivated. In this proposal, we show how recent data from intracranial EEG and attention research naturally leads to a simple model of such reactivation in the case of sensory memories. Specifically, in our model the amplitude of high-frequency activity (>50 Hz, in the gamma-band) underlies the representation of items in high-level visual areas. This activity decreases to noise-levels within 500 ms, unless it is reactivated. We propose that top-down attention, which targets multiple sensory items in a cyclical or rhythmic fashion at around 6–10 Hz, reactivates these decaying gamma-band representations. Therefore, working memory capacity is essentially the number of representations that can simultaneously be kept active by a rhythmically sampling attentional spotlight given the known decay rate. Since attention samples at 6–10 Hz, the predicted WM capacity is 3–5 items, in agreement with empirical findings.

[1]  Werner Lutzenberger,et al.  Dynamics of Gamma-Band Activity during an Audiospatial Working Memory Task in Humans , 2002, The Journal of Neuroscience.

[2]  P. Downing,et al.  Interactions Between Visual Working Memory and Selective Attention , 2000, Psychological science.

[3]  Min-Shik Kim,et al.  The role of spatial working memory in visual search efficiency , 2004, Psychonomic bulletin & review.

[4]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[5]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[6]  Miguel P Eckstein,et al.  Visual search: a retrospective. , 2011, Journal of vision.

[7]  N. P. Bichot,et al.  Visual selection mediated by location: Feature-based selection of noncontiguous locations , 1999, Perception & psychophysics.

[8]  Jeremy M Wolfe,et al.  Attentional pursuit is faster than attentional saccade. , 2004, Journal of vision.

[9]  C. Koch,et al.  Attention-driven discrete sampling of motion perception. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[10]  N. Cowan Attention and Memory: An Integrated Framework , 1995 .

[11]  P Cavanagh,et al.  Familiarity and pop-out in visual search , 1994, Perception & psychophysics.

[12]  G. Adam The relationship between attention and working memory , 2011 .

[13]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[14]  N. Cowan Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[15]  Juan R. Vidal,et al.  Category-Specific Visual Responses: An Intracranial Study Comparing Gamma, Beta, Alpha, and ERP Response Selectivity , 2010, Front. Hum. Neurosci..

[16]  Rodrigo F. Salazar,et al.  Content-Specific Fronto-Parietal Synchronization During Visual Working Memory , 2012, Science.

[17]  Selection And Storage , 1998, The Pepper Lady’s Pocket Pepper Primer.

[18]  Patrick Cavanagh,et al.  The blinking spotlight of attention , 2007, Proceedings of the National Academy of Sciences.

[19]  J. Fell,et al.  Cross-frequency coupling supports multi-item working memory in the human hippocampus , 2010, Proceedings of the National Academy of Sciences.

[20]  John Kounios,et al.  Coherent oscillatory networks supporting short-term memory retention , 2009, Brain Research.

[21]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[22]  J. Lisman,et al.  The Theta-Gamma Neural Code , 2013, Neuron.

[23]  Brian Litt,et al.  Behavioral / Systems / Cognitive Hippocampal Gamma Oscillations Increase with Memory Load , 2010 .

[24]  Todd S Horowitz,et al.  Distinguishing between parallel and serial accounts of multiple object tracking. , 2010, Journal of vision.

[25]  K. Nakayama,et al.  Situating visual search , 2011, Vision Research.

[26]  Patrick Cavanagh,et al.  Distinguishing models of multifocal attention: It's a matter of time , 2010 .

[27]  Thomas A Carlson,et al.  Timing divided attention. , 2010, Attention, perception & psychophysics.

[28]  J. Fell,et al.  The role of phase synchronization in memory processes , 2011, Nature Reviews Neuroscience.

[29]  Andrew B Leber,et al.  Neural Predictors of Within-Subject Fluctuations in Attentional Control , 2010, The Journal of Neuroscience.

[30]  Michael X. Cohen,et al.  Sustained Neural Activity Patterns during Working Memory in the Human Medial Temporal Lobe , 2007, The Journal of Neuroscience.

[31]  A. Raffone,et al.  A Cortical Mechanism for Binding in Visual Working Memory , 2001, Journal of Cognitive Neuroscience.

[32]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[33]  S. Nishida,et al.  4. Jewels in the sea , 2001 .

[34]  P. Brown,et al.  Influence of working memory on patterns of motor related cortico-cortical coupling , 2004, Experimental Brain Research.

[35]  R. VanRullen,et al.  Spontaneous EEG oscillations reveal periodic sampling of visual attention , 2010, Proceedings of the National Academy of Sciences.

[36]  Philippe Kahane,et al.  Reading the mind's eye: Online detection of visuo-spatial working memory and visual imagery in the inferior temporal lobe , 2012, NeuroImage.

[37]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[38]  R. Knight,et al.  The functional role of cross-frequency coupling , 2010, Trends in Cognitive Sciences.

[39]  J. Wolfe,et al.  What Can 1 Million Trials Tell Us About Visual Search? , 1998 .

[40]  B. Breitmeyer,et al.  Interactions Between Visual Working Memory and Selective Attention in Adults, Control Children, and Survivors of Pediatric Cancer , 2016 .

[41]  H Petsche,et al.  Synchronization between temporal and parietal cortex during multimodal object processing in man. , 1999, Cerebral cortex.

[42]  R. Engle,et al.  Working-memory capacity as long-term memory activation: an individual-differences approach. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[43]  J. Jonides,et al.  Rehearsal in spatial working memory. , 1998, Journal of experimental psychology. Human perception and performance.

[44]  P. Barrouillet,et al.  Time constraints and resource sharing in adults' working memory spans. , 2004, Journal of experimental psychology. General.

[45]  Dwight J. Kravitz,et al.  Goal-dependent dissociation of visual and prefrontal cortices during working memory , 2013, Nature Neuroscience.

[46]  Jeffrey S. Johnson,et al.  The role of attention in the maintenance of feature bindings in visual short-term memory. , 2008, Journal of experimental psychology. Human perception and performance.

[47]  G. Woodman,et al.  Visual search is slowed when visuospatial working memory is occupied , 2004, Psychonomic bulletin & review.

[48]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[49]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[50]  Febo Cincotti,et al.  Functional frontoparietal connectivity during short-term memory as revealed by high-resolution EEG coherence analysis. , 2004, Behavioral neuroscience.

[51]  Ravi S. Menon,et al.  Human fMRI evidence for the neural correlates of preparatory set , 2002, Nature Neuroscience.

[52]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[53]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[54]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[55]  W. Singer,et al.  Oscillatory Neuronal Synchronization in Primary Visual Cortex as a Correlate of Stimulus Selection , 2002, The Journal of Neuroscience.

[56]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[57]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[58]  G. Woodman,et al.  Visual Search Remains Efficient when Visual Working Memory is Full , 2001, Psychological science.

[59]  Min-Shik Kim,et al.  The guidance effect of working memory load on visual search , 2010 .

[60]  Philippe Kahane,et al.  The neural bases of attentive reading , 2008, Human brain mapping.

[61]  D. E. Irwin,et al.  Attention on our mind: the role of spatial attention in visual working memory. , 2011, Acta psychologica.

[62]  Giovanni Maria Carlomagno,et al.  Heat flux sensors and infrared thermography , 2007, J. Vis..

[63]  U. Castiello,et al.  Splitting focal attention. , 1992, Journal of experimental psychology. Human perception and performance.

[64]  P. Barrouillet,et al.  Time and cognitive load in working memory. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[65]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[66]  J R Anderson,et al.  Retrieval of information from long-term memory. , 1983, Science.

[67]  A. Jha,et al.  Tracking the time-course of attentional involvement in spatial working memory: an event-related potential investigation. , 2002, Brain research. Cognitive brain research.

[68]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[69]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[70]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[71]  R. VanRullen,et al.  Attention is a state of mind: Phase of ongoing EEG oscillations predicts the timing of attentional deployment , 2011 .

[72]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[73]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[74]  Edward Awh,et al.  Selection and storage of perceptual groups is constrained by a discrete resource in working memory. , 2013, Journal of experimental psychology. Human perception and performance.

[75]  Huan Luo,et al.  Behavioral Oscillations in Attention: Rhythmic α Pulses Mediated through θ Band , 2014, The Journal of Neuroscience.

[76]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[77]  A. Karim,et al.  Brain Oscillatory Substrates of Visual Short-Term Memory Capacity , 2009, Current Biology.

[78]  Michael A. Cohen,et al.  The speed of free will , 2009, Quarterly journal of experimental psychology.

[79]  Michael D'Zmura,et al.  Color in visual search , 1991, Vision Research.

[80]  Erich Schröger,et al.  Synchronized brain activity during rehearsal and short-term memory disruption by irrelevant speech is affected by recall mode. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[81]  D. LaBerge,et al.  Theory of attentional operations in shape identification. , 1989 .

[82]  A. Baddeley,et al.  The multi-component model of working memory: Explorations in experimental cognitive psychology , 2006, Neuroscience.

[83]  Rufin VanRullen,et al.  Bullet trains and steam engines: exogenous attention zips but endogenous attention chugs along. , 2011, Journal of vision.

[84]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[85]  R. Passingham,et al.  Prefrontal interactions reflect future task operations , 2003, Nature Neuroscience.