Reconstructions of Information in Visual Spatial Working Memory Degrade with Memory Load

Working memory (WM) enables the maintenance and manipulation of information relevant to behavioral goals. Variability in WM ability is strongly correlated with IQ [1], and WM function is impaired in many neurological and psychiatric disorders [2, 3], suggesting that this system is a core component of higher cognition. WM storage is thought to be mediated by patterns of activity in neural populations selective for specific properties (e.g., color, orientation, location, and motion direction) of memoranda [4-13]. Accordingly, many models propose that differences in the amplitude of these population responses should be related to differences in memory performance [14, 15]. Here, we used functional magnetic resonance imaging and an image reconstruction technique based on a spatial encoding model [16] to visualize and quantify population-level memory representations supported by multivoxel patterns of activation within regions of occipital, parietal and frontal cortex while participants precisely remembered the location(s) of zero, one, or two small stimuli. We successfully reconstructed images containing representations of the remembered-but not forgotten-locations within regions of occipital, parietal, and frontal cortex using delay-period activation patterns. Critically, the amplitude of representations of remembered locations and behavioral performance both decreased with increasing memory load. These results suggest that differences in visual WM performance between memory load conditions are mediated by changes in the fidelity of large-scale population response profiles distributed across multiple areas of human cortex.

[1]  Edward Awh,et al.  Attending Multiple Items Decreases the Selectivity of Population Responses in Human Primary Visual Cortex , 2013, The Journal of Neuroscience.

[2]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[3]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[4]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[5]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[6]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[7]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[8]  Sohee Park,et al.  Schizophrenics show spatial working memory deficits. , 1992, Archives of general psychiatry.

[9]  John T. Serences,et al.  Computational advances towards linking BOLD and behavior , 2012, Neuropsychologia.

[10]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[11]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[12]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[13]  J. Serences,et al.  Spatial attention improves the quality of population codes in human visual cortex. , 2010, Journal of neurophysiology.

[14]  Edward Awh,et al.  A Neural Measure of Precision in Visual Working Memory , 2013, Journal of Cognitive Neuroscience.

[15]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[16]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[17]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[18]  John T. Serences,et al.  Attention modulates spatial priority maps in the human occipital, parietal and frontal cortices , 2013, Nature Neuroscience.

[19]  Edward Awh,et al.  Induced Alpha Rhythms Track the Content and Quality of Visual Working Memory Representations with High Temporal Precision , 2014, The Journal of Neuroscience.

[20]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[21]  T. Paus Location and function of the human frontal eye-field: A selective review , 1996, Neuropsychologia.

[22]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[23]  M. Sereno,et al.  Multisensory maps in parietal cortex☆ , 2014, Current Opinion in Neurobiology.

[24]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[25]  J. Serences,et al.  Near-Real-Time Feature-Selective Modulations in Human Cortex , 2013, Current Biology.

[26]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[27]  Adam C. Riggall,et al.  Distributed Patterns of Activity in Sensory Cortex Reflect the Precision of Multiple Items Maintained in Visual Short-Term Memory , 2013, The Journal of Neuroscience.

[28]  Clayton E Curtis,et al.  Prioritized Maps of Space in Human Frontoparietal Cortex , 2012, The Journal of Neuroscience.

[29]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[30]  R. Wurtz,et al.  Visual receptive fields of frontal eye field neurons. , 1973, Brain research.

[31]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[32]  Clayton E. Curtis,et al.  Persistent neural activity during the maintenance of spatial position in working memory , 2008, NeuroImage.

[33]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[34]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[35]  R. Bickford,et al.  The relationship of head size to alpha frequency with implications to a brain wave model. , 1978, Electroencephalography and clinical neurophysiology.

[36]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[37]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[38]  R. Engle,et al.  The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective , 2002, Psychonomic bulletin & review.

[39]  J. Jonides,et al.  Rehearsal in spatial working memory. , 1998, Journal of experimental psychology. Human perception and performance.