Neural sources of visual working memory maintenance in human parietal and ventral extrastriate visual cortex

Maintaining information in visual working memory is reliably indexed by the contralateral delay activity (CDA) - a sustained modulation of the event-related potential (ERP) with a topographical maximum over posterior scalp regions contralateral to the memorized input. Based on scalp topography, it is hypothesized that the CDA reflects neural activity in the parietal cortex, but the precise cortical origin of underlying electric activity was never determined. Here we combine ERP recordings with magnetoencephalography based source localization to characterize the cortical current sources generating the CDA. Observers performed a cued delayed match to sample task where either the color or the relative position of colored dots had to be maintained in memory. A detailed source-localization analysis of the magnetic activity in the retention interval revealed that the magnetic analog of the CDA (mCDA) is generated by current sources in the parietal cortex. Importantly, we find that the mCDA also receives contribution from current sources in the ventral extrastriate cortex that display a time-course similar to the parietal sources. On the basis of the magnetic responses, forward modeling of ERP data reveals that the ventral sources have non-optimal projections and that these sources are therefore concealed in the ERP by overlapping fields with parietal projections. The present observations indicate that visual working memory maintenance, as indexed by the CDA, involves the parietal cortical regions as well as the ventral extrastriate regions, which code the sensory representation of the memorized content.

[1]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[2]  J. Matias Palva,et al.  Localization of Cortical Phase and Amplitude Dynamics during Visual Working Memory Encoding and Retention , 2011, The Journal of Neuroscience.

[3]  J. Palva,et al.  Neuronal synchrony reveals working memory networks and predicts individual memory capacity , 2010, Proceedings of the National Academy of Sciences.

[4]  Stephen E. Robinson Environmental Noise Cancellation for Biomagnetic Measurements , 1989 .

[5]  Leslie G. Ungerleider,et al.  Neural Correlates of Visual Working Memory fMRI Amplitude Predicts Task Performance , 2002, Neuron.

[6]  Geoffrey F. Woodman,et al.  Electrophysiological measurement of rapid shifts of attention during visual search , 1999, Nature.

[7]  Carsten Nicolas Boehler,et al.  Attentional selection for locations, features, and objects in vision , 2012 .

[8]  S. Luck,et al.  Electrophysiological correlates of feature analysis during visual search. , 1994, Psychophysiology.

[9]  H Spekreijse,et al.  A Neural Correlate of Working Memory in the Monkey Primary Visual Cortex , 2001, Science.

[10]  M. Eimer The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[11]  David L. Sheinberg,et al.  Neural Dynamics in Inferior Temporal Cortex during a Visual Working Memory Task , 2009, The Journal of Neuroscience.

[12]  G. Woodman,et al.  Selective storage and maintenance of an object’s features in visual working memory , 2008, Psychonomic bulletin & review.

[13]  R. Dolan,et al.  Active representation of shape and spatial location in man. , 1996, Cerebral cortex.

[14]  P. Jolicoeur,et al.  Bilateral parietal and contralateral responses during maintenance of unilaterally encoded objects in visual short-term memory: evidence from magnetoencephalography. , 2009, Psychophysiology.

[15]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[16]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[18]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[19]  Braden A. Purcell,et al.  Homologous Mechanisms of Visuospatial Working Memory Maintenance in Macaque and Human: Properties and Sources , 2012, Journal of Neuroscience.

[20]  Maro G. Machizawa,et al.  Electrophysiological Measures of Maintaining Representations in Visual Working Memory , 2007, Cortex.

[21]  O. Bertrand,et al.  Oscillatory Synchrony between Human Extrastriate Areas during Visual Short-Term Memory Maintenance , 2001, The Journal of Neuroscience.

[22]  A. Nobre,et al.  Attentional modulation of object representations in working memory. , 2007, Cerebral cortex.

[23]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[24]  P. Roland,et al.  Bilateral activation of fronto-parietal networks by incrementing demand in a working memory task. , 1997, Cerebral cortex.

[25]  Hans-Jochen Heinze,et al.  Neural Mechanisms of Surround Attenuation and Distractor Competition in Visual Search , 2011, The Journal of Neuroscience.

[26]  Edward E. Smith,et al.  Spatial working memory in humans as revealed by PET , 1993, Nature.

[27]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[28]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[29]  S. Magnussen Low-level memory processes in vision , 2000, Trends in Neurosciences.

[30]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[31]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[32]  E. Vogel,et al.  Contralateral delay activity provides a neural measure of the number of representations in visual working memory. , 2010, Journal of neurophysiology.

[33]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[34]  M. Fuchs,et al.  An improved boundary element method for realistic volume-conductor modeling , 1998, IEEE Transactions on Biomedical Engineering.

[35]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[36]  P. Goldman-Rakic,et al.  Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[38]  Edward E. Smith,et al.  Rehearsal in Spatial Working Memory: Evidence From Neuroimaging , 1999 .

[39]  R. Passingham,et al.  Active maintenance in prefrontal area 46 creates distractor-resistant memory , 2002, Nature Neuroscience.

[40]  M. D’Esposito,et al.  Functional connectivity during working memory maintenance , 2004, Cognitive, affective & behavioral neuroscience.

[41]  Denis Schluppeck,et al.  Decoding Working Memory of Stimulus Contrast in Early Visual Cortex , 2013, The Journal of Neuroscience.

[42]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[43]  Geoffrey F Woodman,et al.  Serial deployment of attention during visual search. , 2003, Journal of experimental psychology. Human perception and performance.

[44]  Geoffrey F. Woodman,et al.  Attentional Templates in Visual Working Memory , 2011, The Journal of Neuroscience.

[45]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[46]  Edward K. Vogel,et al.  Shape and color conjunction stimuli are represented as bound objects in visual working memory , 2011 .

[47]  Adrian M Owen,et al.  Working Memory: Imaging the Magic Number Four , 2004, Current Biology.

[48]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[49]  Jesper Tegnér,et al.  Mechanism for top-down control of working memory capacity , 2009, Proceedings of the National Academy of Sciences.

[50]  Jason T. Arita,et al.  Direct Electrophysiological Measurement of Attentional Templates in Visual Working Memory , 2011, Psychological science.

[51]  Robert T. Knight,et al.  Contributions of Subregions of the Prefrontal Cortex to Working Memory: Evidence from Brain Lesions in Humans , 2002, Journal of Cognitive Neuroscience.

[52]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[53]  B R Postle,et al.  "What"-Then-Where" in visual working memory: an event-related fMRI study. , 1999, Journal of cognitive neuroscience.

[54]  Mark W. Greenlee,et al.  Brain regions involved in spatial frequency discrimination: evidence from fMRI , 2000, Experimental Brain Research.

[55]  P. Goldman-Rakic,et al.  Functional magnetic resonance imaging of human prefrontal cortex activation during a spatial working memory task. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[56]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[57]  M. D’Esposito,et al.  Dissecting Contributions of Prefrontal Cortex and Fusiform Face Area to Face Working Memory , 2003, Journal of Cognitive Neuroscience.

[58]  M D'Esposito,et al.  The roles of prefrontal brain regions in components of working memory: effects of memory load and individual differences. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Leslie G. Ungerleider,et al.  Object and spatial visual working memory activate separate neural systems in human cortex. , 1996, Cerebral cortex.

[60]  Dag Alnæs,et al.  Visual short-term memory: Activity supporting encoding and maintenance in retinotopic visual cortex , 2012, NeuroImage.

[61]  O. Jensen,et al.  Modulation of Gamma and Alpha Activity during a Working Memory Task Engaging the Dorsal or Ventral Stream , 2007, The Journal of Neuroscience.

[62]  Jason T. Arita,et al.  A cuing study of the N2pc component: An index of attentional deployment to objects rather than spatial locations , 2009, Brain Research.

[63]  J. Fuster,et al.  Inferotemporal neurons distinguish and retain behaviorally relevant features of visual stimuli. , 1981, Science.

[64]  J Jonides,et al.  The where and how of attention-based rehearsal in spatial working memory. , 2004, Brain research. Cognitive brain research.

[65]  S. Luck,et al.  Neural sources of focused attention in visual search. , 2000, Cerebral cortex.

[66]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[67]  Nicolas Robitaille,et al.  Attentional and anatomical considerations for the representation of simple stimuli in visual short-term memory: evidence from human electrophysiology , 2009, Psychological research.

[68]  J. Jonides,et al.  Neuroimaging analyses of human working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[69]  Guideline Thirteen: Guidelines for Standard Electrode Position Nomenclature , 1994, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[70]  Jeffrey D Schall,et al.  Nonhuman primate event-related potentials indexing covert shifts of attention , 2007, Proceedings of the National Academy of Sciences.

[71]  J. Wolfe,et al.  Delineating the Neural Signatures of Tracking Spatial Position and Working Memory during Attentive Tracking , 2011, The Journal of Neuroscience.

[72]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[73]  M. Fuchs,et al.  Linear and nonlinear current density reconstructions. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[74]  Michael X. Cohen,et al.  Inferior Temporal, Prefrontal, and Hippocampal Contributions to Visual Working Memory Maintenance and Associative Memory Retrieval , 2004, The Journal of Neuroscience.

[75]  M. D’Esposito,et al.  Activity in fusiform face area modulated as a function of working memory load. , 2001, Brain research. Cognitive brain research.

[76]  Matti S. Hämäläinen,et al.  Functional localization based on measurements with a whole-head magnetometer system , 2005, Brain Topography.

[77]  Edward K. Vogel,et al.  What ERPs Can Tell Us about Working Memory , 2011 .

[78]  E. Vogel,et al.  Shape and color conjunction stimuli are represented as bound objects in visual working memory , 2011, Neuropsychologia.

[79]  R. Desimone,et al.  Activity of neurons in anterior inferior temporal cortex during a short- term memory task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[80]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  E. Vogel,et al.  Visual Search Demands Dictate Reliance upon Working Memory Storage , 2011 .

[82]  G. V. Simpson,et al.  Phase Locking of Single Neuron Activity to Theta Oscillations during Working Memory in Monkey Extrastriate Visual Cortex , 2003, Neuron.

[83]  Bradley Voytek,et al.  Prefrontal cortex and basal ganglia contributions to visual working memory , 2010, Proceedings of the National Academy of Sciences.

[84]  Benoit Brisson,et al.  Dissociation of the N2pc and sustained posterior contralateral negativity in a choice response task , 2008, Brain Research.

[85]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[86]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.