When memory leads the brain to take scenes at face value: face areas are reactivated at test by scenes that were paired with faces at study

In the first use of the event-related optical signal as a brain imaging tool for the study of long-term memory, we examined relational or associative aspects of memory, widely presumed to involve the interplay among multiple brain regions in representing and reactivating different elements of a given event. Here, we found that a brain region known to be involved in face processing (the posterior superior temporal sulcus) was active not only when viewing faces during the study phase but also when viewing scenes at test that, through prior learning, were associated with specific faces. These findings, demonstrating the activation of stimulus-specific cortical regions in the absence of stimuli of that type, based on learned relations, reveal cortical substrates of the reactivation of relational memories.

[1]  M. Rugg,et al.  An event-related potential study of explicit memory on tests of cued recall and recognition , 1997, Neuropsychologia.

[2]  R. Vines THE LONG AND THE SHORT , 1977, The Medical journal of Australia.

[3]  Neal J. Cohen,et al.  The Long and the Short of It: Relational Memory Impairments in Amnesia, Even at Short Lags , 2006, The Journal of Neuroscience.

[4]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[5]  Bradley R Postle,et al.  The dependence of span and delayed-response performance on prefrontal cortex , 1999, Neuropsychologia.

[6]  G. Gratton,et al.  Optimum filtering for EROS measurements. , 2003, Psychophysiology.

[7]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[9]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[10]  R. Johnson,et al.  A spatio-temporal comparison of semantic and episodic cued recall and recognition using event-related brain potentials. , 1998, Brain research. Cognitive brain research.

[11]  Mark D'Esposito,et al.  Attention Selectively Modifies the Representation of Individual Faces in the Human Brain , 2013, The Journal of Neuroscience.

[12]  C. Ranganath,et al.  The Dorsolateral Prefrontal Cortex Contributes to Successful Relational Memory Encoding , 2007, The Journal of Neuroscience.

[13]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[14]  S. Guderian,et al.  Four types of novelty–familiarity responses in associative recognition memory of humans , 2004, The European journal of neuroscience.

[15]  V. French,et al.  The long and the short of it , 1993, Nature.

[16]  Jeffrey D. Johnson,et al.  Recollection and the reinstatement of encoding-related cortical activity. , 2007, Cerebral cortex.

[17]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[18]  Michael D. Rugg,et al.  Recollection and the Reinstatement of , 2007 .

[19]  Monica Fabiani,et al.  Fast Optical Imaging of Human Brain Function , 2010, Front. Hum. Neurosci..

[20]  David E. Warren,et al.  Hippocampal Amnesia Impairs All Manner of Relational Memory , 2008, Frontiers in human neuroscience.

[21]  R. Cabeza,et al.  Lateralization of Prefrontal Activity during Episodic Memory Retrieval: Evidence for the Production-Monitoring Hypothesis , 2003, Journal of Cognitive Neuroscience.

[22]  Neal J. Cohen,et al.  Rapid Onset Relational Memory Effects Are Evident in Eye Movement Behavior, but Not in Hippocampal Amnesia , 2007, Journal of Cognitive Neuroscience.

[23]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[24]  G Gratton,et al.  Removing the heart from the brain: compensation for the pulse artifact in the photon migration signal. , 1995, Psychophysiology.

[25]  Anthony D Wagner,et al.  Executive Control during Episodic Retrieval Multiple Prefrontal Processes Subserve Source Memory , 2002, Neuron.

[26]  H. Eichenbaum A cortical–hippocampal system for declarative memory , 2000, Nature Reviews Neuroscience.

[27]  Ellen M. Migo,et al.  Associative memory and the medial temporal lobes , 2007, Trends in Cognitive Sciences.

[28]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[29]  N. J. Cohen,et al.  Eye-movement-based memory effect: a reprocessing effect in face perception. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[30]  Marcia K. Johnson,et al.  Left Anterior Prefrontal Activation Increases with Demands to Recall Specific Perceptual Information , 2000, The Journal of Neuroscience.

[31]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[32]  Alan C. Evans,et al.  Detecting changes in nonisotropic images , 1999, Human brain mapping.

[33]  Paul M. Corballis,et al.  Toward Noninvasive 3-D Imaging of the Time Course of Cortical Activity: Investigation of the Depth of the Event-Related Optical Signal , 2000, NeuroImage.

[34]  Michael C. Doyle,et al.  An event-related potential study of word-stem cued recall. , 1996, Brain research. Cognitive brain research.

[35]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[36]  Christopher R. Madan,et al.  The influence of item properties on association-memory , 2010 .

[37]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[38]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[39]  E. Benarroch Executive Control , 2022, Neuroscience for Clinicians.

[40]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[41]  J. Hodges Memory, Amnesia and the Hippocampal System , 1995 .

[42]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[43]  Umberto Castiello,et al.  The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies , 2003, NeuroImage.

[44]  Deborah E. Hannula,et al.  The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements , 2009, Neuron.

[45]  Scott D. Slotnick,et al.  The Fusiform Face Area , 2013 .

[46]  C Sato,et al.  [Optical imaging of brain function]. , 2001, No to shinkei = Brain and nerve.

[47]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[48]  W. K. Simmons,et al.  A common neural substrate for perceiving and knowing about color , 2007, Neuropsychologia.

[49]  Monica Fabiani,et al.  Validation of a method for coregistering scalp recording locations with 3D structural MR images , 2008, Human brain mapping.

[50]  M. Brodeur,et al.  Prefrontal cortex contribution to associative recognition memory in humans: an event-related functional magnetic resonance imaging study , 2003, Neuroscience Letters.

[51]  James B. Rowe,et al.  Working Memory for Location and Time: Activity in Prefrontal Area 46 Relates to Selection Rather than Maintenance in Memory , 2001, NeuroImage.

[52]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[53]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[54]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[55]  N. Cohen,et al.  Amnesia is a Deficit in Relational Memory , 2000, Psychological science.

[56]  Patrik Vuilleumier,et al.  Reactivation of visual cortex during memory retrieval: Content specificity and emotional modulation , 2012, NeuroImage.

[57]  R. Henson,et al.  Episodic Reinstatement in the Medial Temporal Lobe , 2012, The Journal of Neuroscience.

[58]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[59]  R. Passingham,et al.  The prefrontal cortex: response selection or maintenance within working memory? , 2000, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[60]  Alex Martin,et al.  Experience-dependent modulation of category-related cortical activity. , 2002, Cerebral cortex.

[61]  Leslie G. Ungerleider,et al.  The Representation of Objects in the Human Occipital and Temporal Cortex , 2000, Journal of Cognitive Neuroscience.

[62]  R. Henson,et al.  Reversible Information Flow across the Medial Temporal Lobe: The Hippocampus Links Cortical Modules during Memory Retrieval , 2013, The Journal of Neuroscience.

[63]  John Q. Trojanowski,et al.  dorsolateral prefrontal cortex , 1999 .

[64]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.