Neural Correlates of Relational Memory: Successful Encoding and Retrieval of Semantic and Perceptual Associations

Using event-related functional magnetic resonance imaging, we identified brain regions involved in successful relational memory (RM) during encoding and retrieval for semantic and perceptual associations or in general, independent of phase and content. Participants were scanned while encoding and later retrieving associations between pairs of words (semantic RM) or associations between words and fonts (perceptual RM). Encoding success activity (ESA) was identified by comparing study-phase activity for items subsequently remembered (hits) versus forgotten (misses) and retrieval success activity (RSA) by comparing test-phase activity for hits versus misses. The study yielded three main sets of findings. First, ESA-RSA differences were found within the medial temporal lobes (MTLs) and within the prefrontal cortex (PFC). Within the left MTL, ESA was greater in the anterior hippocampus, and RSA was greater in the posterior parahippocampal cortex/hippocampus. This finding is consistent with the notion of an encoding-retrieval gradient along the longitudinal MTL axis. Within the left PFC, ESA was greater in ventrolateral PFC, and RSA was greater in dorsolateral and anterior PFC. This is the first evidence of a dissociation in successful encoding and retrieval activity within left PFC. Second, consistent with the transfer-appropriate processing principle, some ESA regions were reactivated during RSA in a content-specific manner. For semantic RM, these regions included the left ventrolateral PFC, whereas for perceptual RM, they included occipitoparietal and right parahippocampal regions. Finally, only one region in the entire brain was associated with RM in general (i.e., for both semantic and perceptual ESA and RSA): the left hippocampus. This finding highlights the fundamental role of the hippocampus in RM.

[1]  B. Weber,et al.  Human hippocampus establishes associations in memory , 1997, Hippocampus.

[2]  F. Craik,et al.  Hemispheric encoding/retrieval asymmetry in episodic memory: positron emission tomography findings. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Daniel L. Schacter,et al.  Retrieval of Relational Information: A Role for the Left Inferior Prefrontal Cortex , 2002, NeuroImage.

[4]  D. Schnyer,et al.  A critical role for the anterior hippocampus in relational memory: Evidence from an fMRI study comparing associative and item recognition , 2004, Hippocampus.

[5]  Karl J. Friston,et al.  The Functional Neuroanatomy of Temporal Discrimination , 2004, The Journal of Neuroscience.

[6]  Lars-Göran Nilsson,et al.  Reactivation of Motor Brain Areas during Explicit Memory for Actions , 2001, NeuroImage.

[7]  G. Rainer,et al.  Cognitive neuroscience: Neural mechanisms for detecting and remembering novel events , 2003, Nature Reviews Neuroscience.

[8]  Anthony D Wagner,et al.  Executive Control during Episodic Retrieval Multiple Prefrontal Processes Subserve Source Memory , 2002, Neuron.

[9]  A. Owen The Functional Organization of Working Memory Processes Within Human Lateral Frontal Cortex: The Contribution of Functional Neuroimaging , 1997, The European journal of neuroscience.

[10]  H G Wieser,et al.  Human hippocampus associates information in memory. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[11]  C. Stark,et al.  Making Memories without Trying: Medial Temporal Lobe Activity Associated with Incidental Memory Formation during Recognition , 2003, The Journal of Neuroscience.

[12]  E. Tulving,et al.  Hippocampal PET activations of memory encoding and retrieval: The HIPER model , 1998, Hippocampus.

[13]  E. Tulving,et al.  PET studies of encoding and retrieval: The HERA model , 1996, Psychonomic bulletin & review.

[14]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[15]  T. Teyler,et al.  The role of hippocampus in memory: A hypothesis , 1985, Neuroscience & Biobehavioral Reviews.

[16]  S. Thompson-Schill Neuroimaging studies of semantic memory: inferring “how” from “where” , 2003, Neuropsychologia.

[17]  T. Braver,et al.  The Role of Frontopolar Cortex in Subgoal Processing during Working Memory , 2002, NeuroImage.

[18]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[19]  R. Mayeux,et al.  Circuit mechanisms underlying memory encoding and retrieval in the long axis of the hippocampal formation , 2001, Nature Neuroscience.

[20]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[21]  Endel Tulving,et al.  Prefrontal cortex and episodic memory retrieval mode. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[22]  E. Tulving,et al.  Novelty assessment in the brain and long-term memory encoding , 1995, Psychonomic bulletin & review.

[23]  Alison R Preston,et al.  Hippocampal contribution to the novel use of relational information in declarative memory , 2004, Hippocampus.

[24]  H. Eichenbaum,et al.  The hippocampus--what does it do? , 1992, Behavioral and neural biology.

[25]  J A Maldjian,et al.  Functional activation of the left amygdala and hippocampus during associative encoding , 2000, Neuroreport.

[26]  E. Benarroch Executive Control , 2022, Neuroscience for Clinicians.

[27]  E. Tulving,et al.  Reactivation of encoding-related brain activity during memory retrieval. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Dick J Veltman,et al.  Common pathway in the medial temporal lobe for storage and recovery of words as revealed by event‐related functional MRI , 2004, Hippocampus.

[29]  Marcia K. Johnson,et al.  Left Anterior Prefrontal Activation Increases with Demands to Recall Specific Perceptual Information , 2000, The Journal of Neuroscience.

[30]  Adrian M. Owen,et al.  Perceptual and Semantic Components of Memory for Objects and Faces: A PET Study , 2001, Journal of Cognitive Neuroscience.

[31]  D J Wyper,et al.  Associative encoding of pictures activates the medial temporal lobes , 1998, Human brain mapping.

[32]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[33]  Marcia K. Johnson,et al.  Left prefrontal activation during episodic remembering: an event‐related fMRI study , 1998, Neuroreport.

[34]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[35]  C. Stern,et al.  Prefrontal–Temporal Circuitry for Episodic Encoding and Subsequent Memory , 2000, The Journal of Neuroscience.

[36]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Jason P. Mitchell,et al.  Multiple routes to memory: Distinct medial temporal lobe processes build item and source memories , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[38]  N. Hunkin,et al.  Memory for single items, word pairs, and temporal order of different kinds in a patient with selective hippocampal lesions , 2001, Cognitive neuropsychology.

[39]  L. Davachi,et al.  Hippocampal contributions to episodic encoding: insights from relational and item-based learning. , 2002, Journal of neurophysiology.

[40]  James K. Kroger,et al.  Rostrolateral Prefrontal Cortex Involvement in Relational Integration during Reasoning , 2001, NeuroImage.

[41]  Sabrina M. Tom,et al.  Dissociable correlates of recollection and familiarity within the medial temporal lobes , 2004, Neuropsychologia.

[42]  J. R. Baker,et al.  The hippocampal formation participates in novel picture encoding: evidence from functional magnetic resonance imaging. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[43]  A R McIntosh,et al.  Neural correlates of semantic associative encoding in episodic memory. , 2000, Brain research. Cognitive brain research.

[44]  G H Glover,et al.  Separate neural bases of two fundamental memory processes in the human medial temporal lobe. , 1997, Science.

[45]  Bruce D. McCandliss,et al.  The visual word form area: expertise for reading in the fusiform gyrus , 2003, Trends in Cognitive Sciences.

[46]  Mark D'Esposito,et al.  Rapid Prefrontal-Hippocampal Habituation to Novel Events , 2004, The Journal of Neuroscience.

[47]  S. Petersen,et al.  Hemispheric Specialization in Human Dorsal Frontal Cortex and Medial Temporal Lobe for Verbal and Nonverbal Memory Encoding , 1998, Neuron.

[48]  Russell A. Poldrack,et al.  Putting names to faces: Successful encoding of associative memories activates the anterior hippocampal formation , 2003, NeuroImage.

[49]  H. Eichenbaum,et al.  Two functional components of the hippocampal memory system , 1994, Behavioral and Brain Sciences.

[50]  B. Postle,et al.  Maintenance versus Manipulation of Information Held in Working Memory: An Event-Related fMRI Study , 1999, Brain and Cognition.

[51]  Gurindar S. Sohi,et al.  Memory systems , 1996, CSUR.

[52]  Daniel L Schacter,et al.  Encoding activity in anterior medial temporal lobe supports subsequent associative recognition , 2004, NeuroImage.

[53]  Florin Dolcos,et al.  Similarities and Differences in the Neural Correlates of Episodic Memory Retrieval and Working Memory , 2002, NeuroImage.

[54]  Morris Moscovitch,et al.  Memory and working with memory: Evaluation of a component process model and comparisons with other models. , 1994 .

[55]  A R McIntosh,et al.  The neural correlates of intentional learning of verbal materials: a PET study in humans. , 1996, Brain research. Cognitive brain research.

[56]  Hans-Jochen Heinze,et al.  Human Hippocampal and Parahippocampal Activity during Visual Associative Recognition Memory for Spatial and Nonspatial Stimulus Configurations , 2003, The Journal of Neuroscience.

[57]  John E Desmond,et al.  Evidence for cortical encoding specificity in episodic memory: memory-induced re-activation of picture processing areas , 2002, Neuropsychologia.

[58]  Roberto Cabeza,et al.  Prefrontal and medial temporal lobe contributions to relational memory in young and older adults , 2006, Handbook of Binding and Memory.

[59]  L. Davachi,et al.  Behavioral/systems/cognitive Functional–neuroanatomic Correlates of Recollection: Implications for Models of Recognition Memory , 2022 .

[60]  Marcia K. Johnson,et al.  Source monitoring. , 1993, Psychological bulletin.

[61]  D. Schacter,et al.  Medial temporal lobe activations in fMRI and PET studies of episodic encoding and retrieval , 1999, Hippocampus.

[62]  Tim Shallice,et al.  Time-Dependent Changes in Learning Audiovisual Associations: A Single-Trial fMRI Study , 2000, NeuroImage.

[63]  K. Paller,et al.  Observing the transformation of experience into memory , 2002, Trends in Cognitive Sciences.