Neural Global Pattern Similarity Underlies True and False Memories

The neural processes giving rise to human memory strength signals remain poorly understood. Inspired by formal computational models that posit a central role of global matching in memory strength, we tested a novel hypothesis that the strengths of both true and false memories arise from the global similarity of an item's neural activation pattern during retrieval to that of all the studied items during encoding (i.e., the encoding-retrieval neural global pattern similarity [ER-nGPS]). We revealed multiple ER-nGPS signals that carried distinct information and contributed differentially to true and false memories: Whereas the ER-nGPS in the parietal regions reflected semantic similarity and was scaled with the recognition strengths of both true and false memories, ER-nGPS in the visual cortex contributed solely to true memory. Moreover, ER-nGPS differences between the parietal and visual cortices were correlated with frontal monitoring processes. By combining computational and neuroimaging approaches, our results advance a mechanistic understanding of memory strength in recognition. SIGNIFICANCE STATEMENT What neural processes give rise to memory strength signals, and lead to our conscious feelings of familiarity? Using fMRI, we found that the memory strength of a given item depends not only on how it was encoded during learning, but also on the similarity of its neural representation with other studied items. The global neural matching signal, mainly in the parietal lobule, could account for the memory strengths of both studied and unstudied items. Interestingly, a different global matching signal, originated from the visual cortex, could distinguish true from false memories. The findings reveal multiple neural mechanisms underlying the memory strengths of events registered in the brain.

[1]  R. Cabeza,et al.  Effects of aging on true and false memory formation: An fMRI study , 2007, Neuropsychologia.

[2]  Kenneth A. Norman,et al.  Recollection, Familiarity, and Cortical Reinstatement: A Multivoxel Pattern Analysis , 2009, Neuron.

[3]  R. Shiffrin,et al.  A model for recognition memory: REM—retrieving effectively from memory , 1997, Psychonomic bulletin & review.

[4]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[5]  R. Henson,et al.  Episodic Reinstatement in the Medial Temporal Lobe , 2012, The Journal of Neuroscience.

[6]  Gui Xue,et al.  Global Neural Pattern Similarity as a Common Basis for Categorization and Recognition Memory , 2014, The Journal of Neuroscience.

[7]  Arthur P. Shimamura,et al.  Episodic retrieval and the cortical binding of relational activity , 2011, Cognitive, affective & behavioral neuroscience.

[8]  G. Xue,et al.  Spatiotemporal Neural Pattern Similarity Supports Episodic Memory , 2015, Current Biology.

[9]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[10]  John D. Bransford,et al.  The abstraction of linguistic ideas , 1971 .

[11]  Brice A. Kuhl,et al.  Successful Remembering Elicits Event-Specific Activity Patterns in Lateral Parietal Cortex , 2014, The Journal of Neuroscience.

[12]  D. P. Mccabe,et al.  The effect of warnings on false memories in young and older adults , 2002, Memory & cognition.

[13]  M. Rugg,et al.  The relationship between aging, performance, and the neural correlates of successful memory encoding. , 2009, Cerebral cortex.

[14]  D. Schacter,et al.  Can medial temporal lobe regions distinguish true from false? An event-related functional MRI study of veridical and illusory recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Jeremy R. Manning,et al.  Oscillatory patterns in temporal lobe reveal context reinstatement during memory search , 2011, Proceedings of the National Academy of Sciences.

[16]  Hongkeun Kim,et al.  Neural activity that predicts subsequent memory and forgetting: A meta-analysis of 74 fMRI studies , 2011, NeuroImage.

[17]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[18]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[19]  J. Mumford,et al.  Complementary role of frontoparietal activity and cortical pattern similarity in successful episodic memory encoding. , 2013, Cerebral cortex.

[20]  Elizabeth F Loftus,et al.  Imaging the reconstruction of true and false memories using sensory reactivation and the misinformation paradigms. , 2010, Learning & memory.

[21]  Stephen M. Smith,et al.  General multilevel linear modeling for group analysis in FMRI , 2003, NeuroImage.

[22]  Russell A. Poldrack,et al.  What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis , 2014, NeuroImage.

[23]  E. Hirshman,et al.  True and False Recognition in MINERVA2: Explanations from a Global Matching Perspective , 1998 .

[24]  Caitlin R. Bowman,et al.  True and phantom recollection: An fMRI investigation of similar and distinct neural correlates and connectivity , 2012, NeuroImage.

[25]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[26]  C. Koch,et al.  Sparse but not ‘Grandmother-cell’ coding in the medial temporal lobe , 2008, Trends in Cognitive Sciences.

[27]  Russell A Poldrack,et al.  Modeling group fMRI data. , 2007, Social cognitive and affective neuroscience.

[28]  R. Reed Hunt,et al.  Presentation modality affects false memory , 1998 .

[29]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[30]  William H. Alexander,et al.  Computational Models of Performance Monitoring and Cognitive Control , 2010, Top. Cogn. Sci..

[31]  Richard A. Mason,et al.  Prefrontal hemodynamic activity predicts false memory—A near-infrared spectroscopy study , 2006, NeuroImage.

[32]  John G. Seamon,et al.  Repetition can have similar or different effects on accurate and false recognition , 2002 .

[33]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[34]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[35]  Ray Pike,et al.  Comparison of convolution and matrix distributed memory systems for associative recall and recognition , 1984 .

[36]  Jackson C Liang,et al.  Content representation in the human medial temporal lobe. , 2013, Cerebral cortex.

[37]  H L Roediger,et al.  Modality effects in false recall and false recognition. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[38]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[39]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[40]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[41]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[42]  Ray Pike,et al.  Global matching: A comparison of the SAM, Minerva II, Matrix, and TODAM models. , 1989 .

[43]  Melina R. Uncapher,et al.  Functional heterogeneity in posterior parietal cortex across attention and episodic memory retrieval. , 2014, Cerebral cortex.

[44]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[45]  Patricia A. Reuter-Lorenz,et al.  Neural mechanisms of semantic interference and false recognition in short-term memory , 2011, NeuroImage.

[46]  M. Tsukada,et al.  Neural Correlates of True Memory, False Memory, and Deception , 2008, Cerebral cortex.

[47]  B. Murdock A Theory for the Storage and Retrieval of Item and Associative Information. , 1982 .

[48]  M. Jenkinson Non-linear registration aka Spatial normalisation , 2007 .

[49]  Kaia L. Vilberg,et al.  Age differences in the neural correlates of recollection: transient versus sustained fMRI effects , 2012, Neurobiology of Aging.

[50]  Daniel L Schacter,et al.  Amygdala Activity Is Associated with the Successful Encoding of Item, But Not Source, Information for Positive and Negative Stimuli , 2006, The Journal of Neuroscience.

[51]  Caitlin R. Bowman,et al.  Age-related differences in the neural correlates mediating false recollection , 2014, Neurobiology of Aging.

[52]  Daniel L Schacter,et al.  The neural correlates of conceptual and perceptual false recognition. , 2007, Learning & memory.

[53]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[54]  R. Shiffrin,et al.  List-strength Effect: Ii. Theoretical Mechanisms , 1990 .

[55]  Troy A. Smith,et al.  The fSAM model of false recall. , 2007, Psychological review.

[56]  M. Moscovitch,et al.  The parietal cortex and episodic memory: an attentional account , 2008, Nature Reviews Neuroscience.

[57]  K. McDermott,et al.  Creating false memories: Remembering words not presented in lists. , 1995 .

[58]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[59]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[60]  R. Shiffrin,et al.  List-strength effect: I. Data and discussion. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[61]  Valerie A. Carr,et al.  Global Similarity and Pattern Separation in the Human Medial Temporal Lobe Predict Subsequent Memory , 2013, The Journal of Neuroscience.

[62]  Daniel L. Schacter,et al.  Neuroanatomical Correlates of Veridical and Illusory Recognition Memory: Evidence from Positron Emission Tomography , 1996, Neuron.

[63]  J. Deese On the prediction of occurrence of particular verbal intrusions in immediate recall. , 1959, Journal of experimental psychology.

[64]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[65]  K. McDermott,et al.  Factors that determine false recall: A multiple regression analysis , 2001, Psychonomic bulletin & review.

[66]  S. Gronlund,et al.  Global matching models of recognition memory: How the models match the data , 1996, Psychonomic bulletin & review.

[67]  Brice A. Kuhl,et al.  Repetition Suppression and Multi-Voxel Pattern Similarity Differentially Track Implicit and Explicit Visual Memory , 2013, The Journal of Neuroscience.

[68]  A. Dale,et al.  Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. , 1998, Science.

[69]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[70]  Hongkeun Kim,et al.  Trusting Our Memories: Dissociating the Neural Correlates of Confidence in Veridical versus Illusory Memories , 2007, The Journal of Neuroscience.

[71]  L Hasher,et al.  Age deficits in retrieval: the fan effect. , 1991, Journal of gerontology.

[72]  J. Mumford,et al.  Greater Neural Pattern Similarity Across Repetitions Is Associated with Better Memory , 2010, Science.