Tracking neural correlates of successful learning over repeated sequence observations

The neural correlates of memory formation in humans have long been investigated by exposing subjects to diverse material and comparing responses to items later remembered to those forgotten. Tasks requiring memorization of sensory sequences afford unique possibilities for linking neural memorization processes to behavior, because, rather than comparing across different items of varying content, each individual item can be examined across the successive learning states of being initially unknown, newly learned, and eventually, fully known. Sequence learning paradigms have not yet been exploited in this way, however. Here, we analyze the event-related potentials of subjects attempting to memorize sequences of visual locations over several blocks of repeated observation, with respect to pre- and post-block recall tests. Over centro-parietal regions, we observed a rapid P300 component superimposed on a broader positivity, which exhibited distinct modulations across learning states that were replicated in two separate experiments. Consistent with its well-known encoding of surprise, the P300 deflection monotonically decreased over blocks as locations became better learned and hence more expected. In contrast, the broader positivity was especially elevated at the point when a given item was newly learned, i.e., started being successfully recalled. These results implicate the Broad Positivity in endogenously-driven, intentional memory formation, whereas the P300, in processing the current stimulus to the degree that it was previously uncertain, indexes the cumulative knowledge thereby gained. The decreasing surprise/P300 effect significantly predicted learning success both across blocks and across subjects. This presents a new, neural-based means to evaluate learning capabilities independent of verbal reports, which could have considerable value in distinguishing genuine learning disabilities from difficulties to communicate the outcomes of learning, or perceptual impairments, in a range of clinical brain disorders.

[1]  Edward F. Ester,et al.  Parietal and Frontal Cortex Encode Stimulus-Specific Mnemonic Representations during Visual Working Memory , 2015, Neuron.

[2]  L. Squire,et al.  Encapsulation of Implicit and Explicit Memory in Sequence Learning , 1998, Journal of Cognitive Neuroscience.

[3]  J. Rohrbaugh,et al.  Electrocortical signs of levels of processing: perceptual analysis and recognition memory. , 1980, Psychophysiology.

[4]  T. Curran Effects of attention and confidence on the hypothesized ERP correlates of recollection and familiarity , 2004, Neuropsychologia.

[5]  Hongkeun Kim,et al.  Neural activity that predicts subsequent memory and forgetting: A meta-analysis of 74 fMRI studies , 2011, NeuroImage.

[6]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[7]  D. Rujescu,et al.  The neural basis of the P300 potential , 2004, European Archives of Psychiatry and Clinical Neuroscience.

[8]  R. Knight,et al.  Contributions of temporal-parietal junction to the human auditory P3 , 1989, Brain Research.

[9]  K Lehnertz,et al.  Real-time tracking of memory formation in the human rhinal cortex and hippocampus. , 1999, Science.

[10]  T. Curran,et al.  Using ERPs to dissociate recollection from familiarity in picture recognition. , 2003, Brain research. Cognitive brain research.

[11]  H. B. Meziane,et al.  Neural Activations during Visual Sequence Learning Leave a Trace in Post-Training Spontaneous EEG , 2013, PloS one.

[12]  Joseph R. Madsen,et al.  Decrease in gamma-band activity tracks sequence learning , 2015, Front. Syst. Neurosci..

[13]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[14]  J. Rohrbaugh,et al.  Endogenous potentials generated in the human hippocampal formation and amygdala by infrequent events. , 1980, Science.

[15]  A. Dale,et al.  Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. , 1998, Science.

[16]  David Friedman,et al.  ERPs during continuous recognition memory for words , 1990, Biological Psychology.

[17]  H G Smid,et al.  ERPs to encoding and recognition in two different inter‐item association tasks , 1997, Neuroreport.

[18]  Edward Awh,et al.  A Neural Measure of Precision in Visual Working Memory , 2013, Journal of Cognitive Neuroscience.

[19]  Rolf Verleger,et al.  P3b: Towards some decision about memory , 2008, Clinical Neurophysiology.

[20]  Martin Eimer,et al.  Chunking processes in the learning of event sequences: Electrophysiological indicators , 2000, Memory & cognition.

[21]  S. Kelly,et al.  The classic P300 encodes a build‐to‐threshold decision variable , 2015, The European journal of neuroscience.

[22]  Emanuel Donchin,et al.  The P300 component of the event-related brain potential as an index of information processing , 1982, Biological Psychology.

[23]  Simone Rossi,et al.  Temporal dynamics of memory trace formation in the human prefrontal cortex. , 2011, Cerebral cortex.

[24]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[25]  H Künkel,et al.  Effects of a cholinergic nootropic (WEB 1881 FU) on event-related potentials recorded in incidental and intentional memory tasks. , 1988, Neuropsychobiology.

[26]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[27]  David Eidelberg,et al.  L-Dopa infusion does not improve explicit sequence learning in Parkinson's disease. , 2007, Parkinsonism & related disorders.

[28]  P. H. Lindsay,et al.  Evoked Potential Correlates of Auditory Signal Detection , 1971, Science.

[29]  G. Tononi,et al.  Local sleep and learning , 2004, Nature.

[30]  E. Donchin,et al.  “P300” and memory: Individual differences in the von Restorff effect , 1984, Cognitive Psychology.

[31]  R. Verleger,et al.  Reduction of P3b in patients with temporo-parietal lesions. , 1994, Brain research. Cognitive brain research.

[32]  Michael D. Rugg,et al.  Comparison of the neural correlates of encoding item-item and item-context associations , 2013, Front. Hum. Neurosci..

[33]  R. Verleger Event-related potentials and cognition: A critique of the context updating hypothesis and an alternative interpretation of P3 , 1988, Behavioral and Brain Sciences.

[34]  J G Snodgrass,et al.  ERPs during study as a function of subsequent direct and indirect memory testing in young and old adults. , 1996, Brain research. Cognitive brain research.

[35]  Axel Mecklinger,et al.  Error and Deviance Processing in Implicit and Explicit Sequence Learning , 2008, Journal of Cognitive Neuroscience.

[36]  Xiaorong Gao,et al.  Learning without consciously knowing: Evidence from event-related potentials in sequence learning , 2013, Consciousness and Cognition.

[37]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[38]  M Hallett,et al.  Event-related desynchronization (ERD) in the alpha frequency during development of implicit and explicit learning. , 1997, Electroencephalography and clinical neurophysiology.

[39]  Mark F. Bear,et al.  Visual recognition memory, manifest as long-term habituation, requires synaptic plasticity in V1 , 2015, Nature Neuroscience.

[40]  B. Postle,et al.  The cognitive neuroscience of working memory. , 2007, Annual review of psychology.

[41]  J. Hopfield,et al.  All-or-none potentiation at CA3-CA1 synapses. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[42]  E. Donchin,et al.  On the dependence of P300 latency on stimulus evaluation processes. , 1984, Psychophysiology.

[43]  S. Kelly,et al.  Internal and External Influences on the Rate of Sensory Evidence Accumulation in the Human Brain , 2013, The Journal of Neuroscience.

[44]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[45]  M Eimer,et al.  Explicit and implicit learning of event sequences: evidence from event-related brain potentials. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Thomas D. Albright,et al.  Neural Correlates of Knowledge: Stable Representation of Stimulus Associations across Variations in Behavioral Performance , 2005, Neuron.

[47]  Ron Sun,et al.  Introduction to Sequence Learning , 2001, Sequence Learning.

[48]  Y. Katayama,et al.  Thalamic negativity associated with the endogenous late positive component of cerebral evoked potentials (P300): Recordings using discriminative aversive conditioning in humans and cats , 1985, Brain Research Bulletin.

[49]  Mark F. Bear,et al.  Learned spatiotemporal sequence recognition and prediction in primary visual cortex , 2014, Nature Neuroscience.

[50]  D. Linden The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[51]  M. Kutas,et al.  Event-related brain potentials during initial encoding and recognition memory of congruous and incongruous words , 1986 .

[52]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[53]  E. Halgren,et al.  Generators of the late cognitive potentials in auditory and visual oddball tasks. , 1998, Electroencephalography and clinical neurophysiology.

[54]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[55]  C. Pavlides,et al.  Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  C. Stern,et al.  An fMRI Study of the Role of the Medial Temporal Lobe in Implicit and Explicit Sequence Learning , 2003, Neuron.

[57]  Robert J Barry,et al.  Event-related potential correlates of serial-position effects during an elaborative memory test. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  E. Halgren,et al.  Cancellation of EEG and MEG signals generated by extended and distributed sources , 2009, Human brain mapping.

[59]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[60]  E. Donchin,et al.  Parsing the late positive complex: mental chronometry and the ERP components that inhabit the neighborhood of the P300. , 2004, Psychophysiology.

[61]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[62]  Tim Fingscheidt,et al.  A Model-Based Approach to Trial-By-Trial P300 Amplitude Fluctuations , 2013, Front. Hum. Neurosci..

[63]  Lila Davachi,et al.  When Keeping in Mind Supports Later Bringing to Mind: Neural Markers of Phonological Rehearsal Predict Subsequent Remembering , 2001, Journal of Cognitive Neuroscience.

[64]  E Donchin,et al.  A metric for thought: a comparison of P300 latency and reaction time. , 1981, Science.

[65]  L. Squire,et al.  Brain responses to concrete and abstract words reflect processes that correlate with later performance on a test of stem-completion priming. , 1987, Electroencephalography and clinical neurophysiology. Supplement.

[66]  N. Squires,et al.  The effect of stimulus sequence on the waveform of the cortical event-related potential. , 1976, Science.

[67]  J. Sweatt,et al.  Memory-Associated Dynamic Regulation of the “Stable” Core of the Chromatin Particle , 2015, Neuron.

[68]  R N Henson,et al.  Depth of processing effects on neural correlates of memory encoding: relationship between findings from across- and within-task comparisons. , 2001, Brain : a journal of neurology.

[69]  E Donchin,et al.  Effects of mnemonic strategy manipulation in a Von Restorff paradigm. , 1990, Electroencephalography and clinical neurophysiology.

[70]  S. Kelly,et al.  A supramodal accumulation-to-bound signal that determines perceptual decisions in humans , 2012, Nature Neuroscience.

[71]  Rodrigo Quian Quiroga,et al.  Event related potentials to digit learning: tracking neurophysiologic changes accompanying recall performance. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[72]  M. Ghilardi,et al.  Implicit and explicit aspects of sequence learning in pre-symptomatic Huntington's disease. , 2008, Parkinsonism & related disorders.

[73]  S. Debener,et al.  Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise , 2008, The Journal of Neuroscience.

[74]  R Jaffard,et al.  Long-term potentiation and long-term depression in the lateral septum in spatial working and reference memory , 1996, Journal of Physiology-Paris.

[75]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[76]  Thomas F Münte,et al.  Human error monitoring during implicit and explicit learning of a sensorimotor sequence , 2003, Neuroscience Research.

[77]  Tomifusa Kuboki,et al.  Explicit knowledge and intention to learn in sequence learning: an event-related potential study , 2005, Neuroreport.

[78]  L. Squire,et al.  Neuronal representations of stimulus associations develop in the temporal lobe during learning , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[79]  C. C. Wood,et al.  ERPs predictive of subsequent recall and recognition performance , 1988, Biological Psychology.

[80]  M. Ghilardi,et al.  Impaired sequence learning in carriers of the DYT1 dystonia mutation , 2003, Annals of neurology.

[81]  C. Yingling,et al.  A subcortical correlate of P300 in man. , 1984, Electroencephalography and clinical neurophysiology.

[82]  M. Kutas,et al.  An ERP analysis of implicit structured sequence learning. , 1997, Psychophysiology.

[83]  E. Donchin,et al.  P300 and recall in an incidental memory paradigm. , 1986, Psychophysiology.

[84]  R M Chapman,et al.  Memory processes and evoked potentials. , 1981, Canadian journal of psychology.

[85]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[86]  Claude Ghez,et al.  The differential effect of PD and normal aging on early explicit sequence learning , 2003, Neurology.

[87]  J. Desmond,et al.  Making memories: brain activity that predicts how well visual experience will be remembered. , 1998, Science.

[88]  Matthijs A. A. van der Meer,et al.  Internally generated sequences in learning and executing goal-directed behavior , 2014, Trends in Cognitive Sciences.

[89]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[90]  R. Verleger On the utility of P3 latency as an index of mental chronometry. , 1997, Psychophysiology.

[91]  Ava J. Senkfor,et al.  Memory for words and novel visual patterns: repetition, recognition, and encoding effects in the event-related brain potential. , 1996, Psychophysiology.

[92]  C. Carter,et al.  Regional brain activation during concurrent implicit and explicit sequence learning. , 2004, Cerebral cortex.

[93]  Piotr Jaskowski,et al.  Evidence for an Integrative Role of P3b in Linking Reaction to Perception , 2005 .

[94]  R. Heuser Surprise, surprise , 2014, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[95]  M. Rugg,et al.  The relationship between task‐related and subsequent memory effects , 2014, Human brain mapping.

[96]  P. Skudlarski,et al.  Event-related fMRI of auditory and visual oddball tasks. , 2000, Magnetic resonance imaging.

[97]  M. Kutas,et al.  Neural correlates of encoding in an incidental learning paradigm. , 1987, Electroencephalography and clinical neurophysiology.

[98]  E Donchin,et al.  Event-related brain potentials and subjective probability in a learning task , 1980, Memory & cognition.

[99]  J. Pine,et al.  Chunking mechanisms in human learning , 2001, Trends in Cognitive Sciences.

[100]  C. Degueldre,et al.  Are Spatial Memories Strengthened in the Human Hippocampus during Slow Wave Sleep? , 2004, Neuron.

[101]  Thomas F. Münte,et al.  Serial position effects in free memory recall—An ERP-study , 2007, Biological Psychology.

[102]  Marta Kutas,et al.  Brain Potentials during Memory Retrieval Provide Neurophysiological Support for the Distinction between Conscious Recollection and Priming , 1992, Journal of Cognitive Neuroscience.

[103]  Ken A. Paller,et al.  Neural events that underlie remembering something that never happened , 2000, Nature Neuroscience.

[104]  Joseph Dien,et al.  Applying Principal Components Analysis to Event-Related Potentials: A Tutorial , 2012, Developmental neuropsychology.

[105]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[106]  D. Schacter,et al.  When encoding yields remembering: insights from event-related neuroimaging. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[107]  P. Frankland,et al.  The organization of recent and remote memories , 2005, Nature Reviews Neuroscience.

[108]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[109]  Ken A. Paller,et al.  An Electrophysiological Signature of Unconscious Recognition Memory , 2009, Nature Neuroscience.

[110]  E. Kandel,et al.  Molecular biology of learning: modulation of transmitter release. , 1982, Science.

[111]  K Grune,et al.  Information processing in working memory and event-related brain potentials. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[112]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[113]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[114]  J. Lisman,et al.  Hippocampal sequence-encoding driven by a cortical multi-item working memory buffer , 2005, Trends in Neurosciences.

[115]  John Polich,et al.  Evidence for Attentional Gradient in the Serial Position Memory Curve from Event-related Potentials , 2007, Journal of Cognitive Neuroscience.