Using single-trial EEG to predict and analyze subsequent memory

We show that it is possible to successfully predict subsequent memory performance based on single-trial EEG activity before and during item presentation in the study phase. Two-class classification was conducted to predict subsequently remembered vs. forgotten trials based on subjects' responses in the recognition phase. The overall accuracy across 18 subjects was 59.6% by combining pre- and during-stimulus information. The single-trial classification analysis provides a dimensionality reduction method to project the high-dimensional EEG data onto a discriminative space. These projections revealed novel findings in the pre- and during-stimulus periods related to levels of encoding. It was observed that the pre-stimulus information (specifically oscillatory activity between 25 and 35Hz) -300 to 0ms before stimulus presentation and during-stimulus alpha (7-12Hz) information between 1000 and 1400ms after stimulus onset distinguished between recollection and familiarity while the during-stimulus alpha information and temporal information between 400 and 800ms after stimulus onset mapped these two states to similar values.

[1]  Chih-Jen Lin,et al.  Training v-Support Vector Classifiers: Theory and Algorithms , 2001, Neural Computation.

[2]  K. Paller,et al.  Observing the transformation of experience into memory , 2002, Trends in Cognitive Sciences.

[3]  Axel Munk,et al.  P-values for classification , 2008, 0801.2934.

[4]  Saskia Haegens,et al.  Somatosensory Anticipatory Alpha Activity Increases to Suppress Distracting Input , 2012, Journal of Cognitive Neuroscience.

[5]  S. Hanslmayr,et al.  Theta Oscillations at Encoding Mediate the Context-Dependent Nature of Human Episodic Memory , 2013, Current Biology.

[6]  Akira Inagaki,et al.  Acid-sensing ion channel-1b in the stereocilia of mammalian cochlear hair cells , 2006, Neuroreport.

[7]  Leun J. Otten,et al.  Prestimulus Subsequent Memory Effects for Auditory and Visual Events , 2010, Journal of Cognitive Neuroscience.

[8]  Andrew P. Yonelinas,et al.  Examining ERP correlates of recognition memory: Evidence of accurate source recognition without recollection , 2012, NeuroImage.

[9]  Caren M Rotello,et al.  Theremember response: Subject to bias, graded, and not a process-pure indicator of recollection , 2005, Psychonomic bulletin & review.

[10]  Tim Curran,et al.  Familiarity in source memory , 2012, Neuropsychologia.

[11]  Matthias J. Gruber,et al.  Voluntary Control over Prestimulus Activity Related to Encoding , 2010, The Journal of Neuroscience.

[12]  John T Wixted,et al.  In defense of the signal detection interpretation of remember/know judgments , 2004, Psychonomic bulletin & review.

[13]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[14]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[15]  Virginia R. de Sa,et al.  Preprocessing and Meta-Classification for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[16]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[17]  W. Klimesch,et al.  Theta band power in the human scalp EEG and the encoding of new information , 1996, Neuroreport.

[18]  Tim Curran,et al.  ERP correlates of familiarity and recollection processes in visual associative recognition , 2007, Brain Research.

[19]  Tim Curran,et al.  Experts’ memory: an ERP study of perceptual expertise effects on encoding and recognition , 2011, Memory & cognition.

[20]  Pierre Maquet,et al.  Brain activity underlying encoding and retrieval of source memory. , 2002, Cerebral cortex.

[21]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[22]  K. Bäuml,et al.  Brain oscillations dissociate between semantic and nonsemantic encoding of episodic memories. , 2009, Cerebral cortex.

[23]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[24]  H. Ehrlichman,et al.  EEG asymmetry during covert mental activity. , 1980, Psychophysiology.

[25]  M. Kutas,et al.  Neural correlates of encoding in an incidental learning paradigm. , 1987, Electroencephalography and clinical neurophysiology.

[26]  J. Dunn.  Remember-know: a matter of confidence. , 2004, Psychological review.

[27]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[28]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[29]  D. Tucker.  Spatial sampling of head electrical fields: the geodesic sensor net. , 1993, Electroencephalography and clinical neurophysiology.

[30]  S. Hanslmayr,et al.  Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis , 2012, Front. Hum. Neurosci..

[31]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[32]  Sabrina M. Tom,et al.  Dissociable correlates of recollection and familiarity within the medial temporal lobes , 2004, Neuropsychologia.

[33]  Alan Agresti,et al.  Simple and Effective Confidence Intervals for Proportions and Differences of Proportions Result from Adding Two Successes and Two Failures , 2000 .

[34]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[35]  Marc W Howard,et al.  Theta and Gamma Oscillations during Encoding Predict Subsequent Recall , 2003, The Journal of Neuroscience.

[36]  J. Rohrbaugh,et al.  Electrocortical signs of levels of processing: perceptual analysis and recognition memory. , 1980, Psychophysiology.

[37]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[38]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[39]  Koji Jimura,et al.  Prediction of subsequent recognition performance using brain activity in the medial temporal lobe , 2011, NeuroImage.

[40]  Christopher Summerfield,et al.  Coherent theta-band EEG activity predicts item-context binding during encoding , 2005, NeuroImage.

[41]  Arne D. Ekstrom,et al.  Expected reward modulates encoding-related theta activity before an event , 2013, NeuroImage.

[42]  Wolfgang Klimesch,et al.  Individual differences in brain dynamics: important implications for the calculation of event-related band power , 1998, Biological Cybernetics.

[43]  B. Staresina,et al.  Medial Temporal Theta/Alpha Power Enhancement Precedes Successful Memory Encoding: Evidence Based on Intracranial EEG , 2011, The Journal of Neuroscience.

[44]  G. Pfurtscheller,et al.  Event-related desynchronization (ERD) and the Dm effect: does alpha desynchronization during encoding predict later recall performance? , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[45]  R. Knight,et al.  Dissociable neural correlates for familiarity and recollection during the encoding and retrieval of pictures. , 2004, Brain research. Cognitive brain research.

[46]  Heekyeong Park,et al.  Neural Correlates of Encoding Within- and Across-domain Inter-item Associations , 2011, Journal of Cognitive Neuroscience.

[47]  Ole Jensen,et al.  Alpha Oscillations Correlate with the Successful Inhibition of Unattended Stimuli , 2011, Journal of Cognitive Neuroscience.

[48]  Colleen M. Parks,et al.  Testing a neurocomputational model of recollection, familiarity, and source recognition. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[49]  E. Düzel,et al.  Medial temporal theta state before an event predicts episodic encoding success in humans , 2009, Proceedings of the National Academy of Sciences.

[50]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[51]  Simon Hanslmayr,et al.  How brain oscillations form memories — A processing based perspective on oscillatory subsequent memory effects , 2014, NeuroImage.

[52]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[53]  E. Oja,et al.  Independent Component Analysis , 2013 .

[54]  M. Rugg,et al.  Brain activity before an event predicts later recollection , 2006, Nature Neuroscience.

[55]  Simon Hanslmayr,et al.  Brain oscillatory subsequent memory effects differ in power and long-range synchronization between semantic and survival processing , 2013, NeuroImage.

[56]  Lila Davachi,et al.  When Keeping in Mind Supports Later Bringing to Mind: Neural Markers of Phonological Rehearsal Predict Subsequent Remembering , 2001, Journal of Cognitive Neuroscience.

[57]  Todd W. Thompson,et al.  When the brain is prepared to learn: Enhancing human learning using real-time fMRI , 2011, NeuroImage.