Decoding Sequence Learning from Single-Trial Intracranial EEG in Humans

We propose and validate a multivariate classification algorithm for characterizing changes in human intracranial electroencephalographic data (iEEG) after learning motor sequences. The algorithm is based on a Hidden Markov Model (HMM) that captures spatio-temporal properties of the iEEG at the level of single trials. Continuous intracranial iEEG was acquired during two sessions (one before and one after a night of sleep) in two patients with depth electrodes implanted in several brain areas. They performed a visuomotor sequence (serial reaction time task, SRTT) using the fingers of their non-dominant hand. Our results show that the decoding algorithm correctly classified single iEEG trials from the trained sequence as belonging to either the initial training phase (day 1, before sleep) or a later consolidated phase (day 2, after sleep), whereas it failed to do so for trials belonging to a control condition (pseudo-random sequence). Accurate single-trial classification was achieved by taking advantage of the distributed pattern of neural activity. However, across all the contacts the hippocampus contributed most significantly to the classification accuracy for both patients, and one fronto-striatal contact for one patient. Together, these human intracranial findings demonstrate that a multivariate decoding approach can detect learning-related changes at the level of single-trial iEEG. Because it allows an unbiased identification of brain sites contributing to a behavioral effect (or experimental condition) at the level of single subject, this approach could be usefully applied to assess the neural correlates of other complex cognitive functions in patients implanted with multiple electrodes.

[1]  Julien Lefèvre,et al.  Optical flow approaches to the identification of brain dynamics , 2009, Human brain mapping.

[2]  S. Morand,et al.  Electric source imaging of human brain functions , 2001, Brain Research Reviews.

[3]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[4]  W. Strik,et al.  Decreased EEG microstate duration and anteriorisation of the brain electrical fields in mild and moderate dementia of the Alzheimer type , 1997, Psychiatry Research: Neuroimaging.

[5]  Á. Pascual-Leone,et al.  The role of the dorsolateral prefrontal cortex during sequence learning is specific for spatial information. , 2001, Cerebral cortex.

[6]  Paul Sajda,et al.  Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG , 2009, Proceedings of the National Academy of Sciences.

[7]  J. Fell,et al.  Cross-frequency coupling supports multi-item working memory in the human hippocampus , 2010, Proceedings of the National Academy of Sciences.

[8]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[9]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[10]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[11]  Stephanie Clarke,et al.  A Temporal Hierarchy for Conspecific Vocalization Discrimination in Humans , 2010, The Journal of Neuroscience.

[12]  Howard Eichenbaum,et al.  The hippocampus and memory for "what," "where," and "when". , 2004, Learning & memory.

[13]  J. Swets,et al.  Assessment of diagnostic technologies. , 1979, Science.

[14]  Dimitri Van De Ville,et al.  BOLD correlates of EEG topography reveal rapid resting-state network dynamics , 2010, NeuroImage.

[15]  Christoph M. Michel,et al.  Principles of Topographic Analyses for Electrical Neuroimaging , 2009 .

[16]  G. Winocur,et al.  The cognitive neuroscience of remote episodic, semantic and spatial memory , 2006, Current Opinion in Neurobiology.

[17]  E. Rolls The hippocampus and memory , 1997 .

[18]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[19]  Peter Boesiger,et al.  Implicit Associative Learning Engages the Hippocampus and Interacts with Explicit Associative Learning , 2005, Neuron.

[20]  C Gerloff,et al.  Coherence of sequential movements and motor learning. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[21]  Alice J. O'Toole,et al.  Theoretical, Statistical, and Practical Perspectives on Pattern-based Classification Approaches to the Analysis of Functional Neuroimaging Data , 2007, Journal of Cognitive Neuroscience.

[22]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[23]  H. Eichenbaum,et al.  The Hippocampus and Disambiguation of Overlapping Sequences , 2002, The Journal of Neuroscience.

[24]  T. Koenig,et al.  EEG microstate duration and syntax in acute, medication-naïve, first-episode schizophrenia: a multi-center study , 2005, Psychiatry Research: Neuroimaging.

[25]  D. Hubl,et al.  Resting-state EEG in schizophrenia: Auditory verbal hallucinations are related to shortening of specific microstates , 2011, Clinical Neurophysiology.

[26]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[27]  L. Nadel,et al.  The role of medial temporal lobe in retrieving spatial and nonspatial relations from episodic and semantic memory , 2009, Hippocampus.

[28]  Christoph M. Michel,et al.  Decoding stimulus-related information from single-trial EEG responses based on voltage topographies , 2012, Pattern Recognit..

[29]  M. Hasselmo,et al.  The hippocampus as an associator of discontiguous events , 1998, Trends in Neurosciences.

[30]  Niels Birbaumer,et al.  Brain–computer-interface research: Coming of age , 2006, Clinical Neurophysiology.

[31]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[32]  Todd C. Handy,et al.  Brain Signal Analysis: Advances In Neuroelectric and Neuromagnetic Methods , 2011 .

[33]  F. Cincotti,et al.  Comparison of different feature classifiers for brain computer interfaces , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[34]  L. Nadel,et al.  Multiple trace theory of human memory: Computational, neuroimaging, and neuropsychological results , 2000, Hippocampus.

[35]  Micah M. Murray,et al.  Rapid Brain Discrimination of Sounds of Objects , 2006, The Journal of Neuroscience.

[36]  Juliane Britz,et al.  EEG microstate sequences in healthy humans at rest reveal scale-free dynamics , 2010, Proceedings of the National Academy of Sciences.

[37]  Christophe Phillips,et al.  Implicit Oculomotor Sequence Learning in Humans: Time Course of Offline Processing , 2022 .

[38]  P. Hazemann,et al.  Handbook of Electroencephalography and Clinical Neurophysiology , 1975 .

[39]  Axel Cleeremans,et al.  Experience-dependent changes in cerebral activation during human REM sleep , 2000, Nature Neuroscience.

[40]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[41]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[42]  B. McNaughton,et al.  Memory reprocessing in corticocortical and hippocampocortical neuronal ensembles. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[43]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[44]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[45]  Jonathan R Wolpaw,et al.  Brain–computer interfaces as new brain output pathways , 2007, The Journal of physiology.

[46]  Christoph M. Michel,et al.  Single subject EEG analysis based on topographic information , 2007 .

[47]  Noël Staeren,et al.  Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex , 2009, Current Biology.

[48]  R. Passingham,et al.  Sleep-Related Consolidation of a Visuomotor Skill: Brain Mechanisms as Assessed by Functional Magnetic Resonance Imaging , 2003, The Journal of Neuroscience.

[49]  John-Dylan Haynes,et al.  Multivariate decoding and brain reading: Introduction to the special issue , 2011, NeuroImage.

[50]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[51]  S. Clarke,et al.  Single-trial topographic analysis of human EEG: A new `image' of event-related potentials , 2007, 2007 6th International Special Topic Conference on Information Technology Applications in Biomedicine.

[52]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[53]  G. Pfurtscheller,et al.  Information transfer rate in a five-classes brain-computer interface , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[54]  J. Tanji,et al.  Neuronal activity in the primate supplementary, pre-supplementary and premotor cortex during externally and internally instructed sequential movements , 1994, Neuroscience Research.

[55]  Hans-Jochen Heinze,et al.  Predicting the recognition of natural scenes from single trial MEG recordings of brain activity , 2000, NeuroImage.

[56]  P. Dayan,et al.  Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions , 2004, Nature Neuroscience.

[57]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[58]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[59]  Axel Cleeremans,et al.  The neural correlates of implicit and explicit sequence learning: Interacting networks revealed by the process dissociation procedure. , 2005, Learning & memory.

[60]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[61]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[62]  Daniel P. Kennedy,et al.  Differential electrophysiological response during rest, self-referential, and non–self-referential tasks in human posteromedial cortex , 2011, Proceedings of the National Academy of Sciences.

[63]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[64]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[65]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[66]  R. H. Jindra,et al.  Handbook of electroencephalography and clinical neurophysiology Vol. 5,B. A. Remond (ed.-in-chief). Evaluation of bioelectrical data from brain, nerve and muscle—II. M. A. B. Brazier & D. O. Walter (eds). EEG topography. H. Petsche (ed.). Elsevier, Amsterdam (1972). 84 pp , 1979, Neuroscience.

[67]  D. Lehmann,et al.  Principles of spatial analysis , 1987 .

[68]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[69]  Gilles Pourtois,et al.  Modulation of Face Processing by Emotional Expression and Gaze Direction during Intracranial Recordings in Right Fusiform Cortex , 2010, Journal of Cognitive Neuroscience.

[70]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[71]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[72]  Dimitri Van De Ville,et al.  Brain decoding: Opportunities and challenges for pattern recognition , 2012, Pattern Recognit..

[73]  A. Schnider,et al.  Rapid consolidation and the human hippocampus: Intracranial recordings confirm surface EEG , 2011, Hippocampus.

[74]  J. Born,et al.  Maintaining memories by reactivation , 2007, Current Opinion in Neurobiology.

[75]  J. Born,et al.  Temporal coupling of parahippocampal ripples, sleep spindles and slow oscillations in humans. , 2007, Brain : a journal of neurology.

[76]  G. Pfurtscheller Handbook of electroencephalography and clinical neurophysiology , 1978 .

[77]  P. Frankland,et al.  The organization of recent and remote memories , 2005, Nature Reviews Neuroscience.

[78]  Dimitri Van De Ville,et al.  Decoding of Emotional Information in Voice-Sensitive Cortices , 2009, Current Biology.

[79]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[80]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[81]  H. Eichenbaum,et al.  Critical role of the hippocampus in memory for sequences of events , 2002, Nature Neuroscience.