Brain signatures of a multiscale process of sequence learning in humans

Extracting the temporal structure of sequences of events is crucial for perception, decision-making, and language processing. Here, we investigate the mechanisms by which the brain acquires knowledge of sequences and the possibility that successive brain responses reflect the progressive extraction of sequence statistics at different timescales. We measured brain activity using magnetoencephalography in humans exposed to auditory sequences with various statistical regularities, and we modeled this activity as theoretical surprise levels using several learning models. Successive brain waves related to different types of statistical inferences. Early post-stimulus brain waves denoted a sensitivity to a simple statistic, the frequency of items estimated over a long timescale (habituation). Mid-latency and late brain waves conformed qualitatively and quantitatively to the computational properties of a more complex inference: the learning of recent transition probabilities. Our findings thus support the existence of multiple computational systems for sequence processing involving statistical inferences at multiple scales.

[1]  Daniel Feuerriegel,et al.  Evidence for spatiotemporally distinct effects of image repetition and perceptual expectations as measured by event-related potentials , 2018, NeuroImage.

[2]  Vijay Balasubramanian,et al.  A bias–variance trade-off governs individual differences in on-line learning in an unpredictable environment , 2018, Nature Human Behaviour.

[3]  Jenny R. Saffran,et al.  Constraints on Statistical Learning Across Species , 2018, Trends in Cognitive Sciences.

[4]  Cooper A. Smout,et al.  Prediction error and repetition suppression have distinct effects on neural representations of visual information , 2017, bioRxiv.

[5]  Kristoffer Hougaard Madsen,et al.  Simultaneous representation of a spectrum of dynamically changing value estimates during decision making , 2017, bioRxiv.

[6]  Karl J. Friston,et al.  A computational hierarchy in human cortex , 2017, 1709.02323.

[7]  Michael J Frank,et al.  Within- and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory , 2017, Proceedings of the National Academy of Sciences.

[8]  P. Tiňo,et al.  Learning Predictive Statistics: Strategies and Brain Mechanisms , 2017, The Journal of Neuroscience.

[9]  M. Chait,et al.  Great expectations: Is there evidence for predictive coding in auditory cortex? , 2017, Neuroscience.

[10]  Carlos D. Brody,et al.  Fronto-parietal Cortical Circuits Encode Accumulated Evidence with a Diversity of Timescales , 2017, Neuron.

[11]  Stefano Panzeri,et al.  Distinct timescales of population coding across cortex , 2017, Nature.

[12]  E. Koechlin,et al.  The Importance of Falsification in Computational Cognitive Modeling , 2017, Trends in Cognitive Sciences.

[13]  Floris P de Lange,et al.  Time-compressed preplay of anticipated events in human primary visual cortex , 2017, Nature Communications.

[14]  S. Dehaene,et al.  Brain networks for confidence weighting and hierarchical inference during probabilistic learning , 2017, Proceedings of the National Academy of Sciences.

[15]  C. H. Donahue,et al.  Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty , 2017, Neuron.

[16]  Michael W. Spratling A review of predictive coding algorithms , 2017, Brain and Cognition.

[17]  S. Nakauchi,et al.  Variation in Event-Related Potentials by State Transitions , 2017, Front. Hum. Neurosci..

[18]  Morten H. Christiansen,et al.  The long road of statistical learning research: past, present and future , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  Florent Meyniel,et al.  Human Inferences about Sequences: A Minimal Transition Probability Model , 2016, bioRxiv.

[20]  I. Winkler,et al.  Transitional Probabilities Are Prioritized over Stimulus/Pattern Probabilities in Auditory Deviance Detection: Memory Basis for Predictive Sound Processing , 2016, The Journal of Neuroscience.

[21]  Naftali Tishby,et al.  The Representation of Prediction Error in Auditory Cortex , 2016, PLoS Comput. Biol..

[22]  Christopher K. Kovach,et al.  Neural signatures of perceptual inference , 2016, eLife.

[23]  Florent Meyniel,et al.  The Neural Representation of Sequences: From Transition Probabilities to Algebraic Patterns and Linguistic Trees , 2015, Neuron.

[24]  O. Bertrand,et al.  Implicit learning of predictable sound sequences modulates human brain responses at different levels of the auditory hierarchy , 2015, Front. Hum. Neurosci..

[25]  Joseph W Kable,et al.  Normative evidence accumulation in unpredictable environments , 2015, eLife.

[26]  S. Dehaene,et al.  Representation of Numerical and Sequential Patterns in Macaque and Human Brains , 2015, Current Biology.

[27]  Carel ten Cate,et al.  Zebra finches can use positional and transitional cues to distinguish vocal element strings , 2015, Behavioural Processes.

[28]  Florent Meyniel,et al.  The Sense of Confidence during Probabilistic Learning: A Normative Account , 2015, PLoS Comput. Biol..

[29]  Matthew K. Leonard,et al.  Dynamic Encoding of Speech Sequence Probability in Human Temporal Cortex , 2015, The Journal of Neuroscience.

[30]  S. Wichary,et al.  The color red attracts attention in an emotional context. An ERP study , 2015, Front. Hum. Neurosci..

[31]  S. Dehaene,et al.  Disruption of hierarchical predictive coding during sleep , 2015, Proceedings of the National Academy of Sciences.

[32]  Mareike Grotheer,et al.  The relationship between stimulus repetitions and fulfilled expectations , 2015, Neuropsychologia.

[33]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[34]  Carl R Olson,et al.  Statistical Learning of Serial Visual Transitions by Neurons in Monkey Inferotemporal Cortex , 2014, The Journal of Neuroscience.

[35]  Mareike Grotheer,et al.  Repetition Probability Effects Depend on Prior Experiences , 2014, The Journal of Neuroscience.

[36]  Lionel Rigoux,et al.  VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data , 2014, PLoS Comput. Biol..

[37]  Karl J. Friston,et al.  Bayesian model selection for group studies — Revisited , 2014, NeuroImage.

[38]  Karl J. Friston,et al.  A Neurocomputational Model of the Mismatch Negativity , 2013, PLoS Comput. Biol..

[39]  S. Kochen,et al.  Expectation and Attention in Hierarchical Auditory Prediction , 2013, The Journal of Neuroscience.

[40]  Robert C. Wilson,et al.  A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems , 2013, PLoS Comput. Biol..

[41]  Marius Usher,et al.  The Timescale of Perceptual Evidence Integration Can Be Adapted to the Environment , 2013, Current Biology.

[42]  Gary F. Marcus,et al.  Stepwise acquisition of vocal combinatorial capacity in songbirds and human infants , 2013, Nature.

[43]  Timothy J. Gardner,et al.  Long-range Order in Canary Song , 2013, PLoS Comput. Biol..

[44]  Christopher Summerfield,et al.  Overlapping multivoxel patterns for two levels of visual expectation , 2013, Front. Hum. Neurosci..

[45]  Raymond J. Dolan,et al.  Outlier Responses Reflect Sensitivity to Statistical Structure in the Human Brain , 2013, PLoS Comput. Biol..

[46]  Tim Fingscheidt,et al.  A Model-Based Approach to Trial-By-Trial P300 Amplitude Fluctuations , 2013, Front. Hum. Neurosci..

[47]  Karl J. Friston,et al.  Modelling Trial-by-Trial Changes in the Mismatch Negativity , 2013, PLoS Comput. Biol..

[48]  I. Nelken,et al.  Sensitivity to Complex Statistical Regularities in Rat Auditory Cortex , 2012, Neuron.

[49]  A. Todorović,et al.  Repetition Suppression and Expectation Suppression Are Dissociable in Time in Early Auditory Evoked Fields , 2012, The Journal of Neuroscience.

[50]  J. Changeux,et al.  A Neuronal Model of Predictive Coding Accounting for the Mismatch Negativity , 2012, The Journal of Neuroscience.

[51]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[52]  S. Dehaene,et al.  Event related potentials elicited by violations of auditory regularities in patients with impaired consciousness , 2012, Neuropsychologia.

[53]  S. Dehaene,et al.  Evidence for a hierarchy of predictions and prediction errors in human cortex , 2011, Proceedings of the National Academy of Sciences.

[54]  C. Olson,et al.  Statistical learning of visual transitions in monkey inferotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[55]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[56]  Scott P. Johnson,et al.  Visual statistical learning in the newborn infant , 2011, Cognition.

[57]  Vanessa M. Johnen,et al.  Human Scalp Electroencephalography Reveals that Repetition Suppression Varies with Expectation , 2011, Front. Hum. Neurosci..

[58]  Karl J. Friston,et al.  Academic Software Applications for Electromagnetic Brain Mapping Using MEG and EEG , 2011, Comput. Intell. Neurosci..

[59]  E. Maris,et al.  Prior Expectation Mediates Neural Adaptation to Repeated Sounds in the Auditory Cortex: An MEG Study , 2011, The Journal of Neuroscience.

[60]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[61]  Caspar M. Schwiedrzik,et al.  Expectations Change the Signatures and Timing of Electrophysiological Correlates of Perceptual Awareness , 2011, The Journal of Neuroscience.

[62]  H. Seo,et al.  A reservoir of time constants for memory traces in cortical neurons , 2011, Nature Neuroscience.

[63]  J. Dreher,et al.  Decision Threshold Modulation in the Human Brain , 2010, The Journal of Neuroscience.

[64]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[65]  Stanislas Dehaene,et al.  Probing the lifetimes of auditory novelty detection processes , 2010, Neuropsychologia.

[66]  K. Okanoya,et al.  Statistical and Prosodic Cues for Song Segmentation Learning by Bengalese Finches (Lonchura striata var. domestica) , 2010 .

[67]  Stuart Marcovitch,et al.  Sequence learning in infancy: the independent contributions of conditional probability and pair frequency information. , 2009, Developmental science.

[68]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[69]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[70]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[71]  Jacques Mehler,et al.  The surprising power of statistical learning: When fragment knowledge leads to false memories of unheard words , 2009 .

[72]  Paavo Alku,et al.  Statistical language learning in neonates revealed by event-related brain potentials , 2009, BMC Neuroscience.

[73]  Karl J. Friston,et al.  The mismatch negativity: A review of underlying mechanisms , 2009, Clinical Neurophysiology.

[74]  S. Dehaene,et al.  Neural signature of the conscious processing of auditory regularities , 2009, Proceedings of the National Academy of Sciences.

[75]  S. Debener,et al.  Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise , 2008, The Journal of Neuroscience.

[76]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[77]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[78]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[79]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[80]  Steven A. Jax,et al.  The problem of serial order in behavior: Lashley's legacy. , 2007, Human movement science.

[81]  D. Poeppel,et al.  Processing Asymmetry of Transitions between Order and Disorder in Human Auditory Cortex , 2007, The Journal of Neuroscience.

[82]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[83]  E. Sussman,et al.  Organization of sequential sounds in auditory memory , 2005, Neuroreport.

[84]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[85]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[86]  I. Nelken,et al.  Multiple Time Scales of Adaptation in Auditory Cortex Neurons , 2004, The Journal of Neuroscience.

[87]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[88]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[89]  G. McCarthy,et al.  Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex , 2002, Nature Neuroscience.

[90]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[91]  W. Ritter,et al.  Predictability of stimulus deviance and the mismatch negativity , 1998, Neuroreport.

[92]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[93]  H. Akaike A Bayesian analysis of the minimum AIC procedure , 1978 .

[94]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[95]  N. Squires,et al.  The effect of stimulus sequence on the waveform of the cortical event-related potential. , 1976, Science.

[96]  S Sutton,et al.  Quantitative evoked potential correlates of the probability of events. , 1970, Psychophysiology.

[97]  E. Kandel,et al.  Heterosynaptic facilitation in neurones of the abdominal ganglion of Aplysia depilans. , 1965, The Journal of physiology.

[98]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[99]  C. Olson,et al.  Prediction suppression in monkey inferotemporal cortex depends on the conditional probability between images. , 2016, Journal of neurophysiology.

[100]  Nicole Propst,et al.  Classical Conditioning Ii Current Research And Theory , 2016 .

[101]  E. Wagenmakers,et al.  An Introduction to Model-Based Cognitive Neuroscience , 2015, Springer New York.

[102]  David B. Dunson,et al.  Bayesian data analysis, third edition , 2013 .

[103]  H. Tiitinen,et al.  Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. , 2010, Psychophysiology.

[104]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[105]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[106]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[107]  Noam Chomsky,et al.  On language : Chomsky's classic works, Language and responsibility and Reflections on language in one volume , 1998 .

[108]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[109]  E. Newport,et al.  Statistical learning by 8-month-old infants. , 1996, Science.

[110]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[111]  K. Lashley The problem of serial order in behavior , 1951 .

[112]  F. Waszak,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Distinctive Representation of Mispredicted and Unpredicted Prediction Errors in Human Electroencephalography Distinctive Representation of Mispredicted and Unpredicted Prediction Errors in Human Electroencephalography , 2022 .