The neurobiology of uncertainty: implications for statistical learning

The capacity for assessing the degree of uncertainty in the environment relies on estimating statistics of temporally unfolding inputs. This, in turn, allows calibration of predictive and bottom-up processing, and signalling changes in temporally unfolding environmental features. In the last decade, several studies have examined how the brain codes for and responds to input uncertainty. Initial neurobiological experiments implicated frontoparietal and hippocampal systems, based largely on paradigms that manipulated distributional features of visual stimuli. However, later work in the auditory domain pointed to different systems, whose activation profiles have interesting implications for computational and neurobiological models of statistical learning (SL). This review begins by briefly recapping the historical development of ideas pertaining to the sensitivity to uncertainty in temporally unfolding inputs. It then discusses several issues at the interface of studies of uncertainty and SL. Following, it presents several current treatments of the neurobiology of uncertainty and reviews recent findings that point to principles that serve as important constraints on future neurobiological theories of uncertainty, and relatedly, SL. This review suggests it may be useful to establish closer links between neurobiological research on uncertainty and SL, considering particularly mechanisms sensitive to local and global structure in inputs, the degree of input uncertainty, the complexity of the system generating the input, learning mechanisms that operate on different temporal scales and the use of learnt information for online prediction. This article is part of the themed issue ‘New frontiers for statistical learning in the cognitive sciences’.

[1]  N. Daw,et al.  Dissociating hippocampal and striatal contributions to sequential prediction learning , 2012, The European journal of neuroscience.

[2]  R. Carlyon,et al.  An Information Theoretic Characterisation of Auditory Encoding , 2007, PLoS biology.

[3]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[4]  Sharon L. Thompson-Schill,et al.  Local Patterns to Global Architectures: Influences of Network Topology on Human Learning Relating Two Approaches Complex Networks Are Pervasive Network Topology Influences Learning and Memory Local Statistics Underpin Network Architecture , 2022 .

[5]  Richard N Aslin,et al.  The Goldilocks effect in infant auditory attention. , 2014, Child development.

[6]  Uri Hasson,et al.  Multiple sensitivity profiles to diversity and transition structure in non-stationary input , 2012, NeuroImage.

[7]  Uri Hasson,et al.  Connectivity in the human brain dissociates entropy and complexity of auditory inputs , 2015, NeuroImage.

[8]  A. Treisman,et al.  Representation of statistical properties , 2003, Vision Research.

[9]  Tal Linzen,et al.  The role of morphology in phoneme prediction: Evidence from MEG , 2014, Brain and Language.

[10]  Emmanuel M. Pothos,et al.  An Entropy Model for Artificial Grammar Learning , 2010, Front. Psychology.

[11]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[12]  Carsten Gießing,et al.  Persistency and flexibility of complex brain networks underlie dual‐task interference , 2015, Human brain mapping.

[13]  Dirk P. Kroese,et al.  Statistical Learning , 2001, Science.

[14]  Richard N. Aslin,et al.  The Goldilocks Effect: Human Infants Allocate Attention to Visual Sequences That Are Neither Too Simple Nor Too Complex , 2012, PloS one.

[15]  T. Kellermann,et al.  Modality-specific perceptual expectations selectively modulate baseline activity in auditory, somatosensory, and visual cortices. , 2011, Cerebral cortex.

[16]  Erik D. Thiessen,et al.  The extraction and integration framework: a two-process account of statistical learning. , 2013, Psychological bulletin.

[17]  Joan Y. Chiao,et al.  An Event-related fMRI Study of Artificial Grammar Learning in a Balanced Chunk Strength Design , 2004, Journal of Cognitive Neuroscience.

[18]  Marcia K. Johnson,et al.  Implicit Perceptual Anticipation Triggered by Statistical Learning , 2010, The Journal of Neuroscience.

[19]  Josep Marco-Pallarés,et al.  Time course and functional neuroanatomy of speech segmentation in adults , 2009, NeuroImage.

[20]  Antal van den Bosch,et al.  Prediction During Natural Language Comprehension. , 2016, Cerebral cortex.

[21]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[22]  Morten H. Christiansen,et al.  Domain generality versus modality specificity: the paradox of statistical learning , 2015, Trends in Cognitive Sciences.

[23]  Aniruddh D. Patel,et al.  Temporal patterns of human cortical activity reflect tone sequence structure , 2000, Nature.

[24]  Karl J. Friston,et al.  The Functional Anatomy of Time: What and When in the Brain , 2016, Trends in Cognitive Sciences.

[25]  Michael Smithson,et al.  Judgment under Chaos , 1997 .

[26]  Walter Kintsch,et al.  Musings About Beauty , 2012, Cogn. Sci..

[27]  L. Reddy,et al.  Learning of anticipatory responses in single neurons of the human medial temporal lobe , 2015, Nature Communications.

[28]  Jeffrey M. Zacks,et al.  Segmentation in reading and film comprehension. , 2009, Journal of experimental psychology. General.

[29]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[30]  Alec Marantz,et al.  Lexical Preactivation in Basic Linguistic Phrases , 2015, Journal of Cognitive Neuroscience.

[31]  Joseph T. Devlin,et al.  Orienting attention to semantic categories , 2006, NeuroImage.

[32]  Richard N. Aslin,et al.  Sampling over Nonuniform Distributions: A Neural Efficiency Account of the Primacy Effect in Statistical Learning , 2016, Journal of Cognitive Neuroscience.

[33]  D. V. Cramon,et al.  Predicting Perceptual Events Activates Corresponding Motor Schemes in Lateral Premotor Cortex: An fMRI Study , 2002, NeuroImage.

[34]  Karen A. Daniels,et al.  Conscious and Unconscious Processing of Nonverbal Predictability in Wernicke's Area , 2000, The Journal of Neuroscience.

[35]  Uri Hasson,et al.  The Role of Working Memory in the Probabilistic Inference of Future Sensory Events , 2016, Cerebral cortex.

[36]  Matthew K. Leonard,et al.  The influence of lexical statistics on temporal lobe cortical dynamics during spoken word listening , 2015, Brain and Language.

[37]  Jordan B. Peterson,et al.  Psychological entropy: a framework for understanding uncertainty-related anxiety. , 2012, Psychological review.

[38]  G. Loewenstein The psychology of curiosity: A review and reinterpretation. , 1994 .

[39]  W. Penny,et al.  Time Scales of Representation in the Human Brain: Weighing Past Information to Predict Future Events , 2011, Front. Hum. Neurosci..

[40]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[41]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[42]  Lauren V. Kustner,et al.  Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities , 2012, Current Biology.

[43]  C. Carter,et al.  Regional brain activation during concurrent implicit and explicit sequence learning. , 2004, Cerebral cortex.

[44]  Uri Hasson,et al.  Predictability of what or where reduces brain activity, but a bottleneck occurs when both are predictable , 2018, NeuroImage.

[45]  Marco Baroni,et al.  Processing of speech and non-speech sounds in the supratemporal plane: Auditory input preference does not predict sensitivity to statistical structure , 2013, NeuroImage.

[46]  R. Duncan Luce,et al.  Whatever Happened to Information Theory in Psychology? , 2003 .

[47]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[48]  A. Lüthi,et al.  Processing of Temporal Unpredictability in Human and Animal Amygdala , 2007, The Journal of Neuroscience.

[49]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[50]  Donald Laming,et al.  Statistical Information and Uncertainty: A Critique of Applications in Experimental Psychology , 2010, Entropy.

[51]  P. Landsberg,et al.  Simple measure for complexity , 1999 .

[52]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[53]  Ricarda Ines Schubotz,et al.  Prediction and Expectation , 2015 .

[54]  R. Dolan,et al.  Temporally Unpredictable Sounds Exert a Context-Dependent Influence on Evaluation of Unrelated Images , 2015, PloS one.

[55]  R. Dolan,et al.  Knowing how much you don't know: a neural organization of uncertainty estimates , 2012, Nature Reviews Neuroscience.

[56]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[57]  Morten H. Christiansen,et al.  Statistical Learning and Language: An Individual Differences Study , 2012 .

[58]  Uri Hasson,et al.  Neural systems mediating recognition of changes in statistical regularities , 2012, NeuroImage.

[59]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[60]  Timothy E. J. Behrens,et al.  Perceptual Classification in a Rapidly Changing Environment , 2011, Neuron.

[61]  J. Mazziotta,et al.  Cracking the Language Code: Neural Mechanisms Underlying Speech Parsing , 2006, The Journal of Neuroscience.

[62]  Florent Meyniel,et al.  The Neural Representation of Sequences: From Transition Probabilities to Algebraic Patterns and Linguistic Trees , 2015, Neuron.

[63]  P. Perruchet,et al.  Implicit learning and statistical learning: one phenomenon, two approaches , 2006, Trends in Cognitive Sciences.

[64]  Erik D. Thiessen,et al.  Statistical learning of language: Theory, validity, and predictions of a statistical learning account of language acquisition , 2015 .

[65]  J. Gläscher,et al.  Formal Learning Theory Dissociates Brain Regions with Different Temporal Integration , 2005, Neuron.

[66]  Uri Hasson,et al.  Global features of functional brain networks change with contextual disorder , 2015, NeuroImage.

[67]  P. Vitz,et al.  PREFERENCES FOR RATES OF INFORMATION PRESENTED BY SEQUENCES OF TONES. , 1964, Journal of experimental psychology.

[68]  G. McCarthy,et al.  Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex , 2002, Nature Neuroscience.

[69]  E. Newport,et al.  Science Current Directions in Psychological Statistical Learning : from Acquiring Specific Items to Forming General Rules on Behalf Of: Association for Psychological Science , 2022 .

[70]  D. Mareschal,et al.  Local redundancy governs infants' spontaneous orienting to visual-temporal sequences. , 2013, Child development.

[71]  W. R. Garner Uncertainty and structure as psychological concepts , 1975 .

[72]  Uri Hasson,et al.  Uncertainty in visual and auditory series is coded by modality‐general and modality‐specific neural systems , 2014, Human brain mapping.

[73]  James A. Dixon,et al.  Strong anticipation: Multifractal cascade dynamics modulate scaling in synchronization behaviors , 2011 .

[74]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.