Surprise About Sensory Event Timing Drives Cortical Transients in the Beta Frequency Band

Learning the statistical structure of the environment is crucial for adaptive behavior. Humans and nonhuman decision-makers seem to track such structure through a process of probabilistic inference, which enables predictions about behaviorally relevant events. Deviations from such predictions cause surprise, which in turn helps improve inference. Surprise about the timing of behaviorally relevant sensory events drives phasic responses of neuromodulatory brainstem systems, which project to the cerebral cortex. Here, we developed a computational model-based magnetoencephalography (MEG) approach for mapping the resulting cortical transients across space, time, and frequency, in the human brain (N = 28, 17 female). We used a Bayesian ideal observer model to learn the statistics of the timing of changes in a simple visual detection task. This model yielded quantitative trial-by-trial estimates of temporal surprise. The model-based surprise variable predicted trial-by-trial variations in reaction time more strongly than the externally observable interval timings alone. Trial-by-trial variations in surprise were negatively correlated with the power of cortical population activity measured with MEG. This surprise-related power suppression occurred transiently around the behavioral response, specifically in the beta frequency band. It peaked in parietal and prefrontal cortices, remote from the motor cortical suppression of beta power related to overt report (button press) of change detection. Our results indicate that surprise about sensory event timing transiently suppresses ongoing beta-band oscillations in association cortex. This transient suppression of frontal beta-band oscillations might reflect an active reset triggered by surprise, and is in line with the idea that beta-oscillations help maintain cognitive sets. SIGNIFICANCE STATEMENT The brain continuously tracks the statistical structure of the environment to anticipate behaviorally relevant events. Deviations from such predictions cause surprise, which in turn drives neural activity in subcortical brain regions that project to the cerebral cortex. We used magnetoencephalography in humans to map out surprise-related modulations of cortical population activity across space, time, and frequency. Surprise was elicited by variable timing of visual stimulus changes requiring a behavioral response. Surprise was quantified by means of an ideal observer model. Surprise predicted behavior as well as a transient suppression of beta frequency-band oscillations in frontal cortical regions. Our results are in line with conceptual accounts that have linked neural oscillations in the beta-band to the maintenance of cognitive sets.

[1]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[2]  W. Levelt,et al.  Pupillary dilation as a measure of attention: a quantitative system analysis , 1993 .

[3]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[4]  T. Knapen,et al.  Decision-related pupil dilation reflects upcoming choice and individual bias , 2014, Proceedings of the National Academy of Sciences.

[5]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[6]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[7]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[8]  Andreas K. Engel,et al.  Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making , 2009, Current Biology.

[9]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.

[10]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[11]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[12]  M. Corbetta,et al.  Large-scale cortical correlation structure of spontaneous oscillatory activity , 2012, Nature Neuroscience.

[13]  A. Nobre,et al.  Temporal Expectations Guide Dynamic Prioritization in Visual Working Memory through Attenuated α Oscillations , 2017, The Journal of Neuroscience.

[14]  David J. Anderson,et al.  Ventromedial hypothalamic neurons control a defensive emotion state , 2015, eLife.

[15]  M. Lee,et al.  Bayesian Cognitive Modeling: A Practical Course , 2014 .

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  D. McCormick,et al.  Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex , 2016, Nature Communications.

[18]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[19]  A. Nobre,et al.  Effects of Decision Variables and Intraparietal Stimulation on Sensorimotor Oscillatory Activity in the Human Brain , 2012, The Journal of Neuroscience.

[20]  Angela J. Yu,et al.  Phasic norepinephrine: A neural interrupt signal for unexpected events , 2006, Network.

[21]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[22]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[23]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[24]  Niels A. Kloosterman,et al.  Dynamic modulation of decision biases by brainstem arousal systems , 2017, eLife.

[25]  Florent Meyniel,et al.  The Sense of Confidence during Probabilistic Learning: A Normative Account , 2015, PLoS Comput. Biol..

[26]  W. Einhäuser,et al.  Pupil Dilation Signals Surprise: Evidence for Noradrenaline’s Role in Decision Making , 2011, Front. Neurosci..

[27]  Ricardo M. Neves,et al.  Modeling the effect of locus coeruleus firing on cortical state dynamics and single-trial sensory processing , 2015, Proceedings of the National Academy of Sciences.

[28]  Timothy E. J. Behrens,et al.  Dissociable effects of surprise and model update in parietal and anterior cingulate cortex , 2013, Proceedings of the National Academy of Sciences.

[29]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[30]  S. Debener,et al.  Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise , 2008, The Journal of Neuroscience.

[31]  Lars Riecke,et al.  Endogenous Delta/Theta Sound-Brain Phase Entrainment Accelerates the Buildup of Auditory Streaming , 2015, Current Biology.

[32]  A. Nobre,et al.  Temporal Expectation Improves the Quality of Sensory Information , 2012, The Journal of Neuroscience.

[33]  A. Nobre,et al.  Endogenous modulation of low frequency oscillations by temporal expectations , 2011, Journal of neurophysiology.

[34]  M. Siegel,et al.  Linking Band-Limited Cortical Activity to fMRI and Behavior , 2010 .

[35]  A. Nobre,et al.  The hazards of time , 2007, Current Opinion in Neurobiology.

[36]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[37]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[38]  A. Pettitt,et al.  Introduction to MCMC , 2012 .

[39]  M. Siegel,et al.  A framework for local cortical oscillation patterns , 2011, Trends in Cognitive Sciences.

[40]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[41]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[42]  R. Fisher FREQUENCY DISTRIBUTION OF THE VALUES OF THE CORRELATION COEFFIENTS IN SAMPLES FROM AN INDEFINITELY LARGE POPU;ATION , 1915 .

[43]  S. Sara,et al.  Network reset: a simplified overarching theory of locus coeruleus noradrenaline function , 2005, Trends in Neurosciences.

[44]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[45]  Niels A. Kloosterman,et al.  Top-down modulation in human visual cortex predicts the stability of a perceptual illusion. , 2015, Journal of neurophysiology.

[46]  J Gross,et al.  REPRINTS , 1962, The Lancet.

[47]  Guido Nolte,et al.  Multiple Transient Signals in Human Visual Cortex Associated with an Elementary Decision , 2017, The Journal of Neuroscience.

[48]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[49]  Karl J. Friston,et al.  Influence of Uncertainty and Surprise on Human Corticospinal Excitability during Preparation for Action , 2008, Current Biology.

[50]  H H Donaldson,et al.  LOCALIZATION IN THE BRAIN. , 1884, Science.

[51]  Stanislas Dehaene,et al.  Cortical activity is more stable when sensory stimuli are consciously perceived , 2015, Proceedings of the National Academy of Sciences.

[52]  A. Engel,et al.  Beta-band oscillations—signalling the status quo? , 2010, Current Opinion in Neurobiology.

[53]  Niels A. Kloosterman,et al.  Pupil size tracks perceptual content and surprise , 2015, The European journal of neuroscience.

[54]  Dov Sagi,et al.  Motion-induced blindness in normal observers , 2001, Nature.

[55]  Stefano Panzeri,et al.  Dopamine Is Signaled by Mid-frequency Oscillations and Boosts Output Layers Visual Information in Visual Cortex , 2018, Current Biology.

[56]  A. Nobre,et al.  Temporal Expectation Enhances Contrast Sensitivity by Phase Entrainment of Low-Frequency Oscillations in Visual Cortex , 2013, The Journal of Neuroscience.

[57]  A. Nobre,et al.  Alpha Oscillations Related to Anticipatory Attention Follow Temporal Expectations , 2011, The Journal of Neuroscience.

[58]  Saskia Haegens,et al.  Beyond the Status Quo: A Role for Beta Oscillations in Endogenous Content (Re)Activation , 2017, eNeuro.

[59]  Joseph W Kable,et al.  Normative evidence accumulation in unpredictable environments , 2015, eLife.

[60]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[61]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .