Predictability of what or where reduces brain activity, but a bottleneck occurs when both are predictable

&NA; Detecting regularities in the sensory environment licenses predictions that enable adaptive behaviour. However, it is unclear whether predictions about object category, location, or both dimensions are mediated by overlapping systems, and relatedly, whether constructing predictions about both category and location is associated with processing bottlenecks. To examine this issue, in an fMRI study, we presented participants with image‐series in which non‐deterministic transition probabilities enabled predictions about either the location of the next image, its semantic category, both dimensions, or neither (the latter forming a “no‐regularity” random baseline condition). Speaking to a common system, all three predictable conditions resulted in reduced BOLD activity in four clusters: left rostral anterior cingulate cortex; bilateral putamen, caudate and thalamus; right precentral gyrus, and left visual cortex. Pointing to a processing bottleneck, in some regions, a significant interaction between the two factors was found whereby category‐predictable series were associated with lower activity – but only when location regularity was absent. Finally, category regularity decreased activation in areas of the ventral visual stream and semantic areas of lateral temporal cortex, and location regularity decreased activation in a dorsal fronto‐parietal cluster, long implicated in the endogenous control of spatial attention. Our findings confirm and expand a role for dACC/dmPFC and striatum in monitoring or responding to uncertainty in the environment and point to a limited capacity bottleneck when multiple predictions are concurrently licensed.

[1]  Michael Esterman,et al.  Perceptual expectation evokes category-selective cortical activity. , 2010, Cerebral cortex.

[2]  Richard N. Aslin,et al.  The Goldilocks Effect: Human Infants Allocate Attention to Visual Sequences That Are Neither Too Simple Nor Too Complex , 2012, PloS one.

[3]  Klaus Scheffler,et al.  Temporal integration of sequential auditory events: silent period in sound pattern activates human planum temporale , 2003, NeuroImage.

[4]  James A. Dixon,et al.  Strong anticipation: Multifractal cascade dynamics modulate scaling in synchronization behaviors , 2011 .

[5]  R. O’Reilly,et al.  Separate neural substrates for skill learning and performance in the ventral and dorsal striatum , 2007, Nature Neuroscience.

[6]  S. White Dual role , 1996, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[7]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[8]  K. Worsley,et al.  Unified univariate and multivariate random field theory , 2004, NeuroImage.

[9]  P. Lewicki,et al.  Nonconscious acquisition of information. , 1992, The American psychologist.

[10]  S. Grossberg Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion and action , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Mark W. Woolrich,et al.  Robust group analysis using outlier inference , 2008, NeuroImage.

[12]  Marlene Behrmann,et al.  Probability Cuing of Target Location Facilitates Visual Search Implicitly in Normal Participants and Patients with Hemispatial Neglect , 2002, Psychological science.

[13]  Iain D Gilchrist,et al.  Target location probability effects in visual search: an effect of sequential dependencies. , 2006, Journal of experimental psychology. Human perception and performance.

[14]  Denise C. Park,et al.  A lifespan database of adult facial stimuli , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[15]  Zhang Qi-hong Improved Optimization for Simplex Method Based on Matrix Calculation , 2006 .

[16]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[17]  Tiina Vuorinen Processing of speech and non-speech sounds in the language-related cortex compared between dyslexic and normal-reading adults : fMRI-study , 2000 .

[18]  M. Kawato,et al.  Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. , 2006, Journal of neurophysiology.

[19]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[20]  S. Kastner,et al.  Shifting Attentional Priorities: Control of Spatial Attention through Hemispheric Competition , 2013, The Journal of Neuroscience.

[21]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[22]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[23]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[24]  Katiuscia Sacco,et al.  ModalitiesBehavioral Context Across Multiple Sensory A Cortical Network Sensitive to Stimulus Salience in a , 2015 .

[25]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[26]  M. Chee,et al.  Overlap and Dissociation of Semantic Processing of Chinese Characters, English Words, and Pictures: Evidence from fMRI , 2000, NeuroImage.

[27]  N. Daw,et al.  Dissociating hippocampal and striatal contributions to sequential prediction learning , 2012, The European journal of neuroscience.

[28]  S. Keele,et al.  The cognitive and neural architecture of sequence representation. , 2003, Psychological review.

[29]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[30]  Michael P. Kaschak,et al.  Global statistical learning in a visual search task. , 2012, Journal of experimental psychology. Human perception and performance.

[31]  G. Remillard Pure perceptual-based sequence learning: a role for visuospatial attention. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[32]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[33]  J. Saiki,et al.  Gift from statistical learning: Visual statistical learning enhances memory for sequence elements and impairs memory for items that disrupt regularities , 2016, Cognition.

[34]  Larry Gates,et al.  Distinct and shared cortical regions of the human brain activated by pictorial depictions versus verbal descriptions: an fMRI study , 2005, NeuroImage.

[35]  Richard N Aslin,et al.  The Goldilocks effect in infant auditory attention. , 2014, Child development.

[36]  L. Reddy,et al.  Learning of anticipatory responses in single neurons of the human medial temporal lobe , 2015, Nature Communications.

[37]  Uri Hasson,et al.  Multiple sensitivity profiles to diversity and transition structure in non-stationary input , 2012, NeuroImage.

[38]  J. Gore,et al.  A Stimulus-Driven Approach to Object Identity and Location Processing in the Human Brain , 2000, Neuron.

[39]  Rufin Vogels,et al.  When does repetition suppression depend on repetition probability? , 2014, Front. Hum. Neurosci..

[40]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[41]  Christian Gerlach,et al.  A Review of Functional Imaging Studies on Category Specificity , 2007, Journal of Cognitive Neuroscience.

[42]  Martin Kronbichler,et al.  Neural repetition suppression: evidence for perceptual expectation in object-selective regions , 2014, Front. Hum. Neurosci..

[43]  Karl J. Friston,et al.  A Dual Role for Prediction Error in Associative Learning , 2008, Cerebral cortex.

[44]  Timothy F. Brady,et al.  PSYCHOLOGICAL SCIENCE Research Article Statistical Learning Using Real-World Scenes Extracting Categorical Regularities Without Conscious Intent , 2022 .

[45]  Joan Y. Chiao,et al.  An Event-related fMRI Study of Artificial Grammar Learning in a Balanced Chunk Strength Design , 2004, Journal of Cognitive Neuroscience.

[46]  Morten H. Christiansen,et al.  Domain generality versus modality specificity: the paradox of statistical learning , 2015, Trends in Cognitive Sciences.

[47]  Karen A. Daniels,et al.  Conscious and Unconscious Processing of Nonverbal Predictability in Wernicke's Area , 2000, The Journal of Neuroscience.

[48]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Uri Hasson,et al.  Neural systems mediating recognition of changes in statistical regularities , 2012, NeuroImage.

[50]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[51]  G. McCarthy,et al.  Decisions under Uncertainty: Probabilistic Context Influences Activation of Prefrontal and Parietal Cortices , 2005, The Journal of Neuroscience.

[52]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[53]  Timothy E. J. Behrens,et al.  Perceptual Classification in a Rapidly Changing Environment , 2011, Neuron.

[54]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[55]  D. V. Cramon,et al.  Predicting Perceptual Events Activates Corresponding Motor Schemes in Lateral Premotor Cortex: An fMRI Study , 2002, NeuroImage.

[56]  Marcia K. Johnson,et al.  Implicit Perceptual Anticipation Triggered by Statistical Learning , 2010, The Journal of Neuroscience.

[57]  Hongkeun Kim Involvement of the dorsal and ventral attention networks in oddball stimulus processing: A meta‐analysis , 2014, Human brain mapping.

[58]  G. Remillard Pure perceptual-based sequence learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[59]  J. Mazziotta,et al.  Cracking the Language Code: Neural Mechanisms Underlying Speech Parsing , 2006, The Journal of Neuroscience.

[60]  M. Goldsmith,et al.  Statistical Learning by 8-Month-Old Infants , 1996 .

[61]  J. Downar,et al.  A cortical network sensitive to stimulus salience in a neutral behavioral context across multiple sensory modalities. , 2002, Journal of neurophysiology.

[62]  Rufin Vogels,et al.  Stimulus repetition probability does not affect repetition suppression in macaque inferior temporal cortex. , 2011, Cerebral cortex.

[63]  Petra E. Pajtas,et al.  Concordance between perceptual and categorical repetition effects in the ventral visual stream. , 2011, Journal of neurophysiology.

[64]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[65]  Morten Overgaard,et al.  Uncertainty and confidence from the triple-network perspective: Voxel-based meta-analyses , 2014, Brain and Cognition.

[66]  Marco Baroni,et al.  Processing of speech and non-speech sounds in the supratemporal plane: Auditory input preference does not predict sensitivity to statistical structure , 2013, NeuroImage.

[67]  D Yves von Cramon,et al.  Sequences of Abstract Nonbiological Stimuli Share Ventral Premotor Cortex with Action Observation and Imagery , 2004, The Journal of Neuroscience.

[68]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[69]  QI Guan-rong,et al.  TIME SCALES , 1998, AMS/MAA Textbooks.

[70]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[71]  L. Tyler,et al.  Unitary vs multiple semantics: PET studies of word and picture processing , 2004, Brain and Language.

[72]  K. Rayner,et al.  Effects of contextual predictability and transitional probability on eye movements during reading. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[73]  J. Rauschecker,et al.  Brain Activation during Anticipation of Sound Sequences , 2009, The Journal of Neuroscience.

[74]  N. Turk-Browne,et al.  Attention Is Spontaneously Biased Toward Regularities , 2013, Psychological science.

[75]  Uri Hasson,et al.  Uncertainty in visual and auditory series is coded by modality‐general and modality‐specific neural systems , 2014, Human brain mapping.

[76]  D Yves von Cramon,et al.  Exploring the detection of associatively novel events using fMRI , 2011, Human brain mapping.

[77]  Daniel Dewey,et al.  Learning What to Value , 2011, AGI.

[78]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[79]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[80]  D. J. Marcus,et al.  Oculomotor evidence of sequence learning on the serial reaction time task , 2006, Memory & cognition.

[81]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[82]  E. Maris,et al.  Prior Expectation Mediates Neural Adaptation to Repeated Sounds in the Auditory Cortex: An MEG Study , 2011, The Journal of Neuroscience.

[83]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[84]  U. Mayr,et al.  Spatial attention and implicit sequence learning: evidence for independent learning of spatial and nonspatial sequences. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[85]  B. Everitt,et al.  Cocaine Seeking Habits Depend upon Dopamine-Dependent Serial Connectivity Linking the Ventral with the Dorsal Striatum , 2008, Neuron.

[86]  C. Carter,et al.  Regional brain activation during concurrent implicit and explicit sequence learning. , 2004, Cerebral cortex.

[87]  A. Graybiel The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[88]  M. Behrmann,et al.  Spatial probability as an attentional cue in visual search , 2005, Perception & psychophysics.

[89]  Michael Smithson,et al.  Judgment under Chaos , 1997 .

[90]  Christopher M. Conway,et al.  The Importance of Sound for Cognitive Sequencing Abilities , 2009, Current directions in psychological science.

[91]  M. Burke,et al.  The contribution of the right supra-marginal gyrus to sequence learning in eye movements , 2013, Neuropsychologia.

[92]  W. Penny,et al.  Time Scales of Representation in the Human Brain: Weighing Past Information to Predict Future Events , 2011, Front. Hum. Neurosci..

[93]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[94]  M. Bar,et al.  Human preferences are biased towards associative information , 2015, Cognition & emotion.

[95]  Uri Hasson,et al.  Connectivity in the human brain dissociates entropy and complexity of auditory inputs , 2015, NeuroImage.

[96]  Tom M. Mitchell,et al.  From the SelectedWorks of Marcel Adam Just 2011 Commonality of neural representations of words and pictures , 2016 .

[97]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[98]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[99]  Thomas Goschke,et al.  On the modularity of implicit sequence learning: Independent acquisition of spatial, symbolic, and manual sequences , 2012, Cognitive Psychology.

[100]  M Zaitsev,et al.  Point spread function mapping with parallel imaging techniques and high acceleration factors: Fast, robust, and flexible method for echo‐planar imaging distortion correction , 2004, Magnetic resonance in medicine.

[101]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[102]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[103]  Michael J. Constantino,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008 .

[104]  Joseph T. Devlin,et al.  Orienting attention to semantic categories , 2006, NeuroImage.