Temporal uncertainty affects the visual processing of predicted stimulus properties

Abstract Predictive processing has been proposed as a fundamental cognitive mechanism to account for how the brain interacts with the external environment via its sensory modalities. The brain processes external information about the content (i.e. “what”) and timing (i.e., “when”) of environmental stimuli to update an internal generative model of the world around it. However, the interaction between “what” and “when” has received very little attention when focusing on vision. In this magnetoencephalography (MEG) study we investigate how processing of feature specific information (i.e. “what”) is affected by temporal predictability (i.e. “when”). In line with previous findings, we observed a suppression of evoked neural responses in the visual cortex for predictable stimuli. Interestingly, we observed that temporal uncertainty enhances this expectation suppression effect. This suggests that in temporally uncertain scenarios the neurocognitive system relies more on internal representations and invests less resources integrating bottom-up information. Indeed, temporal decoding analysis indicated that visual features are encoded for a shorter time period by the neural system when temporal uncertainty is higher. This supports the fact that visual information is maintained active for less time for a stimulus whose time onset is unpredictable compared to when it is predictable. These findings highlight the higher reliance of the visual system on the internal expectations when the temporal dynamics of the external environment are less predictable.

[1]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[2]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[3]  Karl J. Friston,et al.  A Dual Role for Prediction Error in Associative Learning , 2008, Cerebral cortex.

[4]  Tijl Grootswagers,et al.  An introduction to time-resolved decoding analysis for M/EEG. , 2019, 1905.04820.

[5]  Karl J. Friston,et al.  Not All Predictions Are Equal: “What” and “When” Predictions Modulate Activity in Auditory Cortex through Different Mechanisms , 2018, The Journal of Neuroscience.

[6]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[7]  Krish Devi Singh,et al.  Dynamic representations of behaviourally relevant features support rapid face processing in the human ventral visual stream , 2018, bioRxiv.

[8]  David P. McGovern,et al.  Evaluating the neurophysiological evidence for predictive processing as a model of perception , 2020, Annals of the New York Academy of Sciences.

[9]  Karl J. Friston,et al.  Repetition suppression and its contextual determinants in predictive coding , 2016, Cortex.

[10]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[11]  Krish D. Singh,et al.  Dynamic representations of faces in the human ventral visual stream link visual features to behaviour , 2018 .

[12]  Jiaxiang Zhang,et al.  Spatiotemporal dynamics in human visual cortex rapidly encode the emotional content of faces , 2018, Human brain mapping.

[13]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[14]  P. Sachs,et al.  SMARCAD1 ATPase activity is required to silence endogenous retroviruses in embryonic stem cells , 2019, Nature Communications.

[15]  Floris P. de Lange,et al.  Expectation Suppression in Early Visual Cortex Depends on Task Set , 2015, PloS one.

[16]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[17]  A. Todorović,et al.  Repetition Suppression and Expectation Suppression Are Dissociable in Time in Early Auditory Evoked Fields , 2012, The Journal of Neuroscience.

[18]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[19]  Floris P de Lange,et al.  Prior expectations induce prestimulus sensory templates , 2017, Proceedings of the National Academy of Sciences.

[20]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[21]  A. Pollard,et al.  Limb proportions show developmental plasticity in response to embryo movement , 2017, Scientific Reports.

[22]  Anthony N. Burkitt,et al.  Predictive coding of visual object position ahead of moving objects revealed by time-resolved EEG decoding , 2018, NeuroImage.

[23]  S. Dehaene,et al.  Brain Mechanisms Underlying the Brief Maintenance of Seen and Unseen Sensory Information , 2016, Neuron.

[24]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[25]  Karl J. Friston,et al.  Where bottom-up meets top-down: neuronal interactions during perception and imagery. , 2004, Cerebral cortex.

[26]  Michael W. Spratling A review of predictive coding algorithms , 2017, Brain and Cognition.

[27]  Jonas Larsson,et al.  fMRI repetition suppression: neuronal adaptation or stimulus expectation? , 2012, Cerebral cortex.

[28]  L. Levin,et al.  Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps , 2015, PloS one.

[29]  John H. R. Maunsell,et al.  Visual response latencies in striate cortex of the macaque monkey. , 1992, Journal of neurophysiology.

[30]  Hinze Hogendoorn,et al.  Predictions drive neural representations of visual events ahead of incoming sensory information , 2020, Proceedings of the National Academy of Sciences.

[31]  Radoslaw Martin Cichy,et al.  Multivariate pattern analysis for MEG: A comparison of dissimilarity measures , 2018, NeuroImage.

[32]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[33]  F. D. de Lange,et al.  Repetition suppression to objects is modulated by stimulus-specific expectations , 2017, Scientific Reports.

[34]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[35]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[36]  Yalda Mohsenzadeh,et al.  Decoding the orientation of contrast edges from MEG evoked and induced responses , 2017, NeuroImage.

[37]  Nicola Molinaro,et al.  Contrasting functional imaging parametric maps: The mislocation problem and alternative solutions , 2018, NeuroImage.

[38]  Nathan Weisz,et al.  Automatic and feature-specific prediction-related neural activity in the human auditory system , 2019, Nature Communications.