Prior Expectations Evoke Stimulus Templates in the Primary Visual Cortex

Sensory processing is strongly influenced by prior expectations. Valid expectations have been shown to lead to improvements in perception as well as in the quality of sensory representations in primary visual cortex. However, very little is known about the neural correlates of the expectations themselves. Previous studies have demonstrated increased activity in sensory cortex following the omission of an expected stimulus, yet it is unclear whether this increased activity constitutes a general surprise signal or rather has representational content. One intriguing possibility is that top–down expectation leads to the formation of a template of the expected stimulus in visual cortex, which can then be compared with subsequent bottom–up input. To test this hypothesis, we used fMRI to noninvasively measure neural activity patterns in early visual cortex of human participants during expected but omitted visual stimuli. Our results show that prior expectation of a specific visual stimulus evokes a feature-specific pattern of activity in the primary visual cortex (V1) similar to that evoked by the corresponding actual stimulus. These results are in line with the notion that prior expectation triggers the formation of specific stimulus templates to efficiently process expected sensory inputs.

[1]  Janneke F. M. Jehee,et al.  Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex , 2012, Neuron.

[2]  Joel Pearson,et al.  Phantom perception: voluntary and involuntary nonretinal vision , 2015, Trends in Cognitive Sciences.

[3]  Lars Muckli,et al.  Contributions of cortical feedback to sensory processing in primary visual cortex , 2014, Front. Psychol..

[4]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[5]  Marcia K. Johnson,et al.  A brief thought can modulate activity in extrastriate visual areas: Top-down effects of refreshing just-seen visual stimuli , 2007, NeuroImage.

[6]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[7]  Floris P. de Lange,et al.  How Prediction Errors Shape Perception, Attention, and Motivation , 2012, Front. Psychology.

[8]  E. Schröger,et al.  Hearing Silences: Human Auditory Processing Relies on Preactivation of Sound-Specific Brain Activity Patterns , 2013, The Journal of Neuroscience.

[9]  S. Kosslyn,et al.  Mental Imagery: Functional Mechanisms and Clinical Applications , 2015, Trends in Cognitive Sciences.

[10]  Y. Dan,et al.  Activity Recall in Visual Cortical Ensemble , 2012, Nature Neuroscience.

[11]  Henry Kennedy,et al.  Functional implications of the anatomical organization of the callosal projections of visual areas V1 and V2 in the macaque monkey , 1988, Behavioural Brain Research.

[12]  Frank Tong,et al.  The Functional Impact of Mental Imagery on Conscious Perception , 2008, Current Biology.

[13]  Erich Schröger,et al.  I know what is missing here: electrophysiological prediction error signals elicited by omissions of predicted ”what” but not ”when” , 2013, Front. Hum. Neurosci..

[14]  Luc H. Arnal,et al.  Cortical oscillations and sensory predictions , 2012, Trends in Cognitive Sciences.

[15]  Marty J. Schmidt,et al.  Orientation-Specific Color Aftereffects Following Imagination. , 1977 .

[16]  Luc H. Arnal,et al.  Transitions in neural oscillations reflect prediction errors generated in audiovisual speech , 2011, Nature Neuroscience.

[17]  Jonathan Winawer,et al.  A motion aftereffect from visual imagery of motion , 2010, Cognition.

[18]  I. Nelken,et al.  Sensitivity to Complex Statistical Regularities in Rat Auditory Cortex , 2012, Neuron.

[19]  Joshua J. Tremel,et al.  Prior probability and feature predictability interactively bias perceptual decisions , 2014, Neuropsychologia.

[20]  Yuhong Jiang,et al.  Selection of events in time enhances activity throughout early visual cortex. , 2012, Journal of neurophysiology.

[21]  Michael J. Constantino,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008 .

[22]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[23]  Michael Esterman,et al.  Perceptual expectation evokes category-selective cortical activity. , 2010, Cerebral cortex.

[24]  Egill Rostrup,et al.  Motion or activity: their role in intra- and inter-subject variation in fMRI , 2005, NeuroImage.

[25]  Luc H. Arnal,et al.  Dual Neural Routing of Visual Facilitation in Speech Processing , 2009, The Journal of Neuroscience.

[26]  H. Helmholtz Handbuch der physiologischen Optik , 2015 .

[27]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[28]  A. Todorović,et al.  Repetition Suppression and Expectation Suppression Are Dissociable in Time in Early Auditory Evoked Fields , 2012, The Journal of Neuroscience.

[29]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[30]  S. Dehaene,et al.  Evidence for a hierarchy of predictions and prediction errors in human cortex , 2011, Proceedings of the National Academy of Sciences.

[31]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[32]  John Duncan,et al.  Shape-specific preparatory activity mediates attention to targets in human visual cortex , 2009, Proceedings of the National Academy of Sciences.

[33]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[34]  H. Lau,et al.  Prestimulus Oscillatory Activity over Motor Cortex Reflects Perceptual Expectations , 2013, The Journal of Neuroscience.

[35]  Alec Marantz,et al.  Lexical Preactivation in Basic Linguistic Phrases , 2015, Journal of Cognitive Neuroscience.

[36]  Charan Ranganath,et al.  Category expectation modulates baseline and stimulus-evoked activity in human inferotemporal cortex , 2009, Brain Research.

[37]  Benjamin Morillon,et al.  Attention in the temporal domain: a phase-coding mechanism controls the gain of sensory processing , 2013, Front. Hum. Neurosci..

[38]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[39]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[40]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[41]  F. D. Lange,et al.  Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex , 2014, Current Biology.

[42]  María Ruz,et al.  Attention to individual identities modulates face processing , 2015, Experimental Brain Research.

[43]  Rainer Goebel,et al.  Horizontal tuning for faces originates in high-level Fusiform Face Area , 2016, Neuropsychologia.

[44]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  David E. J. Linden,et al.  Orientation-specific adaptation to mentally generated lines in human visual cortex , 2009, NeuroImage.

[46]  F. D. de Lange,et al.  Prior Expectations Bias Sensory Representations in Visual Cortex , 2013, The Journal of Neuroscience.

[47]  C. Summerfield,et al.  A Neural Representation of Prior Information during Perceptual Inference , 2008, Neuron.

[48]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[49]  Tim Fingscheidt,et al.  A computational analysis of the neural bases of Bayesian inference , 2015, NeuroImage.

[50]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[51]  R. Desimone,et al.  A backward progression of attentional effects in the ventral stream , 2009, Proceedings of the National Academy of Sciences.

[52]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[53]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[54]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[55]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[56]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[57]  Robert P. O'Shea,et al.  Refractoriness about adaptation , 2015, Front. Hum. Neurosci..

[58]  Christopher Summerfield,et al.  Dissociable prior influences of signal probability and relevance on visual contrast sensitivity , 2011 .

[59]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[60]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[61]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[62]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[63]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[64]  Maurizio Corbetta,et al.  Anticipatory and Stimulus-Evoked Blood Oxygenation Level-Dependent Modulations Related to Spatial Attention Reflect a Common Additive Signal , 2009, The Journal of Neuroscience.

[65]  Richard N. Aslin,et al.  Top-down modulation in the infant brain: Learning-induced expectations rapidly affect the sensory cortex at 6 months , 2015, Proceedings of the National Academy of Sciences.

[66]  S. Kastner,et al.  A neural basis for real-world visual search in human occipitotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[67]  R. Desimone,et al.  Responses of Macaque Perirhinal Neurons during and after Visual Stimulus Association Learning , 1999, The Journal of Neuroscience.

[68]  Chris I. Baker,et al.  Disentangling visual imagery and perception of real-world objects , 2012, NeuroImage.

[69]  Peter Carruthers,et al.  Opening Up Vision: The Case Against Encapsulation , 2016 .

[70]  S. Kosslyn,et al.  The heterogeneity of mental representation: Ending the imagery debate , 2015, Proceedings of the National Academy of Sciences.

[71]  W. Ma Organizing probabilistic models of perception , 2012, Trends in Cognitive Sciences.

[72]  Karl J. Friston,et al.  A Dual Role for Prediction Error in Associative Learning , 2008, Cerebral cortex.

[73]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[74]  J. Duncan,et al.  Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery , 2009, The Journal of Neuroscience.

[75]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[76]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[77]  E. Maris,et al.  Prior Expectation Mediates Neural Adaptation to Repeated Sounds in the Auditory Cortex: An MEG Study , 2011, The Journal of Neuroscience.

[78]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[79]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[80]  M. Bar,et al.  Prediction, context, and competition in visual recognition , 2015, Annals of the New York Academy of Sciences.

[81]  C. Olson,et al.  Statistical learning of visual transitions in monkey inferotemporal cortex , 2011, Proceedings of the National Academy of Sciences.