Electrophysiological correlates of incidentally learned expectations in human vision.

The human visual system is remarkably sensitive to environmental regularities, which can facilitate behavioral performance when sensory events conform to past experience. The point at which prior knowledge is integrated during visual perception is unclear, particularly for incidentally learned associations. One possibility is that expectation shapes neural activity prospectively, in an anticipatory fashion, allowing prior knowledge to affect the earliest stages of sensory processing. Alternatively, cognitive processes underlying object recognition and conflict detection may be necessary precursors, constraining effects to later stages of processing. Here we used electroencephalography (EEG) to uncover neural activity that distinguishes between visual stimuli that match prior exposure and those that deviate from it. Participants identified visual targets that were associated with possible target locations; each location was associated with a high-probability target and a low-probability target. Alongside a behavioral cost for stimuli that had occurred infrequently at a cued location compared with those that had occurred frequently, we observed a focal modulation of the evoked EEG response at 250 ms after target onset. Relative to likely targets, unlikely targets evoked an enhanced negativity at midline frontal electrodes, and individual differences in the magnitude of this effect were correlated with the response time difference between likely and unlikely targets. In contrast, the evoked response at the latency of the P1, a correlate of early sensory processing, was indistinguishable for likely and unlikely targets. Together, these results point to postperceptual processes as a key stage at which experience modulates visual processing. NEW & NOTEWORTHY We combined electroencephalography with an incidental learning paradigm to investigate whether prior knowledge of environmental regularities modulates visual processing at early or late stages of sensory analysis. Our results reveal that modulations of neural activity arising at midlevel processing stages predict behavioral costs for unexpected stimuli rather than effects at early stages of sensory encoding.

[1]  Mareike Grotheer,et al.  The contribution of surprise to the prediction based modulation of fMRI responses , 2016, Neuropsychologia.

[2]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[3]  B. Stojanoski,et al.  Colour expectations during object perception are associated with early and late modulations of electrophysiological activity , 2015, Experimental Brain Research.

[4]  Kyungmin Su,et al.  The PREP pipeline: standardized preprocessing for large-scale EEG analysis , 2015, Front. Neuroinform..

[5]  J. Mattingley,et al.  Distinct contributions of attention and working memory to visual statistical learning and ensemble processing. , 2015, Journal of experimental psychology. Human perception and performance.

[6]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[7]  Floris P. de Lange,et al.  Prior Expectations Evoke Stimulus Templates in the Primary Visual Cortex , 2014, Journal of Cognitive Neuroscience.

[8]  Nicholas B Turk-Browne,et al.  Statistical learning and its consequences. , 2012, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[9]  Lauren V. Kustner,et al.  Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities , 2012, Current Biology.

[10]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[11]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[12]  N. Turk-Browne,et al.  Mutual Interference Between Statistical Summary Perception and Statistical Learning , 2011, Psychological science.

[13]  G. Glover Overview of functional magnetic resonance imaging. , 2011, Neurosurgery clinics of North America.

[14]  Jim M. Monti,et al.  Expectation and Surprise Determine Neural Population Responses in the Ventral Visual Stream , 2010, The Journal of Neuroscience.

[15]  Marcia K. Johnson,et al.  Implicit Perceptual Anticipation Triggered by Statistical Learning , 2010, The Journal of Neuroscience.

[16]  T. Braver,et al.  Cognitive Neuroscience Approaches to Individual Differences in Working Memory and Executive Control: Conceptual and Methodological Issues , 2010 .

[17]  Marvin M. Chun,et al.  Neural Evidence of Statistical Learning: Efficient Detection of Visual Regularities Without Awareness , 2009, Journal of Cognitive Neuroscience.

[18]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[19]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[20]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[21]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[22]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[23]  P. Perruchet,et al.  Implicit learning and statistical learning: one phenomenon, two approaches , 2006, Trends in Cognitive Sciences.

[24]  D. Linden The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[25]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[27]  Yuping Wang,et al.  The sequential processing of visual feature conjunction mismatches in the human brain. , 2004, Psychophysiology.

[28]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[29]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[30]  M. Junghöfer,et al.  The polar average reference effect: a bias in estimating the head surface integral in EEG recording , 1999, Clinical Neurophysiology.

[31]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[32]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[33]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[34]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[35]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[36]  G. Mangun Neural mechanisms of visual selective attention. , 1995, Psychophysiology.

[37]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[38]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[39]  Yasushi Miyashita,et al.  Generation of fractal patterns for probing the visual memory , 1991, Neuroscience Research.

[40]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[41]  N. Squires,et al.  The effect of stimulus sequence on the waveform of the cortical event-related potential. , 1976, Science.

[42]  tephen E. Palmer The effects of contextual scenes on the identification of objects , 1975, Memory & cognition.