Temporal and spatial localization of prediction-error signals in the visual brain

It has been suggested that the brain pre-empts changes in the visual environment through generating predictions, although real-time eletrophysiological evidence of prediction violations remains elusive. In a series of experiments we showed participants sequences of images that followed a predictable implied sequence or whose final image violated the implied sequence. Through careful design we were able to use the same final image transitions across predictable and unpredictable conditions, ensuring that any differences in neural responses were due only to preceding context and not to the images themselves. EEG and MEG recordings showed that early/mid-latency visual evoked potentials were robustly modulated by images that violated the implied sequence across a range of types of image change (expression deformations, rigid-rotations and visual field location). This modulation occurred irrespective of stimulus object category. Although the stimuli were static images, MEG source reconstruction of the early latency signal (N/M170) localised expectancy violation signals to brain areas associated with motion perception. Our findings suggest that the N/M170 can index mismatches between predicted and actual visual inputs in a system that predicts trajectories based on ongoing context. This has important implications for understanding the N/M170 and investigating how the brain represents context to generate perceptual predictions.

[1]  E. Halgren,et al.  Cognitive response profile of the human fusiform face area as determined by MEG. , 2000, Cerebral cortex.

[2]  Mark H. Johnson,et al.  The development and neural basis of referential gaze perception , 2006, Social neuroscience.

[3]  Antony B. Morland,et al.  DataViewer3D: An Open-Source, Cross-Platform Multi-Modal Neuroimaging Data Visualization Tool , 2009, Front. Neuroinform..

[4]  Yue-jia Luo,et al.  When rapid adaptation paradigm is not too rapid: Evidence of face-sensitive N170 adaptation effects , 2015, Biological Psychology.

[5]  Moshe Bar,et al.  Predictive Feedback and Conscious Visual Experience , 2012, Front. Psychology.

[6]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[7]  Bruno Rossion,et al.  The early visual encoding of a face (N170) is viewpoint-dependent: A parametric ERP-adaptation study , 2015, Biological Psychology.

[8]  Matthias M. Müller,et al.  Effects of picture repetition on induced gamma band responses, evoked potentials, and phase synchrony in the human EEG. , 2002, Brain research. Cognitive brain research.

[9]  T. Hubbard Representational momentum and related displacements in spatial memory: A review of the findings , 2005, Psychonomic bulletin & review.

[10]  L. Levita,et al.  Potentiation of the early visual response to learned danger signals in adults and adolescents. , 2015, Social cognitive and affective neuroscience.

[11]  M. Eimer The Face-Sensitive N170 Component of the Event-Related Brain Potential , 2011 .

[12]  O. Churches,et al.  Is neural adaptation of the N170 category-specific? Effects of adaptor stimulus duration and interstimulus interval. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  A. Young,et al.  The N170 observed 'in the wild': robust event-related potentials to faces in cluttered dynamic visual scenes. , 2015, Social cognitive and affective neuroscience.

[14]  Karl J. Friston,et al.  Experience-dependent coding of facial expression in superior temporal sulcus , 2007, Proceedings of the National Academy of Sciences.

[15]  Mark H. Johnson,et al.  The N170 Shows Differential Repetition Effects for Faces, Objects, and Orthographic Stimuli , 2011, Front. Hum. Neurosci..

[16]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[17]  István Czigler,et al.  Visual mismatch negativity (vMMN): a prediction error signal in the visual modality , 2015, Front. Hum. Neurosci..

[18]  Michael I. G. Simpson,et al.  MEG Adaptation Resolves the Spatiotemporal Characteristics of Face-Sensitive Brain Responses , 2015, The Journal of Neuroscience.

[19]  Gavin Perry,et al.  Localizing evoked and induced responses to faces using magnetoencephalography , 2014, The European journal of neuroscience.

[20]  R. Silberstein,et al.  Steady State Visually Evoked Potential Correlates of Static and Dynamic Emotional Face Processing , 2009, Brain Topography.

[21]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[22]  N. Kanwisher,et al.  The selectivity of the occipitotemporal M170 for faces , 2000, Neuroreport.

[23]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[24]  R. Parasuraman,et al.  Neural Adaptation Provides Evidence for Categorical Differences in Processing of Faces and Chinese Characters: An ERP Study of the N170 , 2012, PloS one.

[25]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[26]  S. Bentin,et al.  A magnetoencephalographic study of face processing: M170, gamma‐band oscillations and source localization , 2013, Human brain mapping.

[27]  P. Johnston,et al.  Facial Motion Engages Predictive Visual Mechanisms , 2014, PloS one.

[28]  Beatrice de Gelder,et al.  Context influences early perceptual analysis of faces--an electrophysiological study. , 2006, Cerebral cortex.

[29]  P. Hagoort,et al.  The suppression of repetition enhancement: A review of fMRI studies , 2013, Neuropsychologia.

[30]  Gary G. R. Green,et al.  Source stability index: A novel beamforming based localisation metric , 2010, NeuroImage.

[31]  P. Johnston,et al.  Electrophysiological responses to violations of expectation from eye gaze and arrow cues. , 2013, Social cognitive and affective neuroscience.

[32]  Bruce D. McCandliss,et al.  The visual word form area: expertise for reading in the fusiform gyrus , 2003, Trends in Cognitive Sciences.

[33]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[34]  Andrew Tucker,et al.  The effect of blinks and saccadic eye movements on visual reaction times , 2009, Attention, perception & psychophysics.

[35]  Jing Xu,et al.  Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN , 2010, Neuroscience Letters.

[36]  Mark H. Johnson,et al.  Oxford Handbook of Face Perception , 2011 .

[37]  Gyula Kovács,et al.  Neural Correlates of Generic versus Gender-specific Face Adaptation , 2010, Journal of Cognitive Neuroscience.

[38]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[39]  B. Rossion,et al.  ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception , 2011, Vision Research.

[40]  F. Carducci,et al.  Automatic alignment of EEG/MEG and MRI data sets , 2001, Clinical Neurophysiology.

[41]  S. Zeki,et al.  Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. , 1971, Brain research.

[42]  X. Cao,et al.  N170 adaptation effect for repeated faces and words , 2015, Neuroscience.

[43]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[44]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  M. Eimer,et al.  The N170 component and its links to configural face processing: A rapid neural adaptation study , 2011, Brain Research.

[46]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[47]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[48]  R. Gregory Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[49]  A. Young,et al.  Brain networks subserving the evaluation of static and dynamic facial expressions , 2013, Cortex.

[50]  J. Tanaka,et al.  A Neural Basis for Expert Object Recognition , 2001, Psychological science.

[51]  Karl J. Friston,et al.  Cortical circuits for perceptual inference , 2009, Neural Networks.

[52]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[53]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[54]  Patrik Vuilleumier,et al.  EEG-MEG evidence for early differential repetition effects for fearful, happy and neutral faces , 2009, Brain Research.

[55]  E. Amenedo,et al.  MMN in the visual modality: a review , 2003, Biological Psychology.

[56]  Matthias M. Müller,et al.  Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. , 2004, Cerebral cortex.

[57]  J. Hietanen,et al.  The Naked Truth: The Face and Body Sensitive N170 Response Is Enhanced for Nude Bodies , 2011, PloS one.

[58]  J. Hietanen,et al.  Facilitated early cortical processing of nude human bodies , 2015, Biological Psychology.

[59]  Piia Astikainen,et al.  Biological Psychology , 2019 .

[60]  Andrew D. Engell,et al.  Repetition suppression of face‐selective evoked and induced EEG recorded from human cortex , 2014, Human brain mapping.