The Faces of Predictive Coding

Recent neurophysiological accounts of predictive coding hypothesized that a mismatch of prediction and sensory evidence—a prediction error (PE)—should be signaled by increased gamma-band activity (GBA) in the cortical area where prediction and evidence are compared. This hypothesis contrasts with alternative accounts where violated predictions should lead to reduced neural responses. We tested these hypotheses by violating predictions about face orientation and illumination direction in a Mooney face-detection task, while recording magnetoencephalographic responses in a large sample of 48 human subjects. The investigated predictions, acquired via lifelong experience, are known to be processed at different time points and brain regions during face recognition. Behavioral responses confirmed the induction of PEs by our task. Beamformer source analysis revealed an early PE signal for unexpected orientation in visual brain areas followed by a PE signal for unexpected illumination in areas involved in 3D shape from shading and spatial working memory. Both PE signals were reflected by increases in high-frequency (68–140 Hz) GBA. In high-frequency GBA we also observed a late interaction effect in visual brain areas, probably corresponding to a high-level PE signal. In addition, increased high-frequency GBA for expected illumination was observed in brain areas involved in attention to internal representations. Our results strongly support the hypothesis that increased GBA signals PEs. Additionally, GBA may represent attentional effects.

[1]  David Brewster,et al.  XLII.—On the Conversion of Relief by Inverted Vision , 1844 .

[2]  D. Brewster,et al.  XLII.—On the Conversion of Relief by Inverted Vision , 1847, Transactions of the Royal Society of Edinburgh.

[3]  D. Todd,et al.  The Sun , 1870, Nature.

[4]  C. M. Mooney,et al.  A new closure test. , 1951, Canadian journal of psychology.

[5]  Mooney Cm,et al.  A new closure test. , 1951 .

[6]  C. M. Mooney Age in the development of closure ability in children. , 1957, Canadian journal of psychology.

[7]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[8]  H. Pollak,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — III: The dimension of the space of essentially time- and band-limited signals , 1962 .

[9]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[10]  R. Yin Looking at Upside-down Faces , 1969 .

[11]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[12]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[13]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[14]  T. Valentine Upside-down faces: a review of the effect of inversion upon face recognition. , 1988, British journal of psychology.

[15]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[16]  Donald B. Percival,et al.  Spectral Analysis for Physical Applications , 1993 .

[17]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[18]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[19]  C D Frith,et al.  Neural mechanisms involved in the processing of global and local aspects of hierarchically organized visual stimuli. , 1997, Brain : a journal of neurology.

[20]  Patrick Cavanagh,et al.  Recovery of 3D volume from 2-tone images of novel objects , 1998, Cognition.

[21]  P. Perona,et al.  Where is the sun? , 1998, Nature Neuroscience.

[22]  Leslie G. Ungerleider,et al.  An area specialized for spatial working memory in human frontal cortex. , 1998, Science.

[23]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[24]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[25]  H. Kennedy,et al.  Laminar Distribution of Neurons in Extrastriate Areas Projecting to Visual Areas V1 and V4 Correlates with the Hierarchical Rank and Indicates the Operation of a Distance Rule , 2000, The Journal of Neuroscience.

[26]  J. Hegdé,et al.  Selectivity for Complex Shapes in Primate Visual Area V2 , 2000, The Journal of Neuroscience.

[27]  A. Schnitzler,et al.  Dynamic imaging of coherent sources: Studying neural interactions in the human brain. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[29]  M. Taira,et al.  Cortical Areas Related to Attention to 3D Surface Structures Based on Shading: An fMRI Study , 2001, NeuroImage.

[30]  Marti J. Anderson,et al.  Permutation tests for multi-factorial analysis of variance , 2003 .

[31]  G. Nolte The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. , 2003, Physics in medicine and biology.

[32]  N. Logothetis,et al.  Integration of Local Features into Global Shapes Monkey and Human fMRI Studies , 2003, Neuron.

[33]  E. Bullmore,et al.  Permutation tests for factorially designed neuroimaging experiments , 2004, Human brain mapping.

[34]  M-X Huang,et al.  Commonalities and Differences Among Vectorized Beamformers in Electromagnetic Source Imaging , 2003, Brain Topography.

[35]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[36]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[37]  J. Hawkins,et al.  On Intelligence , 2004 .

[38]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[39]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[40]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[41]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  Matthew J. Brookes,et al.  GLM-beamformer method demonstrates stationary field, alpha ERD and gamma ERS co-localisation with fMRI BOLD response in visual cortex , 2005, NeuroImage.

[43]  P. Nunez,et al.  A theoretical basis for standing and traveling brain waves measured with human EEG with implications for an integrated consciousness , 2006, Clinical Neurophysiology.

[44]  Robert Oostenveld,et al.  Localizing human visual gamma-band activity in frequency, time and space , 2006, NeuroImage.

[45]  Wendy J Adams,et al.  A common light-prior for visual search, shape, and reflectance judgments. , 2007, Journal of vision.

[46]  M. Landy,et al.  The effect of viewpoint on perceived visual roughness. , 2007, Journal of vision.

[47]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[48]  S. Grossberg Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. , 2007, Progress in brain research.

[49]  Alexander Borst,et al.  How does Nature Program Neuron Types? , 2008, Front. Neurosci..

[50]  Matthew J. Brookes,et al.  Optimising experimental design for MEG beamformer imaging , 2008, NeuroImage.

[51]  Anthony J. Sherbondy,et al.  ConTrack: finding the most likely pathways between brain regions using diffusion tractography. , 2008, Journal of vision.

[52]  M. Moscovitch,et al.  Top-down and bottom-up attention to memory: A hypothesis (AtoM) on the role of the posterior parietal cortex in memory retrieval , 2008, Neuropsychologia.

[53]  Guillén Fernández,et al.  Visual areas become less engaged in associative recall following memory stabilization , 2008, NeuroImage.

[54]  Michael W. Spratling Reconciling Predictive Coding and Biased Competition Models of Cortical Function , 2008, Frontiers Comput. Neurosci..

[55]  Topi Tanskanen,et al.  From local to global: Cortical dynamics of contour integration. , 2008, Journal of vision.

[56]  Ira Kemelmacher-Shlizerman,et al.  3D shape reconstruction of Mooney faces , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[58]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[59]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[60]  Robert Oostenveld,et al.  Visually induced gamma-band activity predicts speed of change detection in humans , 2010, NeuroImage.

[61]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[62]  Xiao-Jing Wang Neurophysiological and computational principles of cortical rhythms in cognition. , 2010, Physiological reviews.

[63]  W. Singer,et al.  Neuroelectromagnetic Correlates of Perceptual Closure Processes , 2010, The Journal of Neuroscience.

[64]  Stephen Grossberg,et al.  Adaptive Resonance Theory , 2010, Encyclopedia of Machine Learning.

[65]  Pascal Mamassian,et al.  Prior knowledge of illumination for 3D perception in the human brain , 2010, Proceedings of the National Academy of Sciences.

[66]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[67]  E. Maris,et al.  Prior Expectation Mediates Neural Adaptation to Repeated Sounds in the Auditory Cortex: An MEG Study , 2011, The Journal of Neuroscience.

[68]  G. Rees,et al.  The structural basis of inter-individual differences in human behaviour and cognition , 2011, Nature Reviews Neuroscience.

[69]  Luc H. Arnal,et al.  Transitions in neural oscillations reflect prediction errors generated in audiovisual speech , 2011, Nature Neuroscience.

[70]  R. Desimone,et al.  Laminar differences in gamma and alpha coherence in the ventral stream , 2011, Proceedings of the National Academy of Sciences.

[71]  Jim W Kay,et al.  Coherent Infomax as a Computational Goal for Neural Systems , 2011, Bulletin of mathematical biology.

[72]  Luc H. Arnal,et al.  Cortical oscillations and sensory predictions , 2012, Trends in Cognitive Sciences.

[73]  Doris Y. Tsao,et al.  What Makes a Cell Face Selective? The Importance of Contrast , 2012, Neuron.

[74]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[75]  Stephen Grossberg,et al.  Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world , 2013, Neural Networks.

[76]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[77]  Joachim Gross,et al.  Good practice for conducting and reporting MEG research , 2013, NeuroImage.

[78]  J. Hohwy The Predictive Mind , 2013 .

[79]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[80]  Karl J. Friston,et al.  The Computational Anatomy of Psychosis , 2013, Front. Psychiatry.

[81]  Karl J. Friston,et al.  Attentional Modulation of Alpha/Beta and Gamma Oscillations Reflect Functionally Distinct Processes , 2014, The Journal of Neuroscience.