Seeing Jesus in toast: Neural and behavioral correlates of face pareidolia

Face pareidolia is the illusory perception of non-existent faces. The present study, for the first time, contrasted behavioral and neural responses of face pareidolia with those of letter pareidolia to explore face-specific behavioral and neural responses during illusory face processing. Participants were shown pure-noise images but were led to believe that 50% of them contained either faces or letters; they reported seeing faces or letters illusorily 34% and 38% of the time, respectively. The right fusiform face area (rFFA) showed a specific response when participants "saw" faces as opposed to letters in the pure-noise images. Behavioral responses during face pareidolia produced a classification image (CI) that resembled a face, whereas those during letter pareidolia produced a CI that was letter-like. Further, the extent to which such behavioral CIs resembled faces was directly related to the level of face-specific activations in the rFFA. This finding suggests that the rFFA plays a specific role not only in processing of real faces but also in illusory face perception, perhaps serving to facilitate the interaction between bottom-up information from the primary visual cortex and top-down signals from the prefrontal cortex (PFC). Whole brain analyses revealed a network specialized in face pareidolia, including both the frontal and occipitotemporal regions. Our findings suggest that human face processing has a strong top-down component whereby sensory input with even the slightest suggestion of a face can result in the interpretation of a face.

[1]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[2]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[3]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[4]  K. Grill-Spector,et al.  High-resolution imaging reveals highly selective nonface clusters in the fusiform face area , 2006, Nature Neuroscience.

[5]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[6]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[7]  Mark D'Esposito,et al.  Searching for “the Top” in Top-Down Control , 2005, Neuron.

[8]  P. Schyns,et al.  Superstitious Perceptions Reveal Properties of Internal Representations , 2003, Psychological science.

[9]  Jie Tian,et al.  Neural correlates of top-down letter processing , 2010, Neuropsychologia.

[10]  C. Degueldre,et al.  Here I am: The cortical correlates of visual self-recognition , 2007, Brain Research.

[11]  Michael Esterman,et al.  Perceptual expectation evokes category-selective cortical activity. , 2010, Cerebral cortex.

[12]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[13]  N. Hadjikhani,et al.  Early (M170) activation of face-specific cortex by face-like objects , 2009, Neuroreport.

[14]  J. Haxby,et al.  Neural response to the visual familiarity of faces , 2006, Brain Research Bulletin.

[15]  Tobias Egner,et al.  Cerebral Cortex doi:10.1093/cercor/bhi129 Mistaking a House for a Face: Neural Correlates of Misperception in Healthy Humans , 2005 .

[16]  J. Haxby,et al.  Neural systems for recognition of familiar faces , 2007, Neuropsychologia.

[17]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[18]  J. Stiles,et al.  Human Neuroscience , 2022 .

[19]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[20]  Philippe G Schyns,et al.  Accurate statistical tests for smooth classification images. , 2005, Journal of vision.

[21]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[22]  N. Kanwisher,et al.  Face perception: domain specific, not process specific. , 2004, Neuron.

[23]  Christopher J. Fox,et al.  A case of persistent visual hallucinations of faces following LSD abuse: A functional Magnetic Resonance Imaging study , 2010, Neurocase.

[24]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[25]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[26]  P. Schyns,et al.  Measuring Internal Representations from Behavioral and Brain Data , 2012, Current Biology.

[27]  Karl J. Friston,et al.  Where bottom-up meets top-down: neuronal interactions during perception and imagery. , 2004, Cerebral cortex.

[28]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[29]  M. Tarr,et al.  Internal representations for face detection: An application of noise‐based image classification to BOLD responses , 2013, Human brain mapping.

[30]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.

[31]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[32]  Philippe G. Schyns,et al.  Dynamics of Trimming the Content of Face Representations for Categorization in the Brain , 2009, PLoS Comput. Biol..

[33]  Frédéric Gosselin,et al.  Information processing algorithms in the brain , 2009, Trends in Cognitive Sciences.

[34]  Jie Tian,et al.  Faces in the mist: illusory face and letter detection , 2011, i-Perception.

[35]  Shigeru Sato,et al.  Face-specific and domain-general characteristics of cortical responses during self-recognition , 2008, NeuroImage.

[36]  Robert F. Hess,et al.  Extracting the internal representation of faces from human brain activity: An analogue to reverse correlation , 2010, NeuroImage.

[37]  Martin Lepage,et al.  A face to remember: emotional expression modulates prefrontal activity during memory formation , 2005, NeuroImage.

[38]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  C. Gilbert,et al.  Brain States: Top-Down Influences in Sensory Processing , 2007, Neuron.

[40]  Jimin Liang,et al.  A distributed neural system for top-down face processing , 2009, Neuroscience Letters.

[41]  Diane M. Beck,et al.  Top-down and bottom-up mechanisms in biasing competition in the human brain , 2009, Vision Research.

[42]  B. Rosen,et al.  Mechanisms of migraine aura revealed by functional MRI in human visual cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[43]  M. Tarr,et al.  FFA: a flexible fusiform area for subordinate-level visual processing automatized by expertise , 2000, Nature Neuroscience.

[44]  K. Amunts,et al.  Effective connectivity of the left BA 44, BA 45, and inferior temporal gyrus during lexical and phonological decisions identified with DCM , 2009, Human brain mapping.

[45]  Jie Tian,et al.  BRAIN IMAGING NEUROREPORT , 2007 .