Dissociable Cortical Pathways for Qualitative and Quantitative Mechanisms in the Face Inversion Effect

Humans' ability to recognize objects is remarkably robust across a variety of views unless faces are presented upside-down. Whether this face inversion effect (FIE) results from qualitative (distinct mechanisms) or quantitative processing differences (a matter of degree within common mechanisms) between upright and inverted faces has been intensely debated. Studies have focused on preferential responses to faces in face-specific brain areas, although face recognition also involves nonpreferential responses in non–face-specific brain areas. By using dynamic causal modeling with Bayesian model selection, here we show that dissociable cortical pathways are responsible for qualitative and quantitative mechanisms in the FIE in the distributed network for face recognition. When faces were upright, the early visual cortex (VC) and occipital and fusiform face areas (OFA, FFA) suppressed couplings to the lateral occipital cortex (LO), a primary locus of object processing. In contrast, they did not inhibit the LO when faces were inverted but increased couplings to the intraparietal sulcus, which has been associated with visual working memory. Furthermore, we found that upright and inverted face processing together involved the face network consisting of the VC, OFA, FFA, and inferior frontal gyrus. Specifically, modulatory connectivity within the common pathways (VC-OFA), implicated in the parts-based processing of faces, strongly correlated with behavioral FIE performance. The orientation-dependent dynamic reorganization of effective connectivity indicates that the FIE is mediated by both qualitative and quantitative differences in upright and inverted face processing, helping to resolve a central debate over the mechanisms of the FIE.

[1]  A. Treves,et al.  Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain , 2005, Nature Neuroscience.

[2]  I. Gauthier,et al.  How does the brain process upright and inverted faces? , 2002, Behavioral and cognitive neuroscience reviews.

[3]  S. Kastner,et al.  Two hierarchically organized neural systems for object information in human visual cortex , 2008, Nature Neuroscience.

[4]  Nouchine Hadjikhani,et al.  Abnormal activation of the social brain during face perception in autism , 2007, Human brain mapping.

[5]  Karl J. Friston,et al.  Comparing Families of Dynamic Causal Models , 2010, PLoS Comput. Biol..

[6]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[7]  N. Kanwisher,et al.  The Neural Basis of the Behavioral Face-Inversion Effect , 2005, Current Biology.

[8]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.

[9]  I. Gauthier,et al.  A visual short-term memory advantage for faces , 2007, Psychonomic bulletin & review.

[10]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[11]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[12]  P. Thompson,et al.  Margaret Thatcher: A New Illusion , 1980, Perception.

[13]  Roger A. Barker,et al.  Dynamic causal modelling of effective connectivity from fMRI: Are results reproducible and sensitive to Parkinson's disease and its treatment? , 2010, NeuroImage.

[14]  Robert T. Schultz,et al.  Bidirectional communication between amygdala and fusiform gyrus during facial recognition , 2011, NeuroImage.

[15]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[16]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[17]  E. Bullmore,et al.  Activation of auditory cortex during silent lipreading. , 1997, Science.

[18]  Seth A. Herd,et al.  A Unified Framework for Inhibitory Control Opinion , 2022 .

[19]  R. Kakigi,et al.  Differential Roles for Parietal and Occipital Cortices in Visual Working Memory , 2012, PloS one.

[20]  T. Andrews,et al.  Intra- and interhemispheric connectivity between face-selective regions in the human brain. , 2012, Journal of neurophysiology.

[21]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[22]  R. VanRullen,et al.  Attention and biased competition in multi-voxel object representations , 2009, Proceedings of the National Academy of Sciences.

[23]  K. Grill-Spector The neural basis of object perception , 2003, Current Opinion in Neurobiology.

[24]  Allison B Sekuler,et al.  Holistic Processing Is Not Correlated With Face-Identification Accuracy , 2010, Psychological science.

[25]  Bruno Rossion,et al.  Faces are represented holistically in the human occipito-temporal cortex , 2006, NeuroImage.

[26]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[27]  Sheng He,et al.  Anatomical correlates of the functional organization in the human occipitotemporal cortex. , 2006, Magnetic resonance imaging.

[28]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[29]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[30]  Karl J. Friston,et al.  A critique of functional localisers , 2006, NeuroImage.

[31]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[32]  Mark W. Greenlee,et al.  The Lateral Occipital Cortex in the Face Perception Network: An Effective Connectivity Study , 2012, Front. Psychology.

[33]  Kenneth F. Valyear,et al.  The fusiform face area is not sufficient for face recognition: Evidence from a patient with dense prosopagnosia and no occipital face area , 2006, Neuropsychologia.

[34]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[35]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[36]  P. Cavanagh,et al.  Flexible cognitive resources: competitive content maps for attention and memory , 2013, Trends in Cognitive Sciences.

[37]  B. Tjan,et al.  The Perception of a Face Is No More Than the Sum of Its Parts , 2012, Psychological science.

[38]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[39]  Mirella Dapretto,et al.  Frontal contributions to face processing differences in autism: Evidence from fMRI of inverted face processing , 2008, Journal of the International Neuropsychological Society.

[40]  Brian J. Wiltgen,et al.  Expert face processing requires visual input to the right hemisphere during infancy , 2022 .

[41]  Robert T. Knight,et al.  Top-down Enhancement and Suppression of the Magnitude and Speed of Neural Activity , 2005, Journal of Cognitive Neuroscience.

[42]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[43]  M. Erb,et al.  Brain regions sensitive to the face inversion effect: a functional magnetic resonance imaging study in humans , 2003, Neuroscience Letters.

[44]  Brian A. Wandell,et al.  Anatomy of the visual word form area: Adjacent cortical circuits and long-range white matter connections , 2013, Brain and Language.

[45]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[46]  Karl J. Friston,et al.  Behavioral/systems/cognitive Effective Connectivity during Processing of Facial Affect: Evidence for Multiple Parallel Pathways , 2022 .

[47]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[48]  Luca Passamonti,et al.  Changes in “Top-Down” Connectivity Underlie Repetition Suppression in the Ventral Visual Pathway , 2011, The Journal of Neuroscience.

[49]  S. Edelman,et al.  Cue-Invariant Activation in Object-Related Areas of the Human Occipital Lobe , 1998, Neuron.

[50]  D. Heeger,et al.  Two Retinotopic Visual Areas in Human Lateral Occipital Cortex , 2006, The Journal of Neuroscience.

[51]  Doris Y. Tsao,et al.  Mechanisms of face perception. , 2008, Annual review of neuroscience.

[52]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[53]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[54]  Bruno Rossion,et al.  Constraining the cortical face network by neuroimaging studies of acquired prosopagnosia , 2008, NeuroImage.

[55]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[56]  Marlene Behrmann,et al.  Visuotopic Cortical Connectivity Underlying Attention Revealed with White-Matter Tractography , 2012, The Journal of Neuroscience.

[57]  N. Kanwisher,et al.  Neuroimaging of cognitive functions in human parietal cortex , 2001, Current Opinion in Neurobiology.

[58]  K. Paller,et al.  Brain networks for analyzing eye gaze. , 2003, Brain research. Cognitive brain research.

[59]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[60]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[61]  Ralph Adolphs,et al.  The neuropsychology of face perception: beyond simple dissociations and functional selectivity , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Alumit Ishai,et al.  Let’s face it: It’s a cortical network , 2008, NeuroImage.

[63]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[64]  Henrik Olsson,et al.  Visual memory needs categories. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Aiden E. G. F. Arnold,et al.  Structural connectivity of visuotopic intraparietal sulcus , 2013, NeuroImage.

[66]  D. Pitcher,et al.  The role of the occipital face area in the cortical face perception network , 2011, Experimental Brain Research.

[67]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[68]  M. Riesenhuber,et al.  Evaluation of a Shape-Based Model of Human Face Discrimination Using fMRI and Behavioral Techniques , 2006, Neuron.

[69]  Russell A. Epstein,et al.  Cortical correlates of face and scene inversion: A comparison , 2006, Neuropsychologia.

[70]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[71]  K. Nakayama,et al.  The effect of face inversion on the human fusiform face area , 1998, Cognition.

[72]  M. D’Esposito,et al.  Stimulus inversion and the responses of face and object-sensitive cortical areas. , 1999, Neuroreport.

[73]  R. Malach,et al.  Negative BOLD Differentiates Visual Imagery and Perception , 2005, Neuron.

[74]  R. Yin Looking at Upside-down Faces , 1969 .

[75]  A. Dale,et al.  Selective averaging of rapidly presented individual trials using fMRI , 1997, Human brain mapping.

[76]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[77]  B. Wandell,et al.  The vertical occipital fasciculus: A century of controversy resolved by in vivo measurements , 2014, Proceedings of the National Academy of Sciences.

[78]  Zeynep M. Saygin,et al.  Anatomical connectivity patterns predict face-selectivity in the fusiform gyrus , 2011, Nature Neuroscience.

[79]  Mark S. Seidenberg,et al.  Neural Systems Underlying the Recognition of Familiar and Newly Learned Faces , 2000, The Journal of Neuroscience.

[80]  Karl J. Friston,et al.  Commentary on: Divide and conquer; a defence of functional localisers , 2006, NeuroImage.

[81]  Kaustubh Supekar,et al.  Dissociable connectivity within human angular gyrus and intraparietal sulcus: evidence from functional and structural connectivity. , 2010, Cerebral cortex.

[82]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .