A computational model of dysfunctional facial encoding in congenital prosopagnosia

Congenital prosopagnosia is a selective deficit in face identification that is present from birth. Previously, behavioral deficits in face recognition and differences in the neuroanatomical structure and functional activation of face processing areas have been documented mostly in separate studies. Here, we propose a neural network model of congenital prosopagnosia which relates behavioral and neuropsychological studies of prosopagnosia to theoretical models of information processing. In this study we trained a neural network with two different algorithms to represent face images. First, we introduced a predisposition towards a decreased network connectivity implemented as a temporal independent component analysis (ICA). This predisposition induced a featural representation of faces in terms of isolated face parts. Second, we trained the network for optimal information encoding using spatial ICA, which led to holistic representations of faces. The network model was then tested empirically in an experiment with ten prosopagnosic and twenty age-matched controls. Participants had to discriminate between faces that were changed either according to the prosopagnosic model of featural representation or to the control model of holistic representation. Compared to controls prosopagnosic participants were impaired only in discriminating holistic changes of faces but showed no impairment in detecting featural changes. In summary, the proposed model presents an empirically testable account of congenital prosopagnosia that links the critical features--a lack of holistic processing at the computational level and a sparse structural connectivity at the implementation level. More generally, our results point to structural differences in the network connectivity as the cause of the face processing deficit in congenital prosopagnosia.

[1]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[3]  A. Hyvärinen,et al.  A multi-layer sparse coding network learns contour coding from natural images , 2002, Vision Research.

[4]  Marian Stewart Bartlett,et al.  Information maximization in face processing , 2007, Neurocomputing.

[5]  A. Damasio,et al.  Face agnosia and the neural substrates of memory. , 1990, Annual review of neuroscience.

[6]  C. Gallagher Extending the Linear Model With R: Generalized Linear, Mixed Effects and Nonparametric Regression Models , 2007 .

[7]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[8]  T. Schormann,et al.  Functional delineation of the human occipito-temporal areas related to face and scene processing. A PET study. , 2000, Brain : a journal of neurology.

[9]  Jarrod D. Hadfield,et al.  MCMC methods for multi-response generalized linear mixed models , 2010 .

[10]  Randall C. O'Reilly,et al.  Dissociated overt and covert recognition as an emergent property of a lesioned neural network. , 1993, Psychological review.

[11]  Ryan T Maloney,et al.  Things are Looking up: Differential Decline in Face Recognition following Pitch and Yaw Rotation , 2007, Perception.

[12]  J. Keenan,et al.  Perception of global facial geometry in the inversion effect and prosopagnosia , 2003, Neuropsychologia.

[13]  Galia Avidan,et al.  A detailed investigation of facial expression processing in congenital prosopagnosia as compared to acquired prosopagnosia , 2006, Experimental Brain Research.

[14]  Gilles Pourtois,et al.  Portraits or People? Distinct Representations of Face Identity in the Human Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[15]  Ingo Kennerknecht,et al.  First report of prevalence of non‐syndromic hereditary prosopagnosia (HPA) , 2006, American journal of medical genetics. Part A.

[16]  G. Schwarzer,et al.  Gaze behaviour in hereditary prosopagnosia , 2007, Psychological research.

[17]  I. Kennerknecht,et al.  Congenital prosopagnosia--a common hereditary cognitive dysfunction in humans. , 2008, Frontiers in bioscience : a journal and virtual library.

[18]  L. Rapport,et al.  Validation of the Warrington theory of visual processing and the Visual Object and Space Perception Battery. , 1998, Journal of clinical and experimental neuropsychology.

[19]  Rafael Malach,et al.  Detailed Exploration of Face-related Processing in Congenital Prosopagnosia: 2. Functional Neuroimaging Findings , 2005, Journal of Cognitive Neuroscience.

[20]  James V. Stone,et al.  Spatiotemporal Independent Component Analysis of Event-Related fMRI Data Using Skewed Probability Density Functions , 2002, NeuroImage.

[21]  D. Benson,et al.  Loss of topographic familiarity. An environmental agnosia. , 1986, Archives of neurology.

[22]  Beatriz Luna,et al.  Visual category-selectivity for faces, places and objects emerges along different developmental trajectories. , 2007, Developmental science.

[23]  Mark H. Johnson,et al.  Developing a brain specialized for face perception: a converging methods approach. , 2002, Developmental psychobiology.

[24]  Nikolaus Weiskopf,et al.  Voxel-based morphometry reveals reduced grey matter volume in the temporal cortex of developmental prosopagnosics , 2009, Brain : a journal of neurology.

[25]  Catherine J. Mondloch,et al.  What aspects of face processing are impaired in developmental prosopagnosia? , 2006, Brain and Cognition.

[26]  J. Keenan,et al.  Lesions of the fusiform face area impair perception of facial configuration in prosopagnosia , 2002, Neurology.

[27]  Michael G. Strintzis,et al.  Face Recognition , 2008, Encyclopedia of Multimedia.

[28]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[29]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[30]  M Coltheart,et al.  MODELS OF FACE RECOGNITION AND DELUSIONAL MISIDENTIFICATION: A CRITICAL REVIEW , 2000, Cognitive neuropsychology.

[31]  H. McConachie,et al.  Developmental Prosopagnosia. A Single Case Report , 1976, Cortex.

[32]  Peter J. B. Hancock,et al.  From Pixels to People: A Model of Familiar Face Recognition , 1999, Cogn. Sci..

[33]  M J Farah,et al.  Dissociated overt and covert recognition as an emergent property of a lesioned neural network. , 1993, Psychological review.

[34]  J Kreiman,et al.  Voice perception deficits: neuroanatomical correlates of phonagnosia. , 1989, Journal of clinical and experimental neuropsychology.

[35]  Tobias Elze,et al.  Deficits in Long-Term Recognition Memory Reveal Dissociated Subtypes in Congenital Prosopagnosia , 2011, PloS one.

[36]  K. Nakayama,et al.  Prosopagnosia as an impairment to face-specific mechanisms: Elimination of the alternative hypotheses in a developmental case , 2006, Cognitive neuropsychology.

[37]  M. Coltheart,et al.  Cognitive heterogeneity in genetically based prosopagnosia: a family study. , 2008, Journal of neuropsychology.

[38]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[39]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[40]  M. A Virasoro Categorization in neural networks and prosopagnosia , 1989 .

[41]  E. Renzi,et al.  Apperceptive and Associative Forms of Prosopagnosia , 1991, Cortex.

[42]  Bruce A. Draper,et al.  Recognizing faces with PCA and ICA , 2003, Comput. Vis. Image Underst..

[43]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[44]  Irene Daum,et al.  Developmental Prosopagnosia: A Review , 2003, Behavioural neurology.

[45]  M. A. Virasoro,et al.  The Effect of Synapses Destruction on Categorization by Neural Networks , 1988 .

[46]  Joachim Bodamer,et al.  Die Prosop-Agnosie , 2004, Archiv für Psychiatrie und Nervenkrankheiten.

[47]  J. Jost,et al.  F ¨ Ur Mathematik in Den Naturwissenschaften Leipzig the Early Time Course of Compensatory Face Processing in Congenital Prosopagnosia the Early Time Course of Compensatory Face Processing in Congenital Prosopagnosia , 2022 .

[48]  E. Pessa,et al.  Simulating prosopagnosia through a lesion of lateral connections in a feed-forward neural network , 1999, The Italian Journal of Neurological Sciences.

[49]  Denise C. Park,et al.  Nature versus Nurture in Ventral Visual Cortex: A Functional Magnetic Resonance Imaging Study of Twins , 2007, The Journal of Neuroscience.

[50]  I. Gauthier,et al.  Computational approaches to the development of perceptual expertise , 2004, Trends in Cognitive Sciences.

[51]  E. D. de Haan,et al.  A familial factor in the development of face recognition deficits. , 1999, Journal of clinical and experimental neuropsychology.

[52]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[53]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[54]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[55]  Isabel Gauthier,et al.  Are Greebles like faces? Using the neuropsychological exception to test the rule , 2004, Neuropsychologia.

[56]  Mariya V. Cherkasova,et al.  Impaired spatial coding within objects but not between objects in prosopagnosia , 2005, Neurology.

[57]  Max Coltheart,et al.  Training of familiar face recognition and visual scan paths for faces in a child with congenital prosopagnosia , 2008, Cognitive neuropsychology.

[58]  H. Ellis,et al.  Bodamer's (1947) paper on prosopagnosia , 1990 .

[59]  I. Kennerknecht,et al.  Hereditary prosopagnosia (HPA): the first report outside the Caucasian population , 2006, Journal of Human Genetics.

[60]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[61]  P. Földiák,et al.  Forming sparse representations by local anti-Hebbian learning , 1990, Biological Cybernetics.

[62]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[63]  E. Rolls High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[64]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[65]  Karl Sperling,et al.  Hereditary Prosopagnosia: the First Case Series , 2007, Cortex.

[66]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[67]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[69]  Néstor Parga,et al.  Transform-Invariant Recognition by Association in a Recurrent Network , 1998, Neural Computation.

[70]  Galia Avidan,et al.  Structural imaging reveals anatomical alterations in inferotemporal cortex in congenital prosopagnosia. , 2007, Cerebral cortex.

[71]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[72]  H. Collewijn,et al.  The significance of microsaccades for vision and oculomotor control. , 2008, Journal of vision.

[73]  Mary A. Peterson,et al.  Reduction in white matter connectivity, revealed by diffusion tensor imaging, may account for age-related changes in face perception , 2008 .

[74]  M. Behrmann,et al.  Congenital prosopagnosia: face-blind from birth , 2005, Trends in Cognitive Sciences.

[75]  Matthew H Tong,et al.  Why is the fusiform face area recruited for novel categories of expertise? A neurocomputational investigation , 2008, Brain Research.

[76]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[77]  B. Dobkin,et al.  Phonagnosia: A Dissociation Between Familiar and Unfamiliar Voices , 1988, Cortex.

[78]  K. Nakayama,et al.  Developmental Prosopagnosia: a Window to Content-specific Face Processing This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Developmental Prosopagnosia and Inferences to Functional Organization Investigating the Architecture of Face Processing through Developmental Prosopagnosia , 2022 .

[79]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[80]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[81]  Tobias Elze FlashDot — A platform independent experiment generator for visual psychophysics , 2009 .

[82]  A. Mazzucchi,et al.  Is Prosopagnosia More Frequent in Males Than in Females? , 1983, Cortex.

[83]  Glyn W. Humphreys,et al.  BORB: Birmingham Object Recognition Battery , 2017 .

[84]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[85]  Shimon Ullman,et al.  Object Classification Using a Fragment-Based Representation , 2000, Biologically Motivated Computer Vision.

[86]  E. Renzi,et al.  Prosopagnosia can be associated with damage confined to the right hemisphere—An MRI and PET study and a review of the literature , 1994, Neuropsychologia.

[87]  Guy Wallis,et al.  The prototype effect revisited: Evidence for an abstract feature model of face recognition. , 2008, Journal of vision.

[88]  Shahriar Gharibzadeh,et al.  Could dynamic attractors explain associative prosopagnosia? , 2007, Medical hypotheses.

[89]  Galia Avidan,et al.  Functional MRI Reveals Compromised Neural Integrity of the Face Processing Network in Congenital Prosopagnosia , 2009, Current Biology.

[90]  Galia Avidan,et al.  Detailed Exploration of Face-related Processing in Congenital Prosopagnosia: 1. Behavioral Findings , 2005, Journal of Cognitive Neuroscience.

[91]  Michael B. Lewis,et al.  Capgras delusion: a window on face recognition , 2001, Trends in Cognitive Sciences.

[92]  Brad Duchaine,et al.  Dissociations of Face and Object Recognition in Developmental Prosopagnosia , 2005, Journal of Cognitive Neuroscience.

[93]  T J Sejnowski,et al.  Learning viewpoint-invariant face representations from visual experience in an attractor network. , 1998, Network.

[94]  B. Duchaine Comment on prevalence of hereditary prosopagnosia (HPA) in Hong Kong Chinese population , 2008, American journal of medical genetics. Part A.

[95]  Isabel Gauthier,et al.  Individual differences in FFA activity suggest independent processing at different spatial scales , 2005, Cognitive, affective & behavioral neuroscience.

[96]  Are Greebles like faces , 2004 .

[97]  S. Ullman Object recognition and segmentation by a fragment-based hierarchy , 2007, Trends in Cognitive Sciences.

[98]  Rafael Malach,et al.  Face-selective Activation in a Congenital Prosopagnosic Subject , 2003, Journal of Cognitive Neuroscience.

[99]  H. Ellis Recognizing faces. , 1975, British journal of psychology.

[100]  C. Elger,et al.  Congenital prosopagnosia: multistage anatomical and functional deficits in face processing circuitry , 2010, Journal of Neurology.

[101]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[102]  Giuseppe Iaria,et al.  Disconnection in prosopagnosia and face processing , 2008, Cortex.

[103]  George Karabatsos,et al.  Bayesian nonparametric model selection and model testing , 2006 .

[104]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[105]  L. Whitaker Anthropometry of the Head and Face in Medicine. , 1983 .

[106]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[107]  G. Verbeke,et al.  Statistical inference in generalized linear mixed models: a review. , 2006, The British journal of mathematical and statistical psychology.

[108]  Jason D. Warren,et al.  Developmental phonagnosia: A selective deficit of vocal identity recognition , 2009, Neuropsychologia.

[109]  M. D’Esposito,et al.  Topographical disorientation: a synthesis and taxonomy. , 1999, Brain : a journal of neurology.

[110]  K. Nakayama,et al.  Face detection in normal and prosopagnosic individuals. , 2008, Journal of neuropsychology.

[111]  Isabel Gauthier,et al.  Perceptual Expertise Effects Are Not All or None: Spatially Limited Perceptual Expertise for Faces in a Case of Prosopagnosia , 2006, Journal of Cognitive Neuroscience.

[112]  Mitsuru Kawamura,et al.  Pure Topographical Disorientation —The Anatomical Basis of Landmark Agnosia , 2002, Cortex.

[113]  Representing facial information using Gabor wavelets , 2010 .

[114]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[115]  Galia Avidan,et al.  Reduced structural connectivity in ventral visual cortex in congenital prosopagnosia , 2009, Nature Neuroscience.

[116]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.