The Face Module Emerged in a Deep Convolutional Neural Network Selectively Deprived of Face Experience

Can we recognize faces with zero experience on faces? This question is critical because it examines the role of experiences in the formation of domain-specific modules in the brain. Investigation with humans and non-human animals on this issue cannot easily dissociate the effect of the visual experience from that of the hardwired domain-specificity. Therefore the present study built a model of selective deprivation of the experience on faces with a representative deep convolutional neural network, AlexNet, by removing all images containing faces from its training stimuli. This model did not show significant deficits in face categorization and discrimination, and face-selective modules automatically emerged. However, the deprivation reduced the domain-specificity of the face module. In sum, our study provides undisputable evidence on the role of nature versus nurture in developing the domain-specific modules that domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience.

[1]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[2]  Ramakant Nevatia,et al.  Face recognition using deep multi-pose representations , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Daniel D. Dilks,et al.  A critical review of the development of face recognition: Experience is less important than previously believed , 2012, Cognitive neuropsychology.

[4]  R. Yin Looking at Upside-down Faces , 1969 .

[5]  Nancy Kanwisher,et al.  Heritability of the Specific Cognitive Ability of Face Perception , 2010, Current Biology.

[6]  Marcel A. J. van Gerven,et al.  Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream , 2014, The Journal of Neuroscience.

[7]  Lisa R. Betts,et al.  Decoding of Faces and Face Components in Face-Sensitive Human Visual Cortex , 2010, Front. Psychology.

[8]  Mark H. Johnson,et al.  CONSPEC and CONLERN: a two-process theory of infant face recognition. , 1991, Psychological review.

[9]  L. Spillmann Receptive Fields of Visual Neurons: The Early Years , 2014, Perception.

[10]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Margaret S. Livingstone,et al.  Seeing faces is necessary for face-patch formation , 2017, Nature Neuroscience.

[12]  Ha Hong,et al.  Performance-optimized hierarchical models predict neural responses in higher visual cortex , 2014, Proceedings of the National Academy of Sciences.

[13]  Xu Wang,et al.  Quantifying interindividual variability and asymmetry of face-selective regions: A probabilistic functional atlas , 2015, NeuroImage.

[14]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[15]  Yizhen Zhang,et al.  Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision , 2016, Cerebral cortex.

[16]  K. Nakayama,et al.  Human face recognition ability is specific and highly heritable , 2010, Proceedings of the National Academy of Sciences.

[17]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[18]  Francesca Simion,et al.  Face perception and processing in early infancy: inborn predispositions and developmental changes , 2015, Front. Psychol..

[19]  Nikolaus Kriegeskorte,et al.  Deep neural networks: a new framework for modelling biological vision and brain information processing , 2015, bioRxiv.

[20]  K. Nakayama,et al.  The effect of face inversion on the human fusiform face area , 1998, Cognition.

[21]  Y. Sugita Face perception in monkeys reared with no exposure to faces , 2008, Proceedings of the National Academy of Sciences.

[22]  Kalle Åström,et al.  Transferring and Compressing Convolutional Neural Networks for Face Representations , 2016, ICIAR.

[23]  Shan Xu,et al.  Implementation-Independent Representation for Deep Convolutional Neural Networks and Humans in Processing Faces , 2020, bioRxiv.

[24]  P. Heggelund,et al.  Development of spatial receptive-field organization and orientation selectivity in kitten striate cortex. , 1985, Journal of neurophysiology.

[25]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[26]  Kalanit Grill-Spector,et al.  Extensive childhood experience with Pokémon suggests eccentricity drives organization of visual cortex , 2019, Nature Human Behaviour.

[27]  C. Umilta,et al.  Face preference at birth. , 1996, Journal of experimental psychology. Human perception and performance.

[28]  W. Freiwald,et al.  Face Processing Systems: From Neurons to Real-World Social Perception. , 2016, Annual review of neuroscience.

[29]  Jaeson Jang,et al.  Spontaneous generation of face recognition in untrained deep neural networks , 2019, bioRxiv.

[30]  I. W. R. Bushneil,et al.  Neonatal recognition of the mother's face , 1989 .

[31]  Leila Reddy,et al.  Reconstructing faces from fMRI patterns using deep generative neural networks , 2018, Communications Biology.

[32]  Sing-Hang Cheung,et al.  Processing of configural and componential information in face-selective cortical areas , 2014, Cognitive neuroscience.

[33]  R. Reid,et al.  Diverse receptive fields in the lateral geniculate nucleus during thalamocortical development , 2000, Nature Neuroscience.

[34]  F. Simion,et al.  The origins of face perception: specific versus non‐specific mechanisms , 2001 .

[35]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[37]  Jia Liu,et al.  Perception of Face Parts and Face Configurations: An fMRI Study , 2010, Journal of Cognitive Neuroscience.

[38]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[39]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[40]  John B. Troy,et al.  Non-Centered Spike-Triggered Covariance Analysis Reveals Neurotrophin-3 as a Developmental Regulator of Receptive Field Properties of ON-OFF Retinal Ganglion Cells , 2010, PLoS Comput. Biol..

[41]  Ming Zhou,et al.  DNNBrain: A Unifying Toolbox for Mapping Deep Neural Networks and Brains , 2020, bioRxiv.