A Computational Model of the Development of Separate Representations of Facial Identity and Expression in the Primate Visual System

Experimental studies have provided evidence that the visual processing areas of the primate brain represent facial identity and facial expression within different subpopulations of neurons. For example, in non-human primates there is evidence that cells within the inferior temporal gyrus (TE) respond primarily to facial identity, while cells within the superior temporal sulcus (STS) respond to facial expression. More recently, it has been found that the orbitofrontal cortex (OFC) of non-human primates contains some cells that respond exclusively to changes in facial identity, while other cells respond exclusively to facial expression. How might the primate visual system develop physically separate representations of facial identity and expression given that the visual system is always exposed to simultaneous combinations of facial identity and expression during learning? In this paper, a biologically plausible neural network model, VisNet, of the ventral visual pathway is trained on a set of carefully-designed cartoon faces with different identities and expressions. The VisNet model architecture is composed of a hierarchical series of four Self-Organising Maps (SOMs), with associative learning in the feedforward synaptic connections between successive layers. During learning, the network develops separate clusters of cells that respond exclusively to either facial identity or facial expression. We interpret the performance of the network in terms of the learning properties of SOMs, which are able to exploit the statistical indendependence between facial identity and expression.

[1]  A. Meltzoff,et al.  Imitation of Facial and Manual Gestures by Human Neonates , 1977, Science.

[2]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[3]  A. Meltzoff,et al.  Newborn infants imitate adult facial gestures. , 1983, Child development.

[4]  G. Blasdel,et al.  Intrinsic connections of macaque striate cortex: afferent and efferent connections of lamina 4C , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  A. Parker,et al.  Spatial properties of neurons in the monkey striate cortex , 1987, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  M. Hasselmo,et al.  The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey , 1989, Behavioural Brain Research.

[7]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  T. Bower,et al.  Recognition of familiar faces by newborns , 1992 .

[9]  G. Wallis,et al.  Learning invariant responses to the natural transformations of objects , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[10]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[11]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[12]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[13]  Risto Miikkulainen,et al.  Self-organization and segmentation in a laterally connected orientation map of spiking neurons , 1998, Neurocomputing.

[14]  Edmund T. Rolls,et al.  Position invariant recognition in the visual system with cluttered environments , 2000, Neural Networks.

[15]  Edmund T. Rolls,et al.  A Model of Invariant Object Recognition in the Visual System: Learning Rules, Activation Functions, Lateral Inhibition, and Information-Based Performance Measures , 2000, Neural Computation.

[16]  Andrew J. Calder,et al.  PII: S0042-6989(01)00002-5 , 2001 .

[17]  Wayne D. Gray.  Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society , 2001 .

[18]  Edmund T. Rolls,et al.  Invariant Object Recognition in the Visual System with Novel Views of 3D Objects , 2002, Neural Computation.

[19]  S. Royer,et al.  Conservation of total synaptic weight through balanced synaptic depression and potentiation , 2003, Nature.

[20]  L. C. Katz,et al.  Spatiotemporal patterns of excitation and inhibition evoked by the horizontal network in layer 2/3 of ferret visual cortex. , 2003, Journal of neurophysiology.

[21]  H. Sompolinsky,et al.  Mexican hats and pinwheels in visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. Hasselmo,et al.  Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[23]  Stefano Panzeri,et al.  Information in the Neuronal Representation of Individual Stimuli in the Primate Temporal Visual Cortex , 1997, Journal of Computational Neuroscience.

[24]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[25]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[26]  C. Malsburg.  Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[27]  Risto Miikkulainen,et al.  Cooperative self-organization of afferent and lateral connections in cortical maps , 1994, Biological Cybernetics.

[28]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[29]  Hugo D. Critchley,et al.  Face-selective and auditory neurons in the primate orbitofrontal cortex , 2006, Experimental Brain Research.

[30]  Edmund T. Rolls,et al.  Learning invariant object recognition in the visual system with continuous transformations , 2006, Biological Cybernetics.

[31]  Risto Miikkulainen,et al.  Joint maps for orientation, eye, and direction preference in a self-organizing model of V1 , 2006, Neurocomputing.

[32]  K M Gothard,et al.  Neural responses to facial expression and face identity in the monkey amygdala. , 2007, Journal of neurophysiology.

[33]  E T Rolls,et al.  Invariant object recognition with trace learning and multiple stimuli present during training , 2007, Network.

[34]  Edmund T. Rolls,et al.  Learning transform invariant object recognition in the visual system with multiple stimuli present during training , 2008, Neural Networks.

[35]  Giuseppe Iaria,et al.  The correlates of subjective perception of identity and expression in the face network: An fMRI adaptation study , 2009, NeuroImage.

[36]  I. Biederman,et al.  Loci of the release from fMRI adaptation for changes in facial expression, identity, and viewpoint. , 2010, Journal of vision.

[37]  Kathrin Cohen Kadosh,et al.  Task-dependent Activation of Face-sensitive Cortex: An fMRI Adaptation Study , 2010, Journal of Cognitive Neuroscience.

[38]  I. V. Higgins,et al.  The role of independent motion in object segmentation in the ventral visual stream: Learning to recognise the separate parts of the body , 2011, Vision Research.

[39]  Simon M Stringer,et al.  Learning separate visual representations of independently rotating objects , 2012, Network.

[40]  Garrison W. Cottrell,et al.  Do Expression and Identity Need Separate Representations? , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.