Norm-based face encoding by single neurons in the monkey inferotemporal cortex

The rich and immediate perception of a familiar face, including its identity, expression and even intent, is one of the most impressive shared faculties of human and non-human primate brains. Many visually responsive neurons in the inferotemporal cortex of macaque monkeys respond selectively to faces, sometimes to only one or a few individuals, while showing little sensitivity to scale and other details of the retinal image. Here we show that face-responsive neurons in the macaque monkey anterior inferotemporal cortex are tuned to a fundamental dimension of face perception. Using a norm-based caricaturization framework previously developed for human psychophysics, we varied the identity information present in photo-realistic human faces, and found that neurons of the anterior inferotemporal cortex were most often tuned around the average, identity-ambiguous face. These observations are consistent with face-selective responses in this area being shaped by a figural comparison, reflecting structural differences between an incoming face and an internal reference or norm. As such, these findings link the tuning of neurons in the inferotemporal cortex to psychological models of face identity perception.

[1]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[2]  V. Bruce,et al.  The Effects of Distinctiveness in Recognising and Classifying Faces , 1986, Perception.

[3]  G. Rhodes,et al.  Identification and ratings of caricatures: Implications for mental representations of faces , 1987, Cognitive Psychology.

[4]  M. Hasselmo,et al.  The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey , 1989, Behavioural Brain Research.

[5]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[6]  Michael Kubovy,et al.  Caricature and face recognition , 1992, Memory & cognition.

[7]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[8]  C. Gross,et al.  How inferior temporal cortex became a visual area. , 1994, Cerebral cortex.

[9]  David L. Sheinberg,et al.  Visual object recognition. , 1996, Annual review of neuroscience.

[10]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[11]  Michael B. Lewis,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Section a Understanding Caricatures of Faces , 2022 .

[12]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[13]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[14]  G. Rhodes,et al.  Caricature Effects, Distinctiveness, and Identification: Testing the Face-Space Framework , 2000, Psychological science.

[15]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[16]  Decreased activity in inferotemporal cortex during explicit memory: dissociating priming, novelty detection, and recognition , 2002, Neuroreport.

[17]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[18]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[19]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[20]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[21]  E. Rolls,et al.  Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[22]  G. Rhodes,et al.  The dynamics of visual adaptation to faces , 2005, Proceedings of the Royal Society B: Biological Sciences.

[23]  G. Rhodes,et al.  Fitting the Mind to the World: Adaptation and after-effects in high-level vision , 2005 .

[24]  I. Biederman,et al.  Tuning for shape dimensions in macaque inferior temporal cortex , 2005, The European journal of neuroscience.

[25]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.