The structure of face--space is tolerant to lighting and viewpoint transformations.

According to the face-space framework, faces are represented as locations in a multidimensional space, where the distance separating representations is proportional to the degree of dissimilarity between faces. The present study tested whether similarities between faces, and thus the structure of face-space, were tolerant to ("invariant" under) identity-preserving transformations such as changes in lighting or view. To examine the correspondence between the configurations of face-space under different transformations, perceived similarity was rated for two variants of a set of faces, differing either in illumination (Experiment 1) or viewpoint (Experiment 2). We found that similarity ratings within the first variant were highly correlated with ratings within the second variant. In addition, based on these ratings, a separate face-space was constructed for each variant using multidimensional scaling. Procrustean analysis revealed that the different spaces shared comparable structures. This correspondence serves as a face-space manifestation of the tolerance of identity representations. Accordingly, we suggest that tolerance may rely on the fact that similarities between faces under one transformation are isomorphic to similarity patterns under a different transformation. Thus, recognizing faces under varying viewing conditions may only require similarity evaluations within--rather than across--different transformations.

[1]  Shimon Edelman,et al.  Representation and recognition in vision , 1999 .

[2]  Robert A. Johnston,et al.  Exploring the Structure of Multidimensional Face-space: The Effects of Age and Gender , 1997 .

[3]  J. Townsend,et al.  Computational, Geometric, and Process Perspectives on Facial Cognition : Contexts and Challenges , 2005 .

[4]  Michael B. Lewis,et al.  Face‐space‐R: Towards a unified account of face recognition , 2004 .

[5]  S Edelman,et al.  A model of visual recognition and categorization. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[7]  R. Shepard.  Metric structures in ordinal data , 1966 .

[8]  M. Hasselmo,et al.  Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[9]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[10]  T. Valentine,et al.  Towards an Exemplar Model of Face Processing: The Effects of Race and Distinctiveness , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[11]  N. Kanwisher,et al.  The Cognitive and Neural Development of Face Recognition in Humans , 2009 .

[12]  K. Nakayama,et al.  Prosopagnosia as an impairment to face-specific mechanisms: Elimination of the alternative hypotheses in a developmental case , 2006, Cognitive neuropsychology.

[13]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  M. Giese,et al.  Norm-based face encoding by single neurons in the monkey inferotemporal cortex , 2006, Nature.

[15]  James Tanaka,et al.  Mapping attractor fields in face space: the atypicality bias in face recognition , 1998, Cognition.

[16]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[17]  R N Shepard,et al.  Multidimensional Scaling, Tree-Fitting, and Clustering , 1980, Science.

[18]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[19]  Shimon Edelman,et al.  Similarity, Connectionism, and the Problem of Representation in Vision , 1997, Neural Computation.

[20]  Myron Wish,et al.  Three-Way Multidimensional Scaling , 1978 .

[21]  Robert A. Johnston,et al.  A Unified Account of the Effects of Caricaturing Faces , 1999 .

[22]  T. Busey.  Physical and Psychological Representations of Faces: Evidence From Morphing , 1998 .

[23]  T. Valentine,et al.  Recognizing Unfamiliar Faces: The Effects of Distinctiveness and View , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[24]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  Hilary Buxton,et al.  A similarity-based method for the generalization of face recognition over pose and expression , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[26]  Shimon Edelman,et al.  Viewpoint generalization in face recognition: The role of category-specific processes , 1999 .

[27]  I. Borg.  Multidimensional similarity structure analysis , 1987 .

[28]  G. Rhodes,et al.  Caricature Effects, Distinctiveness, and Identification: Testing the Face-Space Framework , 2000, Psychological science.

[29]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[30]  A. Chrysochoos,et al.  Categorical perception of facial gender information: Behavioural evidence and the face-space metaphor , 2001 .

[31]  R. Nosofsky.  Similarity Scaling and Cognitive Process Models , 1992 .

[32]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[33]  S Edelman,et al.  Representation is representation of similarities , 1996, Behavioral and Brain Sciences.

[34]  E. Rolls,et al.  Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[35]  D. Levin.  CLASSIFYING FACES BY RACE : THE STRUCTURE OF FACE CATEGORIES , 1996 .

[36]  Donald A. Jackson.  PROTEST: A PROcrustean Randomization TEST of community environment concordance , 1995 .

[37]  R. Shepard,et al.  Second-order isomorphism of internal representations: Shapes of states ☆ , 1970 .

[38]  Robert M. Nosofsky,et al.  Exemplar-based approach to relating categorization, identification, and recognition , 1992 .

[39]  Ferdinand de Saussure.  Course in General Linguistics , 1916 .

[40]  Shimon Edelman,et al.  Representation, similarity, and the chorus of prototypes , 1993, Minds and Machines.

[41]  S. Edelman,et al.  Representation of object similarity in human vision: psychophysics and a computational model , 1998, Vision Research.

[42]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[43]  E. Rolls.  Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[44]  V. Bruce,et al.  Face processing: Human perception and principal components analysis , 1996, Memory & cognition.

[45]  Bas C. van Fraassen,et al.  Representation Of, Representation As , 2008 .

[46]  G. Rhodes,et al.  Adaptive norm-based coding of facial identity , 2006, Vision Research.

[47]  R. Shepard.  Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space , 1957 .

[48]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  S. Ullman,et al.  Generalization to Novel Images in Upright and Inverted Faces , 1993, Perception.

[50]  T. Valentine.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[51]  T. Valentine,et al.  An Investigation of the Contact Hypothesis of the Own-race Bias in Face Recognition , 1995 .

[52]  Tim Valentine,et al.  Cognitive and Computational Aspects of Face Recognition : Explorations in Face Space , 1995 .

[53]  Hisao Nishijo,et al.  Neuronal correlates of face identification in the monkey anterior temporal cortical areas. , 2004, Journal of neurophysiology.

[54]  J. Gower.  Generalized procrustes analysis , 1975 .

[55]  N. Logothetis,et al.  Psychophysical and physiological evidence for viewer-centered object representations in the primate. , 1995, Cerebral cortex.

[56]  Gillian Rhodes,et al.  Identification of own-race and other-race faces: Implications for the representation of race in face space , 2004, Psychonomic bulletin & review.

[57]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[58]  Tim Valentine,et al.  Face–space models of face recognition. , 2001 .

[59]  Rachel A Robbins,et al.  No face-like processing for objects-of-expertise in three behavioural tasks , 2007, Cognition.

[60]  Tomaso Poggio,et al.  Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex , 2007, The Journal of Neuroscience.