Role of color in face recognition

massachusetts institute of technology — artificial intelligence laboratory @ MIT Abstract One of the key challenges in face perception lies in determining the contribution of different cues to face identification. In this study, we focus on the role of color cues. Although color appears to be a salient attribute of faces, past research has suggested that it confers little recognition advantage for identifying people. Here we report experimental results suggesting that color cues do play a role in face recognition and their contribution becomes evident when shape cues are degraded. Under such conditions, recognition performance with color images is significantly better than that with grayscale images. Our experimental results also indicate that the contribution of color may lie not so much in providing diagnostic cues to identity as in aiding low-level image-analysis processes such as segmentation.

[1]  J. Davidoff,et al.  Some effects of color on naming and recognition of objects. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[2]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[3]  G W Humphreys,et al.  The Effects of Surface Detail on Object Categorization and Naming , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[4]  Daniel P. Huttenlocher,et al.  Image segmentation using local variation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[5]  Shigeru Akamatsu,et al.  Automatic detection of human faces in natural scene images by use of a skin color model and of invariant moments , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[7]  G K Humphrey,et al.  The Role of Surface Information in Object Recognition: Studies of a Visual Form Agnosic and Normal Subjects , 1994, Perception.

[8]  R Kemp,et al.  Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues , 1996, Perception.

[9]  Weimin Huang,et al.  Face detection based on color and local symmetry information , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[11]  J. Tanaka,et al.  Color diagnosticity in object recognition , 1999, Perception & psychophysics.

[12]  D. Perrett,et al.  Presentation-Time Measures of the Effects of Manipulations in Colour Space on Discrimination of Famous Faces , 1997, Perception.

[13]  Tomaso A. Poggio,et al.  Learning-based approach to real time tracking and analysis of faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[14]  B. Wandell,et al.  Asymmetric color matching: how color appearance depends on the illuminant. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[15]  W. Eric L. Grimson,et al.  The Combinatorics Of Object Recognition In Cluttered Environments Using Constrained Search , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[16]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[17]  A. Young,et al.  In the Eye of the Beholder: The Science of Face Perception , 1998 .

[18]  G. Legge,et al.  Color improves object recognition in normal and low vision , 1993 .

[19]  E Switkes,et al.  Simultaneous masking interactions between chromatic and luminance gratings. , 1983, Journal of the Optical Society of America.