The segmental structure of faces and its use in gender recognition.

What is the relationship between object segmentation and recognition? First, we develop a feature segmentation method that parses faces into features and, in doing so, attempts to approximate human performance. This segmentation-based approach allows us to build featural representations that make explicit the part-whole structure of faces and removes a priori assumptions from the equation of how objects come to be divided into features. Second, we examine the utility and the psychological plausibility of this representation by applying it to the task of facial gender recognition. Featural information from the segmentation process is shown to support relatively high accuracy levels with automatic gender categorization. The diagnosticity of featural information, in particular color information as encoded by the three perceptual color channels, is traced to the different patterns of feature contrast across Caucasian male and female faces. Results with human recognition suggest the visual system can exploit this information, however, there are open questions regarding the contribution of color information independent of luminance. More generally, our approach allows us to clarify and extend the notion of "configural" representations to multiple cues (i.e., not only shape) by considering relations between features independent of cue domain.

[1]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[2]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[3]  A. M. Burton,et al.  Sex Discrimination: How Do We Tell the Difference between Male and Female Faces? , 1993, Perception.

[4]  D. Perrett,et al.  What Gives a Face its Gender? , 1993, Perception.

[5]  A. M. Burton,et al.  What's the Difference between Men and Women? Evidence from Facial Measurement , 1993, Perception.

[6]  V Bruce,et al.  The Use of Pigmentation and Shading Information in Recognising the Sex and Identities of Faces , 1994, Perception.

[7]  Terrence J. Sejnowski,et al.  A Perceptron Reveals the Face of Sex , 1995, Neural Computation.

[8]  A J O'Toole,et al.  More about the Difference between Men and Women: Evidence from Linear Neural Networks and the Principal-Component Approach , 1995, Perception.

[9]  V Bruce,et al.  Perceiving the sex and race of faces: the role of shape and colour , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  I Biederman,et al.  Neurocomputational bases of object and face recognition. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[13]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[14]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[15]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Thomas Vetter,et al.  Three-dimensional shape and two-dimensional surface reflectance contributions to face recognition: an application of three-dimensional morphing , 1999, Vision Research.

[17]  N. Jablonski,et al.  The evolution of human skin coloration. , 2000, Journal of human evolution.

[18]  Ming-Hsuan Yang,et al.  Gender classification with support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  A. Freire,et al.  The Face-Inversion Effect as a Deficit in the Encoding of Configural Information: Direct Evidence , 2000, Perception.

[20]  Heather A. Wild,et al.  Recognition and sex categorization of adults' and children's faces: examining performance in the absence of sex-stereotyped cues. , 2000, Journal of experimental child psychology.

[21]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[22]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[24]  Pawan Sinha,et al.  Qualitative Representations for Recognition , 2002, Biologically Motivated Computer Vision.

[25]  M. Tarr,et al.  Unraveling mechanisms for expert object recognition: bridging brain activity and behavior. , 2002, Journal of experimental psychology. Human perception and performance.

[26]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[27]  Flávio P. Ferreira,et al.  Statistics of spatial cone-excitation ratios in natural scenes. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[29]  Jitendra Malik,et al.  Learning affinity functions for image segmentation: combining patch-based and gradient-based approaches , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  P. Sinha,et al.  The Role of Eyebrows in Face Recognition , 2003, Perception.

[31]  Richard Russell,et al.  Sex, Beauty, and the Relative Luminance of Facial Features , 2003, Perception.

[32]  D. Brainard 5 – Color Appearance and Color Difference Specification , 2003 .

[33]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Jitendra Malik,et al.  Contour and Texture Analysis for Image Segmentation , 2001, International Journal of Computer Vision.

[35]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[36]  Claus-Christian Carbon,et al.  Part-to-Whole Effects and Configural Processing in Faces , 2004 .

[37]  Michael J. Tarr,et al.  The role of surface pigmentation for recognition revealed by contrast reversal in faces and Greebles , 2005, Vision Research.

[38]  Richard Russell Face pigmentation and sex classification , 2005 .

[39]  Pawan Sinha,et al.  Receptive Field Structures for Recognition , 2006, Neural Computation.

[40]  Yunus Saatci,et al.  Cascaded classification of gender and facial expression using active appearance models , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[41]  Zakia Hammal,et al.  Parametric models for facial features segmentation , 2006, Signal Process..

[42]  M. Riesenhuber,et al.  Evaluation of a Shape-Based Model of Human Face Discrimination Using fMRI and Behavioral Techniques , 2006, Neuron.

[43]  Bruno Rossion,et al.  It's Pat! Sexing faces using only red and green , 2010 .