Subjective Experiments on Gender and Ethnicity Recognition from Different Face Representations

The design of image-based soft-biometrics systems highly depends on the human factor analysis. How well can human do in gender/ethnicity recognition by looking at faces in different representations? How does human recognize gender/ethnicity? What factors affect the accuracy of gender/ethnicity recognition? The answers of these questions may inspire our design of computer-based automatic gender/ethnicity recognition algorithms. In this work, several subjective experiments are conducted to test the capability of human in gender/ethnicity recognition on different face representations, including 1D face silhouette, 2D face images and 3D face models. Our experimental results provide baselines and interesting inspirations for designing computer-based face gender/ethnicity recognition algorithms.

[1]  J H van Hateren,et al.  Simulating human cones from mid-mesopic up to high-photopic luminances. , 2007, Journal of vision.

[2]  Shinichi Tamura,et al.  Male/female identification from 8×6 very low resolution face images by neural network , 1996, Pattern Recognit..

[3]  Garrison W. Cottrell,et al.  EMPATH: Face, Emotion, and Gender Recognition Using Holons , 1990, NIPS.

[4]  V Bruce,et al.  Perceiving the sex and race of faces: the role of shape and colour , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[5]  Nicolas Davidenko.  Silhouetted face profiles: a new methodology for face perception research. , 2007, Journal of vision.

[6]  Lijun Yin,et al.  Towards race-related face identification: research on skin color transfer , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[7]  Terrence J. Sejnowski,et al.  SEXNET: A Neural Network Identifies Sex From Human Faces , 1990, NIPS.

[8]  Shiaofen Fang,et al.  Gender identification using frontal facial images , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[9]  Xun Xu,et al.  Building Large Scale 3D Face Database for Face Analysis , 2007, MCAM.

[10]  Harry Wechsler,et al.  Gender and ethnic classification of human faces using hybrid classifiers , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[11]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[12]  Nicu Sebe,et al.  Multimedia Content Analysis and Mining, International Workshop, MCAM 2007, Weihai, China, June 30 - July 1, 2007, Proceedings , 2007, MCAM.

[13]  A. M. Burton,et al.  Sex Discrimination: How Do We Tell the Difference between Male and Female Faces? , 1993, Perception.

[14]  Alice J. O'Toole,et al.  Low-dimensional representation of faces in higher dimensions of the face space , 1993 .

[15]  A J O'Toole,et al.  More about the Difference between Men and Women: Evidence from Linear Neural Networks and the Principal-Component Approach , 1995, Perception.

[16]  Harry Wechsler,et al.  Gender and ethnic classification of face images , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.