Facial gender recognition using multiple sources of visual information

In this article we present a novel multimodal gender recognition system, which successfully integrates the head and mouth motion information with facial appearance by taking advantage of a unified probabilistic framework. In fact, we develop a temporal subsystem that has an extended feature space consisting of parameters related to head and mouth motion; at the same time, we introduce a complementary spatial subsystem based on a probabilistic extension of the eigenface approach. In the end, we implement an integration step to combine the similarity scores of the two parallel subsystems, using a suitable opinion fusion (or score fusion) strategy. The experiments show that not only facial appearance but also head and mouth motion possess a potentially relevant discriminatory power, and that the integration of different sources of biometric information from video sequences is the key strategy to develop more accurate and reliable recognition systems.

[1]  Minoru Fukumi,et al.  Marketing data collection from face images using neural networks , 2005 .

[2]  Shaogang Gong,et al.  Learning gender from human gaits and faces , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[3]  Yunus Saatci,et al.  Cascaded classification of gender and facial expression using active appearance models , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[4]  Brunelli Poggio,et al.  HyberBF Networks for Gender Classification , 1992 .

[5]  Shumeet Baluja,et al.  Boosting Sex Identification Performance , 2005, International Journal of Computer Vision.

[6]  Sushil J. Louis,et al.  Genetic feature subset selection for gender classification: a comparison study , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[7]  Terrence J. Sejnowski,et al.  SEXNET: A Neural Network Identifies Sex From Human Faces , 1990, NIPS.

[8]  Harry Wechsler,et al.  Mixture of experts for classification of gender, ethnic origin, and pose of human faces , 2000, IEEE Trans. Neural Networks Learn. Syst..

[9]  Anil K. Jain,et al.  Multimodal Facial Gender and Ethnicity Identification , 2006, ICB.

[10]  Hyun-Chul Kim,et al.  Appearance-based gender classification with Gaussian processes , 2006, Pattern Recognit. Lett..

[11]  Garrison W. Cottrell,et al.  EMPATH: Face, Emotion, and Gender Recognition Using Holons , 1990, NIPS.

[12]  Ming-Hsuan Yang,et al.  Gender classification with support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[13]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Jean-Luc Dugelay,et al.  Person Recognition based on Head and Mouth Dynamics , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[15]  Shinichi Tamura,et al.  Male/female identification from 8×6 very low resolution face images by neural network , 1996, Pattern Recognit..

[16]  Norbert Krüger,et al.  Face Recognition and Gender determination , 1995 .

[17]  Ming Li,et al.  An Experimental Study on Automatic Face Gender Classification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).