Real-world gender classification via local Gabor binary pattern and three-dimensional face reconstruction by generic elastic model

In this study, a novel method is proposed for gender classification by adding facial depth features to texture features. Accordingly, the three-dimensional (3D) generic elastic model is used to reconstruct the 3D model from human face using only a single 2D frontal image. Then, the texture and depth are extracted from the reconstructed face model. Afterwards, the local Gabor binary pattern (LGBP) is applied to both facial texture and reconstructed depth to extract the feature vectors from both texture and reconstructed depth images. Finally, by combining 2D and 3D feature vectors, the final LGBP histogram bins are generated and classified by the support vector machine. Favourable outcomes are acquired for gender classification on the labelled faces in the wild and FERET databases based on the proposed method compared to several state-of-the-arts in gender classification.

[1]  Claudio A. Perez,et al.  Gender Classification Based on Fusion of Different Spatial Scale Features Selected by Mutual Information From Histogram of LBP, Intensity, and Shape , 2013, IEEE Transactions on Information Forensics and Security.

[2]  Marios Savvides,et al.  3-D Generic Elastic Models for Fast and Texture Preserving 2-D Novel Pose Synthesis , 2012, IEEE Transactions on Information Forensics and Security.

[3]  Paul A. Viola,et al.  A unified learning framework for real time face detection and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[4]  Alberto Del Bimbo,et al.  3D facial expression recognition using SIFT descriptors of automatically detected keypoints , 2011, The Visual Computer.

[5]  Roope Raisamo,et al.  An experimental comparison of gender classification methods , 2008, Pattern Recognit. Lett..

[6]  Muhammad Ghulam,et al.  Gender Recognition Using Fusion of Local and Global Facial Features , 2013, ISVC.

[7]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[8]  Brunelli Poggio,et al.  HyberBF Networks for Gender Classification , 1992 .

[9]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[10]  Surendra Ranganath,et al.  Pose-invariant face recognition using a 3D deformable model , 2003, Pattern Recognit..

[11]  Shumeet Baluja,et al.  Boosting Sex Identification Performance , 2005, International Journal of Computer Vision.

[12]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[13]  Dimitris E. Koulouriotis,et al.  Moment-based local binary patterns: A novel descriptor for invariant pattern recognition applications , 2013, Neurocomputing.

[14]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Subrahmanyam Murala,et al.  Local ternary co-occurrence patterns: A new feature descriptor for MRI and CT image retrieval , 2013, Neurocomputing.

[17]  Marios Savvides,et al.  Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Karim Faez,et al.  Real-Time Pose-Invariant Face Recognition by Triplet Pose Sparse Matrix from Only a Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[19]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  Chiraz BenAbdelkader,et al.  A Local Region-based Approach to Gender Classi.cation From Face Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[22]  Yiying Tong,et al.  Age-Invariant Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[24]  Edwin R. Hancock,et al.  Gender Classification using Shape from Shading , 2007, BMVC.

[25]  Matti Pietikäinen,et al.  Combining appearance and motion for face and gender recognition from videos , 2009, Pattern Recognit..

[26]  Ioannis A. Kakadiaris,et al.  Ethnicity- and Gender-based Subject Retrieval Using 3-D Face-Recognition Techniques , 2009, International Journal of Computer Vision.

[27]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  M. Saquib Sarfraz,et al.  Probabilistic learning for fully automatic face recognition across pose , 2010, Image Vis. Comput..

[30]  Marios Savvides,et al.  Gender and Ethnicity Specific Generic Elastic Models from a Single 2D Image for Novel 2D Pose Face Synthesis and Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Pengfei Shi,et al.  A novel fusion-based method for expression-invariant gender classification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Tal Hassner,et al.  Similarity Scores Based on Background Samples , 2009, ACCV.

[33]  Wen Gao,et al.  Efficient 3D reconstruction for face recognition , 2005, Pattern Recognit..

[34]  Ming-Hsuan Yang,et al.  Learning Gender with Support Faces , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Jean-Luc Dugelay,et al.  An Efficient LBP-Based Descriptor for Facial Depth Images Applied to Gender Recognition Using RGB-D Face Data , 2012, ACCV Workshops.

[36]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[37]  Xing Zhang,et al.  Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis , 2012, Image Vis. Comput..

[38]  Jordi Vitrià,et al.  Gender Recognition in Non Controlled Environments , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[40]  Jingu Heo,et al.  3D generic elastic models for 2D pose synthesis and face recognition , 2010 .

[41]  Roope Raisamo,et al.  Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Bing Li,et al.  Gender classification by combining clothing, hair and facial component classifiers , 2012, Neurocomputing.

[43]  Driss Aboutajdine,et al.  Boosting 3-D-Geometric Features for Efficient Face Recognition and Gender Classification , 2012, IEEE Transactions on Information Forensics and Security.

[44]  YiDing Wang,et al.  Improving generalization for gender classification , 2008, 2008 15th IEEE International Conference on Image Processing.

[45]  Anil K. Jain,et al.  Multimodal Facial Gender and Ethnicity Identification , 2006, ICB.

[46]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .