On Combining Face Local Appearance and Geometrical Features for Race Classification

In the field of demographic attribute classification, race estimation is perhaps the least studied topic in the literature. CNN-based approaches report the best results to the day, but they are computational expensive for practical applications. We propose a simpler approach by combining local appearance and geometrical features to describe face images, and to exploit the race information from different face parts by means of a component-based methodology. Experimental results obtained in the FERET subset from EGA database, with traditional but effective classifiers like Random Forest and Support Vector Machines, are very close to those achieved with a recent deep learning proposal.

[1]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[2]  Hanqing Lu,et al.  Recent advances in efficient computation of deep convolutional neural networks , 2018, Frontiers of Information Technology & Electronic Engineering.

[3]  Pierluigi Carcagnì,et al.  A study on different experimental configurations for age, race, and gender estimation problems , 2015, EURASIP J. Image Video Process..

[4]  Yangsheng Xu,et al.  A real time race classification system , 2005, 2005 IEEE International Conference on Information Acquisition.

[5]  Fadi Dornaika,et al.  Pyramid multi-level features for facial demographic estimation , 2017, Expert Syst. Appl..

[6]  G. Gill,et al.  Racial identification from the midfacial skeleton with special reference to American Indians and whites. , 1988, Journal of forensic sciences.

[7]  Julian Fierrez,et al.  Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation , 2018, IEEE Transactions on Information Forensics and Security.

[8]  S. Md. Mansoor Roomi,et al.  Race Classification Based on Facial Features , 2011, 2011 Third National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics.

[9]  Hui Cheng,et al.  Evaluation of low-level features and their combinations for complex event detection in open source videos , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Qijun Zhao,et al.  Facial Ethnicity Classification with Deep Convolutional Neural Networks , 2016, CCBR.

[11]  Massimo Tistarelli,et al.  Age and gender classification using local appearance descriptors from facial components , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[12]  Naeem Ul Islam,et al.  Learned Features are Better for Ethnicity Classification , 2017, ArXiv.

[13]  Yap-Peng Tan,et al.  Facial part displacement effect on template-based gender and ethnicity classification , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[14]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Genny Tortora,et al.  EGA — Ethnicity, gender and age, a pre-annotated face database , 2012, 2012 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS) Proceedings.

[16]  Haibo He,et al.  Learning Race from Face: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[18]  Jean-Luc Dugelay,et al.  Geometric invariants for 2D/3D face recognition , 2007, Pattern Recognit. Lett..

[19]  Naseer Al-Jawad,et al.  Fusing Local Binary Patterns with Wavelet Features for Ethnicity Identification , 2013 .