Race Classification from Face using Deep Convolutional Neural Networks

As a basic and key attribute of human beings, race plays an indispensable role in face analysis. Traditional machine learning methods all tackle the problem of race classification in combination with two separate steps: extracting artificially designed features and training a proper classifier with these features. Some convolutional neural networks have also been proposed to deal with this problem, but get unsatisfactory accuracies. In this paper, we propose an improved deep convolutional neural network based on an existing network. The network uses a branch structure to merge networks of different depths, such that it can see multi-scale features (features in the low layers are more global and general than those in the high layers). To train this network, we collect a private race database using the available search engines on the Internet, which is larger and more balanced than publicly available databases. Experimental results show that the proposed network can not only extract features and classify them simultaneously compared with traditional methods, but also to achieve state-of-the-art accuracy of almost 99% on both public and self-made databases. Finally, it is necessary to highlight the importance of the advanced face detection and face alignment for the final result.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Muhammad Ghulam,et al.  Race Classification from Face Images using Local Descriptors , 2012, Int. J. Artif. Intell. Tools.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[5]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[6]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Shiguang Shan,et al.  Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment , 2014, ECCV.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[11]  Marios Savvides,et al.  A robust approach to facial ethnicity classification on large scale face databases , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[12]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Honglak Lee,et al.  Learning hierarchical representations for face verification with convolutional deep belief networks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Shiguang Shan,et al.  Funnel-Structured Cascade for Multi-View Face Detection with Alignment-Awareness , 2016, Neurocomputing.

[15]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Gang Hua,et al.  Labeled Faces in the Wild: A Survey , 2016 .

[17]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Damon L. Woodard,et al.  Soft biometric classification using periocular region features , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[19]  Thirimachos Bourlai,et al.  Gender and ethnicity classification using deep learning in heterogeneous face recognition , 2016, 2016 International Conference on Biometrics (ICB).

[20]  Harry Wechsler,et al.  Gender and ethnic classification of face images , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.