CNN-based gender classification in near-infrared periocular images

Periocular region has emerged as a key biometric trait with potential applications in the forensics domain. In this paper, we explore two convolutional neural network (CNN)-based approaches for gender classification using near-infrared images of the periocular region. In the first stage, our approaches automatically detect and extract left and right periocular regions. The first approach utilizes a domain-specific pre-trained CNN to extract deep features from the periocular images. A trained support vector machine (SVM) then utilizes these features to predict the gender information. The second approach employs an end-to-end classifier obtained by fine-tuning a pre-trained CNN on the periocular images. Performance evaluations have been carried out on three databases, which includes an in-house and two public databases. Local binary pattern and histogram of oriented gradient-based methods have been used as baseline methods to ascertain the effectiveness of the proposed approaches. Our results indicate that the proposed approaches achieve higher classification accuracy than the baseline methods, particularly on one of the public databases that contains a large number of non-ideal images. In addition, accuracy of the proposed approaches is consistently higher than the existing eyebrow feature-based method.

[1]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Marios Savvides,et al.  An exploration of gender identification using only the periocular region , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  Damon L. Woodard,et al.  Soft biometric classification using local appearance periocular region features , 2012, Pattern Recognit..

[4]  K.W. Bowyer,et al.  Learning to predict gender from iris images , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[5]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[6]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[7]  Sébastien Marcel,et al.  Audio-visual gender recognition in uncontrolled environment using variability modeling techniques , 2014, IEEE International Joint Conference on Biometrics.

[8]  Yujie Dong,et al.  Eyebrow shape-based features for biometric recognition and gender classification: A feasibility study , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[9]  Hazim Kemal Ekenel,et al.  How Transferable Are CNN-Based Features for Age and Gender Classification? , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[10]  Arun Ross,et al.  What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics , 2016, IEEE Transactions on Information Forensics and Security.

[11]  Jun Li,et al.  Boosting dense SIFT descriptors and shape contexts of face images for gender recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[12]  Qi Tian,et al.  Good Practice in CNN Feature Transfer , 2016, ArXiv.

[13]  Javier Lorenzo-Navarro,et al.  On using periocular biometric for gender classification in the wild , 2016, Pattern Recognit. Lett..

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Arun Ross,et al.  Evaluation of gender classification methods on thermal and near-infrared face images , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[20]  Richa Singh,et al.  On cross spectral periocular recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[21]  Deepu Rajan,et al.  Weakly Supervised Top-down Salient Object Detection , 2016, ArXiv.

[22]  Bruce A. Draper,et al.  Overview of the Multiple Biometrics Grand Challenge , 2009, ICB.

[23]  Arun Ross,et al.  Evaluation of Texture Descriptors for Automated Gender Estimation from Fingerprints , 2014, ECCV Workshops.

[24]  Wojciech Czarnecki,et al.  On Loss Functions for Deep Neural Networks in Classification , 2017, ArXiv.

[25]  Mircea Nicolescu,et al.  Gender classification from hand shape , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[26]  Daniel González-Jiménez,et al.  Single- and cross- database benchmarks for gender classification under unconstrained settings , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[27]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Anil K. Jain,et al.  Can soft biometric traits assist user recognition? , 2004, SPIE Defense + Commercial Sensing.

[29]  Anil K. Jain,et al.  Periocular biometrics in the visible spectrum: A feasibility study , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[30]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[31]  Fernando Alonso-Fernandez,et al.  A survey on periocular biometrics research , 2016, Pattern Recognit. Lett..

[32]  Arun Ross,et al.  Can Gender Be Predicted from Near-Infrared Face Images? , 2011, ICIAR.

[33]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.