CNN Based Periocular Recognition Using Multispectral Images

Over the recent years, the periocular region has emerged as a potential unconstrained biometric trait for person authentication. For a biometric identification scenario to operate reliably round the clock, it should be capable of subject recognition in multiple spectra. However, there is limited research associated with the non-ideal multispectral imaging of the periocular trait. This is critical for real life applications such as surveillance and watch list identification. The existing techniques for multispectral periocular recognition rely on fusion at the feature level. However, these handcrafted features are not primarily data driven and there even exists possibilities for more novel features that could better describe the same. One possible solution to address such issues is to resort to the data driven deep learning strategies. Accordingly, we propose to apply the attributes extracted from pretrained CNN for subject authentication. To the best of our knowledge, this is the first study of multispectral periocular recognition employing deep learning. For our work, the IIITD Multispectral Periocular (IMP) database is used. The best classification accuracy reported for this dataset is 91.8%. This value is not precise enough for biometric identification tasks. The off-the-shelf CNN features employed in our work gives an improved accuracy of 97.14% for the multispectral periocular images.

[1]  Ivars Namatēvs,et al.  Deep Convolutional Neural Networks: Structure, Feature Extraction and Training , 2017 .

[2]  Sridha Sridharan,et al.  Super-resolution for biometrics: A comprehensive survey , 2018, Pattern Recognit..

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Arun Ross,et al.  Periocular Biometrics in the Visible Spectrum , 2011, IEEE Transactions on Information Forensics and Security.

[5]  Ajay Kumar,et al.  Accurate Periocular Recognition Under Less Constrained Environment Using Semantics-Assisted Convolutional Neural Network , 2017, IEEE Transactions on Information Forensics and Security.

[6]  Wageeh Boles,et al.  Multispectral Periocular Classification With Multimodal Compact Multi-Linear Pooling , 2017, IEEE Access.

[7]  Mohamed Abdel-Mottaleb,et al.  Fully automatic face normalization and single sample face recognition in unconstrained environments , 2016, Expert Syst. Appl..

[8]  Richa Singh,et al.  On cross spectral periocular recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Sridha Sridharan,et al.  Iris Recognition With Off-the-Shelf CNN Features: A Deep Learning Perspective , 2018, IEEE Access.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Sambit Bakshi,et al.  A novel phase-intensive local pattern for periocular recognition under visible spectrum , 2015 .

[12]  Anil K. Jain,et al.  Periocular biometrics in the visible spectrum: A feasibility study , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[13]  Himanshu S. Bhatt,et al.  Periocular biometrics: When iris recognition fails , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[14]  Mohamed Abdel-Mottaleb,et al.  Discriminant correlation analysis for feature level fusion with application to multimodal biometrics , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[16]  Zhenhua Guo,et al.  Multispectral Biometrics Systems , 2016 .

[17]  David Menotti,et al.  Deep periocular representation aiming video surveillance , 2017, Pattern Recognit. Lett..

[18]  Fernando Alonso-Fernandez,et al.  A survey on periocular biometrics research , 2016, Pattern Recognit. Lett..

[19]  Xiaojie Wang,et al.  Human detection and object tracking based on Histograms of Oriented Gradients , 2013, 2013 Ninth International Conference on Natural Computation (ICNC).

[20]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[21]  Fernando Alonso-Fernandez,et al.  Periocular Recognition Using CNN Features Off-the-Shelf , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[22]  Hugo Proença,et al.  Deep-PRWIS: Periocular Recognition Without the Iris and Sclera Using Deep Learning Frameworks , 2018, IEEE Transactions on Information Forensics and Security.

[23]  Juan E. Tapia,et al.  Gender classification from multispectral periocular images , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[24]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..