Person identification using fusion of iris and periocular deep features

A novel method for person identification based on the fusion of iris and periocular biometrics has been proposed in this paper. The challenges for image acquisition for Near-Infrared or Visual Wavelength lights under constrained and unconstrained environments have been considered here. The proposed system is divided into image preprocessing data augmentation followed by feature learning for classification components. In image preprocessing an annular iris, the portion is segmented out from an eyeball image and then transformed into a fixed-sized image region. The parameters of iris localization have been used to extract the local periocular region. Due to different imaging environments, the images suffer from various noise artifacts which create data insufficiency and complicate the recognition task. To overcome this situation, a novel method for data augmentation technique has been introduced here. For features extraction and classification tasks well-known, VGG16, ResNet50, and Inception-v3 CNN architectures have been employed. The performance due to iris and periocular are fused together to increase the performance of the recognition system. The extensive experimental results have been demonstrated in four benchmark iris databases namely: MMU1, UPOL, CASIA-Iris-distance, and UBIRIS.v2. The comparison with the state-of-the-art methods with respect to these databases shows the robustness and effectiveness of the proposed approach.

[1]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[2]  Paul F. Whelan,et al.  Using filter banks in Convolutional Neural Networks for texture classification , 2016, Pattern Recognit. Lett..

[3]  Kyoil Chung,et al.  A Novel and Efficient Feature Extraction Method for Iris Recognition , 2007 .

[4]  Somnath Dey,et al.  Iris Data Indexing Method Using Gabor Energy Features , 2012, IEEE Transactions on Information Forensics and Security.

[5]  K. Subr,et al.  Edge-preserving multiscale image decomposition based on local extrema , 2009, SIGGRAPH 2009.

[6]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[7]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Tieniu Tan,et al.  Iris Image Classification Based on Hierarchical Visual Codebook , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Tieniu Tan,et al.  Ethnic Classification Based on Iris Images , 2011, CCBR.

[10]  Ioannis Athanasiadis,et al.  A Framework of Transfer Learning in Object Detection for Embedded Systems , 2018, ArXiv.

[11]  Terrance E. Boult,et al.  AFFACT: Alignment-free facial attribute classification technique , 2016, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[12]  Arun Ross,et al.  On the Fusion of Periocular and Iris Biometrics in Non-ideal Imagery , 2010, 2010 20th International Conference on Pattern Recognition.

[13]  Andreas Uhl,et al.  Iris Recognition: From Segmentation to Template Security , 2012 .

[14]  Hugo Proença,et al.  A Reminiscence of “Mastermind”: Iris/Periocular Biometrics by “In-Set” CNN Iterative Analysis , 2019, IEEE Transactions on Information Forensics and Security.

[15]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[16]  Danny Z. Chen,et al.  Iris Recognition Based on Human-Interpretable Features , 2016, IEEE Trans. Inf. Forensics Secur..

[17]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[18]  Hugo Proenca Iris Recognition: What Is Beyond Bit Fragility? , 2015, IEEE Transactions on Information Forensics and Security.

[19]  Libor Masek,et al.  MATLAB Source Code for a Biometric Identification System Based on Iris Patterns , 2003 .

[20]  Rama Chellappa,et al.  Secure and Robust Iris Recognition Using Random Projections and Sparse Representations , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Raghunath S. Holambe,et al.  Half-Iris Feature Extraction and Recognition Using a New Class of Biorthogonal Triplet Half-Band Filter Bank and Flexible k-out-of-n:A Postclassifier , 2012, IEEE Transactions on Information Forensics and Security.

[22]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[23]  Rodrigo Salas,et al.  Zernike's Feature Descriptors for Iris Recognition with SVM , 2011, 2011 30th International Conference of the Chilean Computer Science Society.

[24]  Ajay Kumar,et al.  Iris recognition using quaternionic sparse orientation code (QSOC) , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Hugo Proença,et al.  Iris Recognition: On the Segmentation of Degraded Images Acquired in the Visible Wavelength , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Tieniu Tan,et al.  Deep Feature Fusion for Iris and Periocular Biometrics on Mobile Devices , 2018, IEEE Transactions on Information Forensics and Security.

[28]  Bhabatosh Chanda,et al.  A novel cancelable iris recognition system based on feature learning techniques , 2017, Inf. Sci..

[29]  Dexin Zhang,et al.  DCT-Based Iris Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Arun Ross,et al.  Periocular Biometrics in the Visible Spectrum , 2011, IEEE Transactions on Information Forensics and Security.

[31]  Andreas Uhl,et al.  Context-based biometric key generation for Iris , 2011 .

[32]  Hiroshi Nakajima,et al.  An Effective Approach for Iris Recognition Using Phase-Based Image Matching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Hugo Proença,et al.  Deep-PRWIS: Periocular Recognition Without the Iris and Sclera Using Deep Learning Frameworks , 2018, IEEE Transactions on Information Forensics and Security.

[34]  John Daugman How iris recognition works , 2004 .

[35]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[36]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[37]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[38]  Chun-Wei Tan,et al.  Towards Online Iris and Periocular Recognition Under Relaxed Imaging Constraints , 2013, IEEE Transactions on Image Processing.

[39]  Dexin Zhang,et al.  Personal Identification Based on Iris Texture Analysis , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Cordelia Schmid,et al.  On the Importance of Visual Context for Data Augmentation in Scene Understanding , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Tieniu Tan,et al.  Iris Matching Based on Personalized Weight Map , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Hiroshi Inoue,et al.  Data Augmentation by Pairing Samples for Images Classification , 2018, ArXiv.

[43]  Bhabatosh Chanda,et al.  Texture code matrix-based multi-instance iris recognition , 2015, Pattern Analysis and Applications.

[44]  Arun Ross,et al.  Challenging ocular image recognition , 2011, Defense + Commercial Sensing.

[45]  Chun-Wei Tan,et al.  Efficient and Accurate At-a-Distance Iris Recognition Using Geometric Key-Based Iris Encoding , 2014, IEEE Transactions on Information Forensics and Security.

[46]  Andreas Uhl,et al.  Secure Iris Recognition Based on Local Intensity Variations , 2010, ICIAR.

[47]  K.W. Bowyer,et al.  The Best Bits in an Iris Code , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Ajay Kumar,et al.  Accurate Periocular Recognition Under Less Constrained Environment Using Semantics-Assisted Convolutional Neural Network , 2017, IEEE Transactions on Information Forensics and Security.

[49]  Chun-Wei Tan,et al.  Accurate Iris Recognition at a Distance Using Stabilized Iris Encoding and Zernike Moments Phase Features , 2014, IEEE Transactions on Image Processing.

[50]  Michał Grochowski,et al.  Data augmentation for improving deep learning in image classification problem , 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW).

[51]  Bhabatosh Chanda,et al.  Iris recognition using multiscale morphologic features , 2015, Pattern Recognit. Lett..

[52]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[53]  Adilson Gonzaga,et al.  Dynamic Features for Iris Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[54]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[55]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[57]  Xiaobo Zhang,et al.  Noisy iris image matching by using multiple cues , 2012, Pattern Recognit. Lett..

[58]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[59]  Junbin Gao,et al.  Generative Adversarial Network (GAN) Based Data Augmentation for Palmprint Recognition , 2018, 2018 Digital Image Computing: Techniques and Applications (DICTA).