Deep Feature Fusion for Iris and Periocular Biometrics on Mobile Devices

The quality of iris images on mobile devices is significantly degraded due to hardware limitations and less constrained environments. Traditional iris recognition methods cannot achieve high identification rate using these low-quality images. To enhance the performance of mobile identification, we develop a deep feature fusion network that exploits the complementary information presented in iris and periocular regions. The proposed method first applies maxout units into the convolutional neural networks (CNNs) to generate a compact representation for each modality and then fuses the discriminative features of two modalities through a weighted concatenation. The parameters of convolutional filters and fusion weights are simultaneously learned to optimize the joint representation of iris and periocular biometrics. To promote the iris recognition research on mobile devices under near-infrared (NIR) illumination, we publicly release the CASIA-Iris-Mobile-V1.0 database, which in total includes 11 000 NIR iris images of both eyes from 630 Asians. It is the largest NIR mobile iris database as far as we know. On the newly built CASIA-Iris-M1-S3 data set, the proposed method achieves 0.60% equal error rate and 2.32% false non-match rate at false match rate $=10^{-5}$ , which are obviously better than unimodal biometrics as well as traditional fusion methods. Moreover, the proposed model requires much fewer storage spaces and computational resources than general CNNs.

[1]  Arun Ross,et al.  Long range iris recognition: A survey , 2017, Pattern Recognit..

[2]  Matthew C. Valenti,et al.  Multibiometric secure system based on deep learning , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[3]  Hugo Proença,et al.  Results from MICHE II - Mobile Iris CHallenge Evaluation II , 2017, Pattern Recognit. Lett..

[4]  Sébastien Marcel,et al.  Periocular biometrics in mobile environment , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[5]  Edmundo Hoyle,et al.  A fusion approach to unconstrained iris recognition , 2012, Pattern Recognit. Lett..

[6]  Ajita Rattani,et al.  ICIP 2016 competition on mobile ocular biometric recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Stefano Ricciardi,et al.  Ubiquitous iris recognition by means of mobile devices , 2015, Pattern Recognit. Lett..

[8]  Hugo Proença,et al.  IRINA: Iris Recognition (Even) in Inaccurately Segmented Data , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Tieniu Tan,et al.  Fusion of Iris and Periocular Biometrics for Cross-Sensor Identification , 2012, CCBR.

[11]  Abhishek Kumar Gangwar,et al.  DeepIrisNet: Deep iris representation with applications in iris recognition and cross-sensor iris recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[12]  Kevin W. Bowyer The results of the NICE.II Iris biometrics competition , 2012, Pattern Recognit. Lett..

[13]  Anil K. Jain,et al.  Periocular biometrics in the visible spectrum: A feasibility study , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[14]  Chun-Wei Tan,et al.  Efficient and Accurate At-a-Distance Iris Recognition Using Geometric Key-Based Iris Encoding , 2014, IEEE Transactions on Information Forensics and Security.

[15]  Michele Nappi,et al.  FIRME: Face and Iris Recognition for Mobile Engagement , 2014, Image Vis. Comput..

[16]  Hugo Proença,et al.  Deep-PRWIS: Periocular Recognition Without the Iris and Sclera Using Deep Learning Frameworks , 2018, IEEE Transactions on Information Forensics and Security.

[17]  Ashok A. Ghatol,et al.  Iris recognition: an emerging biometric technology , 2007 .

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Ajay Kumar,et al.  Towards More Accurate Iris Recognition Using Deeply Learned Spatially Corresponding Features , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Kiran B. Raja,et al.  Collaborative representation of deep sparse filtered features for robust verification of smartphone periocular images , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[21]  Jaime S. Cardoso,et al.  Multi-source deep transfer learning for cross-sensor biometrics , 2016, Neural Computing and Applications.

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[23]  Tieniu Tan,et al.  Exploring complementary features for iris recognition on mobile devices , 2016, 2016 International Conference on Biometrics (ICB).

[24]  Kuntal Dey,et al.  A preliminary study of CNNs for iris and periocular verification in the visible spectrum , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[25]  Tieniu Tan,et al.  DeepIris: Learning pairwise filter bank for heterogeneous iris verification , 2016, Pattern Recognit. Lett..

[26]  Gil Melfe Mateus Santos,et al.  Fusing iris and periocular information for cross-sensor recognition , 2015, Pattern Recognit. Lett..

[27]  Michele Nappi,et al.  Noisy Iris Recognition Integrated Scheme , 2012, Pattern Recognit. Lett..

[28]  Sridha Sridharan,et al.  Iris Recognition With Off-the-Shelf CNN Features: A Deep Learning Perspective , 2018, IEEE Access.

[29]  Muhammad Hussain,et al.  ConvSRC: SmartPhone based Periocular Recognition using Deep Convolutional Neural Network and Sparsity Augmented Collaborative Representation , 2018, J. Intell. Fuzzy Syst..

[30]  Kang Ryoung Park,et al.  New iris recognition method for noisy iris images , 2012, Pattern Recognit. Lett..

[31]  Peihua Li,et al.  Deep Convolutional Features for Iris Recognition , 2017, CCBR.

[32]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Yoshua Bengio,et al.  Maxout Networks , 2013, ICML.

[34]  Ramachandra Raghavendra,et al.  Learning deeply coupled autoencoders for smartphone based robust periocular verification , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[35]  Tieniu Tan,et al.  Ordinal Measures for Iris Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Michele Nappi,et al.  Mobile Iris Challenge Evaluation (MICHE)-I, biometric iris dataset and protocols , 2015, Pattern Recognit. Lett..

[37]  Fernando Alonso-Fernandez,et al.  A survey on periocular biometrics research , 2016, Pattern Recognit. Lett..

[38]  Ajay Kumar,et al.  Accurate Periocular Recognition Under Less Constrained Environment Using Semantics-Assisted Convolutional Neural Network , 2017, IEEE Transactions on Information Forensics and Security.

[39]  Chun-Wei Tan,et al.  Accurate Iris Recognition at a Distance Using Stabilized Iris Encoding and Zernike Moments Phase Features , 2014, IEEE Transactions on Image Processing.

[40]  Yang Hu,et al.  Signal-Level Information Fusion for Less Constrained Iris Recognition Using Sparse-Error Low Rank Matrix Factorization , 2016, IEEE Transactions on Information Forensics and Security.

[41]  Andrea F. Abate,et al.  SKIPSOM: Skewness & kurtosis of iris pixels in Self Organizing Maps for iris recognition on mobile devices , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[42]  Chun-Wei Tan,et al.  Towards Online Iris and Periocular Recognition Under Relaxed Imaging Constraints , 2013, IEEE Transactions on Image Processing.

[43]  Luís A. Alexandre,et al.  Toward Covert Iris Biometric Recognition: Experimental Results From the NICE Contests , 2012, IEEE Transactions on Information Forensics and Security.

[44]  Tieniu Tan,et al.  Fusion of Face and Iris Biometrics on Mobile Devices Using Near-infrared Images , 2015, CCBR.

[45]  Kiran B. Raja,et al.  Dynamic scale selected Laplacian decomposed frequency response for cross-smartphone periocular verification in visible spectrum , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[46]  Kiran B. Raja,et al.  Multi-modal authentication system for smartphones using face, iris and periocular , 2015, 2015 International Conference on Biometrics (ICB).

[47]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[48]  Jean-Luc Dugelay,et al.  Fusing iris colour and texture information for fast iris recognition on mobile devices , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[49]  Yang Hu,et al.  Optimal Generation of Iris Codes for Iris Recognition , 2017, IEEE Transactions on Information Forensics and Security.

[50]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[51]  Kiran B. Raja,et al.  Multi-patch deep sparse histograms for iris recognition in visible spectrum using collaborative subspace for robust verification , 2017, Pattern Recognit. Lett..

[52]  Zia Saquib,et al.  Person recognition based on fusion of iris and periocular biometrics , 2012, 2012 12th International Conference on Hybrid Intelligent Systems (HIS).

[53]  Kiran B. Raja,et al.  Smartphone based robust iris recognition in visible spectrum using clustered K-means features , 2014, 2014 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS) Proceedings.

[54]  Peter Corcoran,et al.  User Authentication on Smartphones: Focusing on iris biometrics , 2016, IEEE Consumer Electronics Magazine.

[55]  Tieniu Tan,et al.  Ordinal Feature Selection for Iris and Palmprint Recognition , 2014, IEEE Transactions on Image Processing.

[56]  Man Zhang,et al.  The BTAS∗Competition on Mobile Iris Recognition , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[57]  Javier Lorenzo-Navarro,et al.  Local descriptors fusion for mobile iris verification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[58]  Pramod K. Varshney,et al.  An adaptive multimodal biometric management algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[59]  Dexin Zhang,et al.  DCT-Based Iris Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Richa Singh,et al.  At-a-distance person recognition via combining ocular features , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[61]  B. V. K. Vijaya Kumar,et al.  Iris Recognition Using Correlation Filters , 2015, Encyclopedia of Biometrics.

[62]  Tieniu Tan,et al.  Toward Accurate and Fast Iris Segmentation for Iris Biometrics , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[64]  Arun Ross,et al.  On the Fusion of Periocular and Iris Biometrics in Non-ideal Imagery , 2010, 2010 20th International Conference on Pattern Recognition.