Towards Complete and Accurate Iris Segmentation Using Deep Multi-Task Attention Network for Non-Cooperative Iris Recognition

Iris images captured in non-cooperative environments often suffer from adverse noise, which challenges many existing iris segmentation methods. To address this problem, this paper proposes a high-efficiency deep learning based iris segmentation approach, named IrisParseNet. Different from many previous CNN-based iris segmentation methods, which only focus on predicting accurate iris masks by following popular semantic segmentation frameworks, the proposed approach is a complete iris segmentation solution, i.e., iris mask and parameterized inner and outer iris boundaries are jointly achieved by actively modeling them into a unified multi-task network. Moreover, an elaborately designed attention module is incorporated into it to improve the segmentation performance. To train and evaluate the proposed approach, we manually label three representative and challenging iris databases, i.e., CASIA.v4-distance, UBIRIS.v2, and MICHE-I, which involve multiple illumination (NIR, VIS) and imaging sensors (long-range and mobile iris cameras), along with various types of noises. Additionally, several unified evaluation protocols are built for fair comparisons. Extensive experiments are conducted on these newly annotated databases, and results show that the proposed approach achieves state-of-the-art performance on various benchmarks. Further, as a general drop-in replacement, the proposed iris segmentation method can be used for any iris recognition methodology, and would significantly improve the performance of non-cooperative iris recognition.

[1]  Christoph Busch,et al.  Detection of Glasses in Near-Infrared Ocular Images , 2018, 2018 International Conference on Biometrics (ICB).

[2]  John Daugman,et al.  New Methods in Iris Recognition , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Andreas Uhl,et al.  Domain Adaptation for CNN Based Iris Segmentation , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[4]  Michele Nappi,et al.  Mobile Iris Challenge Evaluation (MICHE)-I, biometric iris dataset and protocols , 2015, Pattern Recognit. Lett..

[5]  Ritesh Vyas,et al.  Recent trends of ROI segmentation in iris biometrics: a survey , 2019, Int. J. Biom..

[6]  Andreas Uhl,et al.  Exploiting superior CNN-based iris segmentation for better recognition accuracy , 2019, Pattern Recognit. Lett..

[7]  Zijing Zhao,et al.  A deep learning based unified framework to detect, segment and recognize irises using spatially corresponding features , 2019, Pattern Recognit..

[8]  Marcin Kowalski,et al.  PROTECT Multimodal DB: fusion evaluation on a novel multimodal biometrics dataset envisaging Border Control , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[9]  Ajay Kumar,et al.  An Accurate Iris Segmentation Framework Under Relaxed Imaging Constraints Using Total Variation Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Peter Corcoran,et al.  An End to End Deep Neural Network for Iris Segmentation in Unconstraint Scenarios , 2017, Neural Networks.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Michal Haindl,et al.  Unsupervised detection of non-iris occlusions , 2015, Pattern Recognit. Lett..

[13]  Andreas Uhl,et al.  A Ground Truth for Iris Segmentation , 2014, 2014 22nd International Conference on Pattern Recognition.

[14]  H. Proenca,et al.  The NICE.I: Noisy Iris Challenge Evaluation - Part I , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[15]  Luís A. Alexandre,et al.  Iris segmentation methodology for non-cooperative recognition , 2006 .

[16]  Tieniu Tan,et al.  Deep Feature Fusion for Iris and Periocular Biometrics on Mobile Devices , 2018, IEEE Transactions on Information Forensics and Security.

[17]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Kang Ryoung Park,et al.  IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors , 2018, Sensors.

[19]  Christoph Busch,et al.  Visible Wavelength Iris Segmentation: A Multi-Class Approach using Fully Convolutional Neuronal Networks , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[20]  Wolfgang Rosenstiel,et al.  Evaluation of state-of-the-art pupil detection algorithms on remote eye images , 2016, UbiComp Adjunct.

[21]  Andreas Uhl,et al.  Iris Segmentation Using Fully Convolutional Encoder--Decoder Networks , 2017 .

[22]  Bernadette Dorizzi,et al.  The Viterbi algorithm at different resolutions for enhanced iris segmentation , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Yang Hu,et al.  Improving colour iris segmentation using a model selection technique , 2015, Pattern Recognit. Lett..

[25]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Arun Ross,et al.  Non-ideal iris segmentation using Polar Spline RANSAC and illumination compensation , 2019, Comput. Vis. Image Underst..

[27]  M. Sujatha,et al.  Recognition of Human Iris Patterns for Biometric Identification , 2015 .

[28]  Patrick J. Flynn,et al.  The ND-IRIS-0405 Iris Image Dataset , 2016, ArXiv.

[29]  Arun Ross,et al.  Iris Segmentation Using Geodesic Active Contours , 2009, IEEE Transactions on Information Forensics and Security.

[30]  Zhenan Sun,et al.  Accurate iris segmentation in non-cooperative environments using fully convolutional networks , 2016, 2016 International Conference on Biometrics (ICB).

[31]  Tieniu Tan,et al.  Toward Accurate and Fast Iris Segmentation for Iris Biometrics , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yu Liu,et al.  Learning Relaxed Deep Supervision for Better Edge Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[34]  David Menotti,et al.  Robust Iris Segmentation Based on Fully Convolutional Networks and Generative Adversarial Networks , 2018, 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[35]  Tieniu Tan,et al.  Efficient and robust segmentation of noisy iris images for non-cooperative iris recognition , 2010, Image Vis. Comput..

[36]  Tang Rongnian,et al.  Improving Iris Segmentation Performance Via Borders Recognition , 2011, 2011 Fourth International Conference on Intelligent Computation Technology and Automation.

[37]  Hao Chen,et al.  Gland segmentation in colon histology images: The glas challenge contest , 2016, Medical Image Anal..

[38]  Kevin W. Bowyer,et al.  Iris Recognition with Image Segmentation Employing Retrained Off-the-Shelf Deep Neural Networks , 2019, 2019 International Conference on Biometrics (ICB).

[39]  Tieniu Tan,et al.  Ordinal Measures for Iris Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Kiran B. Raja,et al.  Cross-Eyed - Cross-Spectral Iris/Periocular Recognition Database and Competition , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[41]  Luís A. Alexandre,et al.  The UBIRIS.v2: A Database of Visible Wavelength Iris Images Captured On-the-Move and At-a-Distance , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Bernadette Dorizzi,et al.  OSIRIS: An open source iris recognition software , 2016, Pattern Recognit. Lett..

[43]  Zhiming Luo,et al.  Attention guided U-Net for accurate iris segmentation , 2018, J. Vis. Commun. Image Represent..

[44]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[46]  Shahrel Azmin Suandi,et al.  Automated segmentation of iris images acquired in an unconstrained environment using HOG-SVM and GrowCut , 2017, Digit. Signal Process..

[47]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[48]  Tieniu Tan,et al.  Fusion of Face and Iris Biometrics on Mobile Devices Using Near-infrared Images , 2015, CCBR.

[49]  Nikolai I. Chernov,et al.  Least Squares Fitting of Circles , 2005, Journal of Mathematical Imaging and Vision.

[50]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[51]  Ashok A. Ghatol,et al.  Iris recognition: an emerging biometric technology , 2007 .

[52]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[53]  In-So Kweon,et al.  BAM: Bottleneck Attention Module , 2018, BMVC.

[54]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[55]  Christoph Busch,et al.  Iris Recognition in Visible Wavelength: Impact and Automated Detection of Glasses , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[56]  Kang Ryoung Park,et al.  FRED-Net: Fully residual encoder-decoder network for accurate iris segmentation , 2019, Expert Syst. Appl..

[57]  Domingo Mery,et al.  Iris Segmentation Using Geodesic Active Contours and GrabCut , 2015, PSIVT Workshops.

[58]  Ajay Kumar,et al.  Towards More Accurate Iris Recognition Using Deeply Learned Spatially Corresponding Features , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[59]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.