Joint Iris Segmentation and Localization Using Deep Multi-task Learning Framework

Iris segmentation and localization in non-cooperative environment is challenging due to illumination variations, long distances, moving subjects and limited user cooperation, etc. Traditional methods often suffer from poor performance when confronted with iris images captured in these conditions. Recent studies have shown that deep learning methods could achieve impressive performance on iris segmentation task. In addition, as iris is defined as an annular region between pupil and sclera, geometric constraints could be imposed to help locating the iris more accurately and improve the segmentation results. In this paper, we propose a deep multi-task learning framework, named as IrisParseNet, to exploit the inherent correlations between pupil, iris and sclera to boost up the performance of iris segmentation and localization in a unified model. In particular, IrisParseNet firstly applies a Fully Convolutional Encoder-Decoder Attention Network to simultaneously estimate pupil center, iris segmentation mask and iris inner/outer boundary. Then, an effective post-processing method is adopted for iris inner/outer circle localization.To train and evaluate the proposed method, we manually label three challenging iris datasets, namely CASIA-Iris-Distance, UBIRIS.v2, and MICHE-I, which cover various types of noises. Extensive experiments are conducted on these newly annotated datasets, and results show that our method outperforms state-of-the-art methods on various benchmarks. All the ground-truth annotations, annotation codes and evaluation protocols are publicly available at https://github.com/xiamenwcy/IrisParseNet.

[1]  Luís A. Alexandre,et al.  Iris recognition: Analysis of the error rates regarding the accuracy of the segmentation stage , 2010, Image Vis. Comput..

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tang Rongnian,et al.  Improving Iris Segmentation Performance Via Borders Recognition , 2011, 2011 Fourth International Conference on Intelligent Computation Technology and Automation.

[4]  Hao Chen,et al.  Gland segmentation in colon histology images: The glas challenge contest , 2016, Medical Image Anal..

[5]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[6]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[9]  Arun Ross,et al.  Iris Segmentation Using Geodesic Active Contours , 2009, IEEE Transactions on Information Forensics and Security.

[10]  Yang Hu,et al.  Improving colour iris segmentation using a model selection technique , 2015, Pattern Recognit. Lett..

[11]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ashok A. Ghatol,et al.  Iris recognition: an emerging biometric technology , 2007 .

[13]  Ming-Yu Liu,et al.  CASENet: Deep Category-Aware Semantic Edge Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  In-So Kweon,et al.  BAM: Bottleneck Attention Module , 2018, BMVC.

[16]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[17]  Nikolai I. Chernov,et al.  Least Squares Fitting of Circles , 2005, Journal of Mathematical Imaging and Vision.

[18]  Domingo Mery,et al.  Iris Segmentation Using Geodesic Active Contours and GrabCut , 2015, PSIVT Workshops.

[19]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Luís A. Alexandre,et al.  The UBIRIS.v2: A Database of Visible Wavelength Iris Images Captured On-the-Move and At-a-Distance , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Francisco Javier Vera-Olmos,et al.  Deconvolutional Neural Network for Pupil Detection in Real-World Environments , 2017, IWINAC.

[22]  Wolfgang Rosenstiel,et al.  Evaluation of state-of-the-art pupil detection algorithms on remote eye images , 2016, UbiComp Adjunct.

[23]  Tieniu Tan,et al.  Efficient and robust segmentation of noisy iris images for non-cooperative iris recognition , 2010, Image Vis. Comput..

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Andreas Uhl,et al.  Experimental analysis regarding the influence of iris segmentation on the recognition rate , 2016, IET Biom..

[26]  Gang Yu,et al.  Learning a Discriminative Feature Network for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Takeshi Saitoh,et al.  CNN-Based Pupil Center Detection for Wearable Gaze Estimation System , 2017, Appl. Comput. Intell. Soft Comput..

[28]  Tao Zhang,et al.  A Survey of Model Compression and Acceleration for Deep Neural Networks , 2017, ArXiv.

[29]  Fernando Alonso-Fernandez,et al.  IrisSeg: A fast and robust iris segmentation framework for non-ideal iris images , 2016, 2016 International Conference on Biometrics (ICB).

[30]  Ajay Kumar,et al.  An Accurate Iris Segmentation Framework Under Relaxed Imaging Constraints Using Total Variation Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Peter Corcoran,et al.  An End to End Deep Neural Network for Iris Segmentation in Unconstraint Scenarios , 2017, Neural Networks.

[32]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[33]  Zhenan Sun,et al.  Accurate iris segmentation in non-cooperative environments using fully convolutional networks , 2016, 2016 International Conference on Biometrics (ICB).

[34]  Yu Liu,et al.  Learning Relaxed Deep Supervision for Better Edge Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Bernadette Dorizzi,et al.  The Viterbi algorithm at different resolutions for enhanced iris segmentation , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[37]  Otmar Hilliges,et al.  Learning to find eye region landmarks for remote gaze estimation in unconstrained settings , 2018, ETRA.

[38]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[39]  Andreas Uhl,et al.  Domain Adaptation for CNN Based Iris Segmentation , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[40]  Michele Nappi,et al.  Mobile Iris Challenge Evaluation (MICHE)-I, biometric iris dataset and protocols , 2015, Pattern Recognit. Lett..

[41]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[42]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Alexander Rakhlin,et al.  Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning , 2018, bioRxiv.

[45]  Michal Haindl,et al.  Unsupervised detection of non-iris occlusions , 2015, Pattern Recognit. Lett..

[46]  Zhuowen Tu,et al.  Deeply Supervised Salient Object Detection with Short Connections , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[49]  Shahrel Azmin Suandi,et al.  Automated segmentation of iris images acquired in an unconstrained environment using HOG-SVM and GrowCut , 2017, Digit. Signal Process..

[50]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[51]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[52]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[53]  Kang Ryoung Park,et al.  IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors , 2018, Sensors.

[54]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[55]  Hugo Proença,et al.  Results from MICHE II - Mobile Iris CHallenge Evaluation II , 2017, Pattern Recognit. Lett..

[56]  Michele Nappi,et al.  FIRME: Face and Iris Recognition for Mobile Engagement , 2014, Image Vis. Comput..

[57]  David Menotti,et al.  A Benchmark for Iris Location and a Deep Learning Detector Evaluation , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[58]  Andreas Uhl,et al.  A Ground Truth for Iris Segmentation , 2014, 2014 22nd International Conference on Pattern Recognition.

[59]  H. Proenca,et al.  The NICE.I: Noisy Iris Challenge Evaluation - Part I , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.