ScleraSegNet: An Attention Assisted U-Net Model for Accurate Sclera Segmentation

This paper proposes a novel sclera segmentation approach based on an attention assisted U-Net model, named ScleraSegNet. Several off-the-shelf or improved attention modules are incorporated into the central bottleneck part or skip connection part of the original U-Net, helping the new model implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using an external ROI localization model of cascade frameworks. The proposed approach is evaluated on several public, challenging eye datasets and experimental results show that introduced attention modules consistently improve the segmentation performance over the original U-Net across different datasets, and the best performing ScleraSegNet (CBAM) model achieves state-of-the-art segmentation performance. By utilizing the high stage’s semantic information to guide the selection of features from the low stage in channel-wise and spatial-wise, the further improved ScleraSegNet (SSBC) model ranked first in the Sclera Segmentation Benchmarking Competition 2019 (SSBC 2019), part of ICB 2019, with a Precision value of 92.88% and a Recall value of 90.34% on the MASD.v1 dataset, and a Precision value of 83.19% and a Recall value of 80.01% on the MSD dataset, respectively.

[1]  Petru Radu,et al.  A robust sclera segmentation algorithm , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  Jaihie Kim,et al.  Vessel pattern enhancement based on Weber's law for sclera recognition , 2018, 2018 International Conference on Electronics, Information, and Communication (ICEIC).

[4]  S VANNAS,et al.  OBSERVATIONS ON STRUCTURES AND AGE CHANGES IN THE HUMAN SCLERA , 1960, Acta ophthalmologica.

[5]  Edward J. Delp,et al.  A New Human Identification Method: Sclera Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[7]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Zhenan Sun,et al.  Sclera Segmentation Benchmarking Competition in Cross-resolution Environment , 2019, 2019 International Conference on Biometrics (ICB).

[11]  Abhijit Dasa,et al.  SSBC 2015: Sclera segmentation benchmarking competition , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[12]  Wai Lok Woo,et al.  Enhanced segmentation and complex-sclera features for human recognition with unconstrained visible-wavelength imaging , 2016, 2016 International Conference on Biometrics (ICB).

[13]  Alexander J. Smola,et al.  Stacked Attention Networks for Image Question Answering , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Reza Safabakhsh,et al.  A TASOM-based algorithm for active contour modeling , 2003, Pattern Recognit. Lett..

[15]  Gang Yu,et al.  Learning a Discriminative Feature Network for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Chih-Peng Fan,et al.  SIFT Features and SVM Learning based Sclera Recognition Method with Efficient Sclera Segmentation for Identity Identification , 2019, 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS).

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Edward J. Delp,et al.  Multimodal eye recognition , 2010, Defense + Commercial Sensing.

[19]  David Menotti,et al.  Fully Convolutional Networks and Generative Adversarial Networks Applied to Sclera Segmentation , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[20]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  P. Tower The fundus oculi in monozygotic twins; report of six pairs of identical twins. , 1955, A.M.A. archives of ophthalmology.

[22]  Luís A. Alexandre,et al.  UBIRIS: A Noisy Iris Image Database , 2005, ICIAP.

[23]  Miguel Angel Ferrer-Ballester,et al.  SSBC 2018: Sclera Segmentation Benchmarking Competition , 2015, 2018 International Conference on Biometrics (ICB).

[24]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Hiromitsu Kobayashi,et al.  Unique morphology of the human eye , 1997, Nature.

[26]  Roberto Cipolla,et al.  MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving , 2016, 2018 IEEE Intelligent Vehicles Symposium (IV).

[27]  Arun Ross,et al.  A New Biometric Modality Based on Conjunctival Vasculature , 2006 .

[28]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[29]  Wai Lok Woo,et al.  Robust Sclera Recognition System With Novel Sclera Segmentation and Validation Techniques , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Miguel Angel Ferrer-Ballester,et al.  Sclera Recognition - A Survey , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[31]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[32]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  H E Kaufman,et al.  Electron microscopic studies of the elastic fiber in human sclera. , 1972, Investigative ophthalmology.

[34]  R M Broekhuyse The lipid composition of aging sclera and cornea. , 1975, Ophthalmologica. Journal international d'ophtalmologie. International journal of ophthalmology. Zeitschrift fur Augenheilkunde.

[35]  Peter Peer,et al.  Deep Multi-class Eye Segmentation for Ocular Biometrics , 2018, 2018 IEEE International Work Conference on Bioinspired Intelligence (IWOBI).

[36]  Luís A. Alexandre,et al.  The UBIRIS.v2: A Database of Visible Wavelength Iris Images Captured On-the-Move and At-a-Distance , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Kar-Ann Toh,et al.  Extracting sclera features for cancelable identity verification , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[38]  Zainul Abdin Jaffery,et al.  Analysis of multimodal biometrie recognition using Iris and sclera , 2017, INFOCOM 2017.

[39]  Miguel Angel Ferrer-Ballester,et al.  SSRBC 2016: Sclera Segmentation and Recognition Benchmarking Competition , 2016, 2016 International Conference on Biometrics (ICB).

[40]  Miguel Angel Ferrer-Ballester,et al.  SSERBC 2017: Sclera segmentation and eye recognition benchmarking competition , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  In-So Kweon,et al.  BAM: Bottleneck Attention Module , 2018, BMVC.

[43]  Reza Safabakhsh,et al.  Human eye sclera detection and tracking using a modified time-adaptive self-organizing map , 2008, Pattern Recognit..

[44]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[45]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Lei Zhang,et al.  Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  A. Joussen,et al.  Vascular plasticity – the role of the angiopoietins in modulating ocular angiogenesis , 2001, Graefe's Archive for Clinical and Experimental Ophthalmology.

[48]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[49]  Wai Lok Woo,et al.  Sclera recognition: on the quality measure and segmentation of degraded images captured under relaxed imaging conditions , 2017, IET Biom..

[50]  Jaihie Kim,et al.  A bifurcation-based descriptor for sclera recognition , 2019, 2019 International Conference on Electronics, Information, and Communication (ICEIC).

[51]  Michele Nappi,et al.  FIRME: Face and Iris Recognition for Mobile Engagement , 2014, Image Vis. Comput..

[52]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[54]  Miguel Angel Ferrer-Ballester,et al.  Sclera recognition using dense-SIFT , 2013, 2013 13th International Conference on Intellient Systems Design and Applications.

[55]  Zhenan Sun,et al.  ScleraSegNet: an Improved U-Net Model with Attention for Accurate Sclera Segmentation , 2019, 2019 International Conference on Biometrics (ICB).

[56]  Arun Ross,et al.  A Texture-Based Neural Network Classifier for Biometric Identification using Ocular Surface Vasculature , 2007, 2007 International Joint Conference on Neural Networks.