Intensity and Compactness Enabled Saliency Estimation for Leakage Detection in Diabetic and Malarial Retinopathy

Leakage in retinal angiography currently is a key feature for confirming the activities of lesions in the management of a wide range of retinal diseases, such as diabetic maculopathy and paediatric malarial retinopathy. This paper proposes a new saliency-based method for the detection of leakage in fluorescein angiography. A superpixel approach is firstly employed to divide the image into meaningful patches (or superpixels) at different levels. Two saliency cues, intensity and compactness, are then proposed for the estimation of the saliency map of each individual superpixel at each level. The saliency maps at different levels over the same cues are fused using an averaging operator. The two saliency maps over different cues are fused using a pixel-wise multiplication operator. Leaking regions are finally detected by thresholding the saliency map followed by a graph-cut segmentation. The proposed method has been validated using the only two publicly available datasets: one for malarial retinopathy and the other for diabetic retinopathy. The experimental results show that it outperforms one of the latest competitors and performs as well as a human expert for leakage detection and outperforms several state-of-the-art methods for saliency detection.

[1]  Yonghuai Liu,et al.  Using Region-Based Saliency for 3D Interest Points Detection , 2013, CAIP.

[2]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[3]  Yalin Zheng,et al.  Automated Detection of Leakage in Fluorescein Angiography Images with Application to Malarial Retinopathy , 2015, Scientific Reports.

[4]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[5]  Jayanthi Sivaswamy,et al.  Visual saliency based bright lesion detection and discrimination in retinal images , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[6]  Ling Shao,et al.  Sub-Markov Random Walk for Image Segmentation , 2016, IEEE Transactions on Image Processing.

[7]  I. Deary,et al.  Retinal vascular image analysis as a potential screening tool for cerebrovascular disease: a rationale based on homology between cerebral and retinal microvasculatures , 2005, Journal of anatomy.

[8]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[9]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[10]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Alfredo Dubra,et al.  Comparison of adaptive optics scanning light ophthalmoscopic fluorescein angiography and offset pinhole imaging. , 2014, Biomedical optics express.

[12]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[13]  Sheng Chen,et al.  A Kernel-Based Two-Class Classifier for Imbalanced Data Sets , 2007, IEEE Transactions on Neural Networks.

[14]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Xuelong Li,et al.  Interactive Segmentation Using Constrained Laplacian Optimization , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Jayanthi Sivaswamy,et al.  Assessment of computational visual attention models on medical images , 2012, ICVGIP '12.

[17]  L Martínez-Costa,et al.  Macular edema computer-aided evaluation in ocular vein occlusions. , 1998, Computers and biomedical research, an international journal.

[18]  S. Harding,et al.  Automated Detection of Vessel Abnormalities on Fluorescein Angiogram in Malarial Retinopathy , 2015, Scientific Reports.

[19]  Xiao Chen,et al.  Automatic salient object detection via maximum entropy estimation. , 2013, Optics letters.

[20]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[21]  Harish Katti,et al.  Depth Matters: Influence of Depth Cues on Visual Saliency , 2012, ECCV.

[22]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Pavel Matula,et al.  Smooth Chan-Vese segmentation via graph cuts , 2012, Pattern Recognit. Lett..

[24]  Dwarikanath Mahapatra,et al.  MRF-Based Intensity Invariant Elastic Registration of Cardiac Perfusion Images Using Saliency Information , 2011, IEEE Transactions on Biomedical Engineering.

[25]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yalin Zheng,et al.  Retinal Vessel Segmentation: An Efficient Graph Cut Approach with Retinex and Local Phase , 2015, PloS one.

[27]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[28]  Byoung Chul Ko,et al.  Object-of-interest image segmentation based on human attention and semantic region clustering. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  Pedro Martins,et al.  Context-aware features and robust image representations , 2014, J. Vis. Commun. Image Represent..

[30]  Max Q.-H. Meng,et al.  Saliency Based Ulcer Detection for Wireless Capsule Endoscopy Diagnosis , 2015, IEEE Transactions on Medical Imaging.

[31]  A. Ellingford,et al.  A new method of image analysis of fluorescein angiography applied to age-related macular degeneration , 1995, Eye.

[32]  Priyatham S. Mettu,et al.  Fully automatic segmentation of fluorescein leakage in subjects with diabetic macular edema. , 2015, Investigative ophthalmology & visual science.

[33]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[34]  E. Trucco,et al.  Contextual detection of ischemic regions in ultra-wide-field-of-view retinal fluorescein angiograms , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[36]  Bärbel Mertsching,et al.  Fast and Robust Generation of Feature Maps for Region-Based Visual Attention , 2008, IEEE Transactions on Image Processing.

[37]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[38]  Colleen A. Hammond,et al.  Acute Brain MRI Findings in 120 Malawian Children with Cerebral Malaria: New Insights into an Ancient Disease , 2012, American Journal of Neuroradiology.

[39]  Chia-Ling Tsai,et al.  Automatic characterization of classic choroidal neovascularization by using AdaBoost for supervised learning. , 2011, Investigative ophthalmology & visual science.

[40]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.