Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion

BACKGROUND AND OBJECTIVE Diabetic retinopathy is one of the leading disabling chronic diseases and one of the leading causes of preventable blindness in developed world. Early diagnosis of diabetic retinopathy enables timely treatment and in order to achieve it a major effort will have to be invested into automated population screening programs. Detection of exudates in color fundus photographs is very important for early diagnosis of diabetic retinopathy. METHODS We use deep convolutional neural networks for exudate detection. In order to incorporate high level anatomical knowledge about potential exudate locations, output of the convolutional neural network is combined with the output of the optic disc detection and vessel detection procedures. RESULTS In the validation step using a manually segmented image database we obtain a maximum F1 measure of 0.78. CONCLUSIONS As manually segmenting and counting exudate areas is a tedious task, having a reliable automated output, such as automated segmentation using convolutional neural networks in combination with other landmark detectors, is an important step in creating automated screening programs for early detection of diabetic retinopathy.

[1]  Majid Mirmehdi,et al.  Automatic Recognition of Exudative Maculopathy using Fuzzy C- Means Clustering and Neural Networks , 2001 .

[2]  Jürgen Schmidhuber,et al.  A fast learning algorithm for image segmentation with max-pooling convolutional networks , 2013, 2013 IEEE International Conference on Image Processing.

[3]  Feroui Amel,et al.  Improvement of the Hard Exudates Detection Method Used For Computer- Aided Diagnosis of Diabetic Retinopathy , 2012 .

[4]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[5]  Pascal Getreuer,et al.  Rudin-Osher-Fatemi Total Variation Denoising using Split Bregman , 2012, Image Process. Line.

[6]  Kenneth W. Tobin,et al.  Detection of Anatomic Structures in Human Retinal Imagery , 2007, IEEE Transactions on Medical Imaging.

[7]  Remco Duits,et al.  A Multi-Orientation Analysis Approach to Retinal Vessel Tracking , 2012, Journal of Mathematical Imaging and Vision.

[8]  Sven Loncaric,et al.  Diabetic retinopathy image database(DRiDB): A new database for diabetic retinopathy screening programs research , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[9]  William L. Goffe,et al.  SIMANN: FORTRAN module to perform Global Optimization of Statistical Functions with Simulated Annealing , 1992 .

[10]  Bram van Ginneken,et al.  Improving hard exudate detection in retinal images through a combination of local and contextual information , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[12]  J. Olson,et al.  Diabetic retinopathy at diagnosis of type 2 diabetes in Scotland , 2012, Diabetologia.

[13]  Majid Mirmehdi,et al.  Comparison of colour spaces for optic disc localisation in retinal images , 2002, Object recognition supported by user interaction for service robots.

[14]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[15]  Paul Mitchell,et al.  Diabetic retinopathy screening and monitoring of early stage disease in general practice: design and methods. , 2012, Contemporary clinical trials.

[16]  Sharon E. Lee,et al.  Use of eye care services by people with diabetes: the Melbourne Visual Impairment Project , 1995, The British journal of ophthalmology.

[17]  András Hajdu,et al.  Detection of the optic disc in fundus images by combining probability models , 2015, Comput. Biol. Medicine.

[18]  Roberto Hornero,et al.  A novel automatic image processing algorithm for detection of hard exudates based on retinal image analysis. , 2008, Medical engineering & physics.

[19]  Bunyarit Uyyanonvara,et al.  Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methods , 2008, Comput. Medical Imaging Graph..

[20]  Anurag Mittal,et al.  Automated feature extraction for early detection of diabetic retinopathy in fundus images , 2009, CVPR.

[21]  András Hajdu,et al.  Automatic exudate detection using active contour model and regionwise classification , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Philip J. Morrow,et al.  Algorithms for digital image processing in diabetic retinopathy , 2009, Comput. Medical Imaging Graph..

[23]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[24]  Tunde Peto,et al.  Screening for Diabetic Retinopathy and Diabetic Macular Edema in the United Kingdom , 2012, Current Diabetes Reports.

[25]  S. Wild,et al.  Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. , 2004, Diabetes care.

[26]  Aliaa A. A. Youssif,et al.  Optic Disc Detection From Normalized Digital Fundus Images by Means of a Vessels' Direction Matched Filter , 2008, IEEE Transactions on Medical Imaging.

[27]  P F Sharp,et al.  Cost-effectiveness of implementing automated grading within the national screening programme for diabetic retinopathy in Scotland , 2007, British Journal of Ophthalmology.

[28]  Michael H. Goldbaum,et al.  Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels , 2003, IEEE Transactions on Medical Imaging.

[29]  Bunyarit Uyyanonvara,et al.  Automatic Exudate Detection from Non-dilated Diabetic Retinopathy Retinal Images Using Fuzzy C-means Clustering , 2009, Sensors.

[30]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Peter F. Sharp,et al.  Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes , 2008, Diabetes Care.

[32]  Aliaa A. A. Youssif,et al.  Comparative Study of Contrast Enhancement and Illumination Equalization Methods for Retinal Vasculat , 2006 .

[33]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[34]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[35]  Gwénolé Quellec,et al.  Exudate detection in color retinal images for mass screening of diabetic retinopathy , 2014, Medical Image Anal..

[36]  B. van Ginneken,et al.  Automated detection and differentiation of drusen, exudates, and cotton-wool spots in digital color fundus photographs for diabetic retinopathy diagnosis. , 2007, Investigative ophthalmology & visual science.

[37]  Pascale Massin,et al.  A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina , 2002, IEEE Transactions on Medical Imaging.

[38]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[39]  Thomas Walter,et al.  Segmentation of Color Fundus Images of the Human Retina: Detection of the Optic Disc and the Vascular Tree Using Morphological Techniques , 2001, ISMDA.

[40]  Bálint Antal,et al.  Automatic exudate detection with improved Naïve-bayes classifier , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[41]  Bram van Ginneken,et al.  Contextual computer-aided detection: Improving bright lesion detection in retinal images and coronary calcification identification in CT scans , 2012, Medical Image Anal..

[42]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[43]  Roberto Hornero,et al.  Retinal image analysis based on mixture models to detect hard exudates , 2009, Medical Image Anal..

[44]  Xinpeng Zhang,et al.  Hard Exudates Detection Method Based on Background-Estimation , 2015, ICIG.

[45]  Emanuele Trucco,et al.  Leveraging Multiscale Hessian-Based Enhancement With a Novel Exudate Inpainting Technique for Retinal Vessel Segmentation , 2016, IEEE Journal of Biomedical and Health Informatics.