Diabetic retinopathy detection through artificial intelligent techniques: a review and open issues

Diabetic Retinopathy (DR) is the disease caused by uncontrolled diabetes that may lead to blindness among the patients. Due to the advancements in artificial intelligence, early detection of DR through an automated system is more beneficial over the manual detection. At present, there are several published studies on automated DR detection systems through machine learning or deep learning approaches. This study presents a review on DR detection techniques from five different aspects namely, datasets, image preprocessing techniques, machine learning-based approaches, deep learning-based approaches, and performance measures. Moreover, it also presents the authors’ observation and significance of the review findings. Furthermore, we also discuss nine new research challenges in DR detection. After a rigorous selection process, 74 primary publications were selected from eight academic databases for this review. From the selected studies, it was observed that many public datasets are available in the field of DR detection. In image preprocessing techniques, contrast enhancement combined with green channel extraction contributed the most in classification accuracy. In features, shape-based, texture-based and statistical features were reported as the most discriminative in DR detection. The Artificial Neural Network was proven eminent classifier compared to other machine learning classifiers. In deep learning, Convolutional Neural Network outperformed compared to other deep learning networks. Finally, to measure the classification performance, accuracy, sensitivity, and specificity metrics were mostly employed. This review presents a comprehensive summary of DR detection techniques and will be proven useful for the community of scientists working in the field of automated DR detection techniques.

[1]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Vasile Palade,et al.  Automatic detection of microaneurysms in colour fundus images for diabetic retinopathy screening , 2015, Neural Computing and Applications.

[3]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[4]  Ihsan ul Haq,et al.  Referral system for hard exudates in eye fundus , 2015, Comput. Biol. Medicine.

[5]  Xiao Chen,et al.  A matting method based on full feature coverage , 2018, Multimedia Tools and Applications.

[6]  Juan Humberto Sossa Azuela,et al.  Retinal vessel extraction using Lattice Neural Networks with dendritic processing , 2015, Comput. Biol. Medicine.

[7]  Romany F Mansour,et al.  Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy , 2017, Biomedical Engineering Letters.

[8]  J. Dheeba,et al.  Automatic Detection of Exudates in Color Fundus Retinopathy Images , 2015 .

[9]  Yiteng Pan,et al.  A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation , 2018, Multimedia Tools and Applications.

[10]  Ehsan Rahimy,et al.  Deep learning applications in ophthalmology , 2018, Current opinion in ophthalmology.

[11]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[12]  Somshubra Majumdar,et al.  Microaneurysm detection using fully convolutional neural networks , 2018, Comput. Methods Programs Biomed..

[13]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[14]  M. Kavitha,et al.  Hierarchical classifier for soft and hard exudates detection of retinal fundus images , 2014, J. Intell. Fuzzy Syst..

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Terry Taewoong Um,et al.  Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database , 2017, PloS one.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[19]  U. Rajendra Acharya,et al.  Segmentation of optic disc, fovea and retinal vasculature using a single convolutional neural network , 2017, J. Comput. Sci..

[20]  Dwarikanath Mahapatra,et al.  A novel hybrid approach for severity assessment of Diabetic Retinopathy in colour fundus images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[22]  Hikmet Kerem Cigizoglu,et al.  Generalized regression neural network in modelling river sediment yield , 2006, Adv. Eng. Softw..

[23]  Enrique V. Carrera,et al.  Automated detection of diabetic retinopathy using SVM , 2017, 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON).

[24]  Chengdong Wu,et al.  Automatic Microaneurysm Detection Using the Sparse Principal Component Analysis-Based Unsupervised Classification Method , 2017, IEEE Access.

[25]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[26]  Haibo Mi,et al.  Deep Convolutional Neural Network-Based Early Automated Detection of Diabetic Retinopathy Using Fundus Image , 2017, Molecules.

[27]  Lei Zhang,et al.  Multi-level deep supervised networks for retinal vessel segmentation , 2017, International Journal of Computer Assisted Radiology and Surgery.

[28]  S. Vijayachitra,et al.  Early detection and classification of microaneurysms in retinal fundus images using sequential learning methods , 2014 .

[29]  Oscar Perdomo,et al.  Convolutional network to detect exudates in eye fundus images of diabetic subjects , 2017, Symposium on Medical Information Processing and Analysis.

[30]  Xiaogang Li,et al.  Convolutional neural networks based transfer learning for diabetic retinopathy fundus image classification , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[31]  Tien Yin Wong,et al.  Artificial Intelligence With Deep Learning Technology Looks Into Diabetic Retinopathy Screening. , 2016, JAMA.

[32]  Nanning Zheng,et al.  New hierarchical approach for microaneurysms detection with matched filter and machine learning , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Fouad Khelifi,et al.  Detection and classification of retinal fundus images exudates using region based multiscale LBP texture approach , 2016, 2016 International Conference on Control, Decision and Information Technologies (CoDIT).

[34]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using convolutional neural networks , 2015, 2015 9th International Symposium on Image and Signal Processing and Analysis (ISPA).

[35]  B. Sandeep,et al.  Machine learning approach for the identification of diabetes retinopathy and its stages , 2015, 2015 International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT).

[36]  Kazuhide Matsunaga,et al.  Effectiveness of an Interdisciplinary Medical Hospital Admission Center: The Role of the Dental Section in the Interdisciplinary System for Perioperative Management of Patients Awaiting Surgery , 2017, Journal of Medical Systems.

[37]  Qaisar Abbas,et al.  Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features , 2017, Medical & Biological Engineering & Computing.

[38]  U. Rajendra Acharya,et al.  Computer-aided diabetic retinopathy detection using trace transforms on digital fundus images , 2014, Medical & Biological Engineering & Computing.

[39]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[40]  G. Mahendran,et al.  Investigation of the severity level of diabetic retinopathy using supervised classifier algorithms , 2015, Comput. Electr. Eng..

[41]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[42]  Amira S. Ashour,et al.  Combined empirical mode decomposition and texture features for skin lesion classification using quadratic support vector machine , 2017, Health Information Science and Systems.

[43]  Miloš Oravec,et al.  Diabetic Rethinopathy Screening by Bright Lesions Extraction from Fundus Images , 2013 .

[44]  Mustafa Mumtaz,et al.  Automatic detection of retinal hemorrhages by exploiting image processing techniques for screening retinal diseases in diabetic patients , 2017, International Journal of Diabetes in Developing Countries.

[45]  Nigel M. Bolster,et al.  A review of feature-based retinal image analysis , 2017 .

[46]  J. Dheeba,et al.  Detection of Hard Exudates in Colour Fundus Images Using Fuzzy Support Vector Machine-Based Expert System , 2015, Journal of Digital Imaging.

[47]  U. Rajendra Acharya,et al.  Automated segmentation of exudates, haemorrhages, microaneurysms using single convolutional neural network , 2017, Inf. Sci..

[48]  Grading diabetic retinopathy from stereoscopic color fundus photographs--an extension of the modified Airlie House classification. ETDRS report number 10. Early Treatment Diabetic Retinopathy Study Research Group. , 1991, Ophthalmology.

[49]  Di Xiao,et al.  Exudate detection for diabetic retinopathy with convolutional neural networks , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[50]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[51]  Arunkumar Rajendran,et al.  Multi-retinal disease classification by reduced deep learning features , 2017, Neural Computing and Applications.

[52]  Yiteng Pan,et al.  A novel region-based active contour model via local patch similarity measure for image segmentation , 2018, Multimedia Tools and Applications.

[53]  Tien Yin Wong,et al.  Detecting retinal microaneurysms and hemorrhages with robustness to the presence of blood vessels , 2017, Comput. Methods Programs Biomed..

[54]  Sven Loncaric,et al.  Weighted ensemble based automatic detection of exudates in fundus photographs , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  S. Edward Rajan,et al.  Computerized screening of diabetic retinopathy employing blood vessel segmentation in retinal images , 2014 .

[56]  Zhitao Xiao,et al.  Automatic non-proliferative diabetic retinopathy screening system based on color fundus image , 2017, Biomedical engineering online.

[57]  R. Vanithamani,et al.  Exudates in Detection and Classification of Diabetic Retinopathy , 2016, SoCPaR.

[58]  Saeid Sanei,et al.  Localizing Microaneurysms in Fundus Images Through Singular Spectrum Analysis , 2017, IEEE Transactions on Biomedical Engineering.

[59]  Tao Li,et al.  Lesion Detection and Grading of Diabetic Retinopathy via Two-Stages Deep Convolutional Neural Networks , 2017, MICCAI.

[60]  B. Uyyanonvara,et al.  Automated microaneurysm detection algorithms applied to diabetic retinopathy retinal images , 2013 .

[61]  Shilpa Joshi,et al.  A review on exudates detection methods for diabetic retinopathy. , 2018, Biomedicine & pharmacotherapy = Biomedecine & pharmacotherapie.

[62]  Gongping Yang,et al.  Hierarchical retinal blood vessel segmentation based on feature and ensemble learning , 2015, Neurocomputing.

[63]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[64]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion , 2016, Comput. Methods Programs Biomed..

[65]  C. Sinthanayothin,et al.  Automated detection of diabetic retinopathy on digital fundus images , 2002, Diabetic medicine : a journal of the British Diabetic Association.

[66]  Shuang Yu,et al.  Retinal hemorrhage detection by rule-based and machine learning approach , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[67]  Somsak Choomchuay,et al.  Detection of lesions and classification of diabetic retinopathy using fundus images , 2016, 2016 9th Biomedical Engineering International Conference (BMEiCON).

[68]  R. Simó,et al.  Genetics in Diabetic Retinopathy: Current Concepts and New Insights , 2013, Current genomics.

[69]  Kuntal Ghosh,et al.  Automatic detection and classification of diabetic retinopathy stages using CNN , 2017, 2017 4th International Conference on Signal Processing and Integrated Networks (SPIN).

[70]  R. Yuste,et al.  Comparison Between Supervised and Unsupervised Classifications of Neuronal Cell Types: A Case Study , 2010, Developmental neurobiology.

[71]  Chengdong Wu,et al.  Automatic Microaneurysms Detection Based on Multifeature Fusion Dictionary Learning , 2017, Comput. Math. Methods Medicine.

[72]  Huiqun Wu,et al.  Automatic Screening of Diabetic Retinopathy Images with Convolution Neural Network Based on Caffe Framework , 2017, ICMHI.

[73]  Praveen Vashist,et al.  Role of Early Screening for Diabetic Retinopathy in Patients with Diabetes Mellitus: An Overview , 2011, Indian journal of community medicine : official publication of Indian Association of Preventive & Social Medicine.

[74]  Khaled Elleithy,et al.  Retinal Vessels Segmentation Techniques and Algorithms: A Survey , 2018 .

[75]  Halima Mahjoubi,et al.  Improvement of displacement estimation of breast tissue in ultrasound elastography using the monogenic signal , 2017, BioMedical Engineering OnLine.

[76]  José Manuel Bravo,et al.  A tool for automated diabetic retinopathy pre-screening based on retinal image computer analysis , 2017, Comput. Biol. Medicine.

[77]  Dattatray V. Jadhav,et al.  Early Stage Detection of Diabetic Retinopathy Using an Optimal Feature Set , 2017, SIRS.

[78]  Sonam Singh,et al.  A fully convolutional neural network based structured prediction approach towards the retinal vessel segmentation , 2016, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[79]  Hude Quan,et al.  Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa , 2009, BMC medical research methodology.

[80]  Muhammad Moazam Fraz,et al.  Multiscale segmentation of exudates in retinal images using contextual cues and ensemble classification , 2017, Biomed. Signal Process. Control..

[81]  Buket D. Barkana,et al.  Performance analysis of descriptive statistical features in retinal vessel segmentation via fuzzy logic, ANN, SVM, and classifier fusion , 2017, Knowl. Based Syst..

[82]  Guo Li,et al.  Exudate Detection in Fundus Images via Convolutional Neural Network , 2017, IFTC.

[83]  S. Vijayachitra,et al.  A SEQUENTIAL LEARNING METHOD FOR DETECTION AND CLASSIFICATION OF EXUDATES IN RETINAL IMAGES TO ASSESS DIABETIC RETINOPATHY , 2014 .

[84]  Ukrit Watchareeruetai,et al.  Detection of cotton wool for diabetic retinopathy analysis using neural network , 2017, 2017 IEEE 10th International Workshop on Computational Intelligence and Applications (IWCIA).

[85]  D. Jude Hemanth,et al.  Diabetic Retinopathy Diagnosis in Retinal Images Using Hopfield Neural Network , 2016 .

[86]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[87]  Gernot A. Fink,et al.  Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[88]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[89]  Qiang Wu,et al.  Hard exudates segmentation based on learned initial seeds and iterative graph cut , 2018, Comput. Methods Programs Biomed..

[90]  M. Al-Jarrah,et al.  Non-proliferative diabetic retinopathy symptoms detection and classification using neural network , 2017, Journal of medical engineering & technology.

[91]  Silvio Silvério da Silva,et al.  Biosurfactants produced by Scheffersomyces stipitis cultured in sugarcane bagasse hydrolysate as new green larvicides for the control of Aedes aegypti, a vector of neglected tropical diseases , 2017, PloS one.

[92]  Ümit Budak,et al.  A novel microaneurysms detection approach based on convolutional neural networks with reinforcement sample learning algorithm , 2017, Health Inf. Sci. Syst..

[93]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[94]  Xiaogang Wang,et al.  DeepID-Net: multi-stage and deformable deep convolutional neural networks for object detection , 2014, ArXiv.

[95]  Lin Li,et al.  A Deep Learning Method for Microaneurysm Detection in Fundus Images , 2016, 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[96]  Bálint Antal,et al.  An ensemble-based system for automatic screening of diabetic retinopathy , 2014, Knowl. Based Syst..

[97]  Yusuke Arai,et al.  Applying artificial intelligence to disease staging: Deep learning for improved staging of diabetic retinopathy , 2017, PloS one.

[98]  Prachi Gharpure,et al.  Diabetic retinopathy detection using deep convolutional neural networks , 2016, 2016 International Conference on Computing, Analytics and Security Trends (CAST).

[99]  Yang Zhang,et al.  Development of a UPLC-TQ/MS Approach for the Determination of Eleven Bioactive Components in Haizao Yuhu Decoction Plus-Minus Haizao and Gancao Drug Combination after Oral Administration in a Rat Model of Hypothyroidism , 2016, Molecules.

[100]  B. M. Patre,et al.  A clustering approach for exudates detection in screening of diabetic retinopathy , 2016, 2016 International Conference on Signal and Information Processing (IConSIP).

[101]  Bram van Ginneken,et al.  Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images , 2016, IEEE Transactions on Medical Imaging.

[102]  P. Alli,et al.  A Machine Learning Ensemble Classifier for Early Prediction of Diabetic Retinopathy , 2017, Journal of Medical Systems.

[103]  D. Manimegalai,et al.  Segmentation and classification of bright lesions to diagnose diabetic retinopathy in retinal images , 2016, Biomedizinische Technik. Biomedical engineering.

[104]  Matthew B. Blaschko,et al.  An ensemble deep learning based approach for red lesion detection in fundus images , 2017, Comput. Methods Programs Biomed..

[105]  H. Kolb Simple Anatomy of the Retina , 2012 .

[106]  D. V. Jadhav,et al.  Hybrid classifier and region-dependent integrated features for detection of diabetic retinopathy , 2017, J. Intell. Fuzzy Syst..

[107]  Mussarat Yasmin,et al.  A Review on Recent Developments for Detection of Diabetic Retinopathy , 2016, Scientifica.

[108]  Dilip Singh Sisodia,et al.  Diabetic Retinal Fundus Images: Preprocessing and Feature Extraction for Early Detection of Diabetic Retinopathy , 2017 .