Hybrid deep learning convolutional neural networks and optimal nonlinear support vector machine to detect presence of hemorrhage in retina

Abstract Diabetic retinopathy is a disorder that occurs in retina and it is caused by diabetes mellitus. Millions of people with diabetic retinopathy are expected to experience a loss of vision across the globe. Therefore, accurate automated-diagnosis systems are highly needed to help physicians in clinical milieu. Though many factors are effective in the diagnosis of diabetic retinopathy, presence of hemorrhage in retina remains one of the most significant factors. We present a three-stage hybrid system for classification of normal and abnormal digital retina images with hemorrhage. First, deep learning convolutional neural networks (CNN) is used for automatic features extraction. Second, the Student t-test is applied to the high dimensional features set extracted by CNN to select the best ten features. Third, the selected CNN-based features are fed to a nonlinear support vector machine (SVM) tuned by Bayes optimization to perform classification task. Three additional popular classifiers are also trained with features extracted by CNN and their performances are compared to that of the optimal nonlinear SVM including linear discriminant analysis (LDA), naive Bayes (NB), and k nearest neighbor (kNN). Each automated-diagnosis system is validated on a database composed of healthy and unhealthy digital retina images affected with various grades of hemorrhage. Experimental results from ten-fold cross-validation methodology show that CNN-SVM outperforms all other three reference systems; namely, CNN-LDA, CNN-NB, and CNN-kNN. Indeed, CNN-SVM system achieved 99.11%±0.0101 accuracy, 99.14%±0.0143 sensitivity, 99.08%±0.0083 specificity, and 0.97.31%± 0.0381 area under curve (AUC) of the receiver operating characteristic. The proposed system is fast and accurate.

[1]  Salim Lahmiri,et al.  Automated pathologies detection in retina digital images based on complex continuous wavelet transform phase angles. , 2014, Healthcare technology letters.

[2]  Hao Chen,et al.  Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[4]  Xin Yang,et al.  A Three-Stage Deep Learning Model for Accurate Retinal Vessel Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Chikkannan Eswaran,et al.  An automated decision-support system for non-proliferative diabetic retinopathy disease based on MAs and HAs detection , 2012, Comput. Methods Programs Biomed..

[8]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[9]  Dinggang Shen,et al.  Anatomical Landmark Based Deep Feature Representation for MR Images in Brain Disease Diagnosis , 2018, IEEE Journal of Biomedical and Health Informatics.

[10]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[11]  Salim Lahmiri,et al.  Automated detection of circinate exudates in retina digital images using empirical mode decomposition and the entropy and uniformity of the intrinsic mode functions , 2014, Biomedizinische Technik. Biomedical engineering.

[12]  Mohammad H. Jafari,et al.  Segmentation of vessels in angiograms using convolutional neural networks , 2018, Biomed. Signal Process. Control..

[13]  Amir Shmuel,et al.  Detection of Parkinson's disease based on voice patterns ranking and optimized support vector machine , 2019, Biomed. Signal Process. Control..

[14]  Salim Lahmiri,et al.  Glioma detection based on multi-fractal features of segmented brain MRI by particle swarm optimization techniques , 2017, Biomed. Signal Process. Control..

[15]  Carmen C. Y. Poon,et al.  Automatic Detection and Classification of Colorectal Polyps by Transferring Low-Level CNN Features From Nonmedical Domain , 2017, IEEE Journal of Biomedical and Health Informatics.

[16]  Kevin Noronha,et al.  Biomedical Signal Processing and Control Automated Classification of Glaucoma Stages Using Higher Order Cumulant Features , 2022 .

[17]  Baidaa Al-Bander,et al.  Multiscale sequential convolutional neural networks for simultaneous detection of fovea and optic disc , 2018, Biomed. Signal Process. Control..

[18]  Mustafa Mumtaz,et al.  Automatic detection of retinal hemorrhages by exploiting image processing techniques for screening retinal diseases in diabetic patients , 2017, International Journal of Diabetes in Developing Countries.

[19]  Cicero Ferreira Fernandes Costa Filho,et al.  Myocardial segmentation in cardiac magnetic resonance images using fully convolutional neural networks , 2018, Biomed. Signal Process. Control..

[20]  Muhammad Younus Javed,et al.  Automated detection of exudates and macula for grading of diabetic macular edema , 2014, Comput. Methods Programs Biomed..

[21]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Hamid Reza Pourreza,et al.  Improvement of retinal blood vessel detection using morphological component analysis , 2015, Comput. Methods Programs Biomed..

[24]  Lin Li,et al.  Microaneurysm Detection Using Principal Component Analysis and Machine Learning Methods , 2018, IEEE Transactions on NanoBioscience.

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[26]  Carla Agurto,et al.  Automated Detection of Malarial Retinopathy in Digital Fundus Images for Improved Diagnosis in Malawian Children with Clinically Defined Cerebral Malaria , 2017, Scientific Reports.

[27]  Agus Harjoko,et al.  Automatic detection of peripapillary atrophy in retinal fundus images using statistical features , 2018, Biomed. Signal Process. Control..

[28]  Dinggang Shen,et al.  A Robust Deep Model for Improved Classification of AD/MCI Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[29]  Marios Anthimopoulos,et al.  Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis , 2016, IEEE journal of biomedical and health informatics.

[30]  He Ma,et al.  An Automatic Detection System of Lung Nodule Based on Multigroup Patch-Based Deep Learning Network , 2018, IEEE Journal of Biomedical and Health Informatics.

[31]  Amir Shmuel,et al.  Variational mode decomposition based approach for accurate classification of color fundus images with hemorrhages , 2017 .

[32]  Amir Shmuel,et al.  Performance of machine learning methods in diagnosing Parkinson’s disease based on dysphonia measures , 2017, Biomedical Engineering Letters.