Data Diversity in Convolutional Neural Network Based Ensemble Model for Diabetic Retinopathy

The medical and healthcare domains require automatic diagnosis systems (ADS) for the identification of health problems with technological advancements. Biomedical imaging is one of the techniques used in computer-aided diagnosis systems. Ophthalmologists examine fundus images (FI) to detect and classify stages of diabetic retinopathy (DR). DR is a chronic disease that appears in patients with long-term diabetes. Unattained patients can lead to severe conditions of DR, such as retinal eye detachments. Therefore, early detection and classification of DR are crucial to ward off advanced stages of DR and preserve the vision. Data diversity in an ensemble model refers to the use of multiple models trained on different subsets of data to improve the ensemble’s overall performance. In the context of an ensemble model based on a convolutional neural network (CNN) for diabetic retinopathy, this could involve training multiple CNNs on various subsets of retinal images, including images from different patients or those captured using distinct imaging techniques. By combining the predictions of these multiple models, the ensemble model can potentially make more accurate predictions than a single prediction. In this paper, an ensemble model (EM) of three CNN models is proposed for limited and imbalanced DR data using data diversity. Detecting the Class 1 stage of DR is important to control this fatal disease in time. CNN-based EM is incorporated to classify the five classes of DR while giving attention to the early stage, i.e., Class 1. Furthermore, data diversity is created by applying various augmentation and generation techniques with affine transformation. Compared to the single model and other existing work, the proposed EM has achieved better multi-class classification accuracy, precision, sensitivity, and specificity of 91.06%, 91.00%, 95.01%, and 98.38%, respectively.

[1]  F. Fatmawati,et al.  Image Fundus Classification System for Diabetic Retinopathy Stage Detection Using Hybrid CNN-DELM , 2022, Big Data Cogn. Comput..

[2]  M. Akram,et al.  A Deep Learning Based Approach for Grading of Diabetic Retinopathy Using Large Fundus Image Dataset , 2022, Diagnostics.

[3]  Mukesh Kumar,et al.  Optimized Stacking Ensemble Learning Model for Breast Cancer Detection and Classification Using Machine Learning , 2022, Sustainability.

[4]  M. A. Shah,et al.  Traffic Flow Prediction: An Intelligent Scheme for Forecasting Traffic Flow Using Air Pollution Data in Smart Cities with Bagging Ensemble , 2022, Sustainability.

[5]  Soyoung Park,et al.  Robust Spatiotemporal Estimation of PM Concentrations Using Boosting-Based Ensemble Models , 2021, Sustainability.

[6]  Xiangbin Liu,et al.  A Review of Deep-Learning-Based Medical Image Segmentation Methods , 2021, Sustainability.

[7]  Zhang Junming,et al.  Ensemble Framework of Deep CNNs for Diabetic Retinopathy Detection , 2020, Comput. Intell. Neurosci..

[8]  B. Datta,et al.  Performance Evaluation of Homogeneous and Heterogeneous Ensemble Models for Groundwater Salinity Predictions: a Regional-Scale Comparison Study , 2020, Water, Air, & Soil Pollution.

[9]  V. Sudha,et al.  Diabetic Retinopathy Detection , 2020, International Journal of Engineering and Advanced Technology.

[10]  Saket S. Chaturvedi,et al.  Automated Diabetic Retinopathy Grading using Deep Convolutional Neural Network , 2020, ArXiv.

[11]  Bernadette Dorizzi,et al.  Diabetic retinopathy detection using red lesion localization and convolutional neural networks , 2019, Comput. Biol. Medicine.

[12]  Pheng-Ann Heng,et al.  CANet: Cross-Disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading , 2019, IEEE Transactions on Medical Imaging.

[13]  Shahaboddin Shamshirband,et al.  A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection , 2019, IEEE Access.

[14]  Song Guo,et al.  Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening , 2019, Inf. Sci..

[15]  Kang Yang,et al.  An Interpretable Ensemble Deep Learning Model for Diabetic Retinopathy Disease Classification , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  Andras Hajdu,et al.  Automatic screening of fundus images using a combination of convolutional neural network and hand-crafted features , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Naeem Khalid Janjua,et al.  Going Deep in Medical Image Analysis: Concepts, Methods, Challenges, and Future Directions , 2019, IEEE Access.

[18]  Hayit Greenspan,et al.  An Adversarial Learning Approach to Medical Image Synthesis for Lesion Detection , 2018, IEEE Journal of Biomedical and Health Informatics.

[19]  Hui Li,et al.  Research and development of neural network ensembles: a survey , 2018, Artificial Intelligence Review.

[20]  Haibo Mi,et al.  Deep Convolutional Neural Network-Based Early Automated Detection of Diabetic Retinopathy Using Fundus Image , 2017, Molecules.

[21]  Zhiming Luo,et al.  An Ensemble Deep Learning Method for Vehicle Type Classification on Visual Traffic Surveillance Sensors , 2017, IEEE Access.

[22]  Syed Muhammad Anwar,et al.  Medical Image Analysis using Convolutional Neural Networks: A Review , 2017, Journal of Medical Systems.

[23]  Xiang Li,et al.  Two are Better than One: An Ensemble of Retrieval- and Generation-Based Dialog Systems , 2016, ArXiv.

[24]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.

[25]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[26]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[27]  Vadlamani Ravi,et al.  Diabetic Retinopathy Detection Using Transfer Learning and Deep Learning , 2020, FICTA.

[28]  W. Shalash,et al.  Diabetic retinopathy detection through deep learning techniques: A review , 2020, Informatics in Medicine Unlocked.

[29]  M. T. Esfahani,et al.  Classification of diabetic and normal fundus images using new deep learning method , 2018 .

[30]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[31]  Laude,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[32]  Christopher Hunt SURF: Speeded-Up Robust Features , 2009 .

[33]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .