Diabetic Retinopathy Screening Using Custom-Designed Convolutional Neural Network

The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its progression to advanced levels. As manual screening is timeconsuming and subjective, machine learning (ML) and deep learning (DL) have been employed to aid graders. However, the existing CNN-based methods use either pre-trained CNN models or a brute force approach to design new CNN models, which are not customized to the complexity of fundus images. To overcome this issue, we introduce an approach for custom-design of CNN models, whose architectures are adapted to the structural patterns of fundus images and better represent the DR-relevant features. It takes the leverage of k-medoid clustering, principal component analysis (PCA), and inter-class and intra-class variations to automatically determine the depth and width of a CNN model. The designed models are lightweight, adapted to the internal structures of fundus images, and encode the discriminative patterns of DR lesions. The technique is validated on a local dataset from King Saud University Medical City, Saudi Arabia, and two challenging benchmark datasets from Kaggle: EyePACS and APTOS2019. The custom-designed models outperform the famous pre-trained CNN models like ResNet152, Densnet121, and ResNeSt50 with a significant decrease in the number of parameters and compete well with the state-of-the-art CNN-based DR screening methods. The proposed approach is helpful for DR screening under diverse clinical settings and referring the patients who may need further assessment and treatment to expert ophthalmologists.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Muhammad Hussain,et al.  Deep Learning based Computer-Aided Diagnosis Systems for Diabetic Retinopathy: A Survey , 2018, Artif. Intell. Medicine.

[3]  Zhang Yi,et al.  Diagnosis of Diabetic Retinopathy Using Deep Neural Networks , 2019, IEEE Access.

[4]  Bassam Daya,et al.  Survey on Deep Learning Techniques for Medical Imaging Application Area , 2020 .

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Yung-Hui Li,et al.  Computer-Assisted Diagnosis for Diabetic Retinopathy Based on Fundus Images Using Deep Convolutional Neural Network , 2019, Mob. Inf. Syst..

[7]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[8]  Skylar Stolte,et al.  A survey on medical image analysis in diabetic retinopathy , 2020, Medical Image Anal..

[9]  Chongruo Wu,et al.  ResNeSt: Split-Attention Networks , 2020, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Muhammad Mohsin,et al.  Novel approach of Principal Component Analysis method to assess the national energy performance via Energy Trilemma Index , 2019, Energy Reports.

[11]  Borys Tymchenko,et al.  Deep Learning Approach to Diabetic Retinopathy Detection , 2020, ICPRAM.

[12]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Omer Deperlioglu,et al.  An enhanced diabetic retinopathy detection and classification approach using deep convolutional neural network , 2019, Neural Computing and Applications.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[17]  David Mera,et al.  Towards a Fast and Accurate EIT Inverse Problem Solver: A Machine Learning Approach , 2018, Electronics.

[18]  Trevor Darrell,et al.  Data-dependent Initializations of Convolutional Neural Networks , 2015, ICLR.

[19]  Marcus Liwicki,et al.  PCA-Initialized Deep Neural Networks Applied to Document Image Analysis , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[20]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[21]  Wei Zhang,et al.  Automated identification and grading system of diabetic retinopathy using deep neural networks , 2019, Knowl. Based Syst..

[22]  Arie Ben-David,et al.  Comparison of classification accuracy using Cohen's Weighted Kappa , 2008, Expert Syst. Appl..

[23]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  V. K. Govindan,et al.  Retrieval of pathological retina images using Bag of Visual Words and pLSA model , 2019, Engineering Science and Technology, an International Journal.

[26]  B. Schmauch,et al.  Deep learning approach for diabetic retinopathy screening , 2016 .

[27]  Wei Wu,et al.  BlockQNN: Efficient Block-Wise Neural Network Architecture Generation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  M. Hiscock Handbook of Clinical Child Neuropsychology , 1989, Critical Issues in Neuropsychology.

[29]  Aaron Y. Lee,et al.  Artificial intelligence and deep learning in ophthalmology , 2018, British Journal of Ophthalmology.

[30]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[31]  Sorin Grigorescu,et al.  A Survey of Deep Learning Techniques for Autonomous Driving , 2020, J. Field Robotics.

[32]  Sheikh Muhammad Saiful Islam,et al.  Deep Learning based Early Detection and Grading of Diabetic Retinopathy Using Retinal Fundus Images , 2018, ArXiv.

[33]  Takuya Akiba,et al.  Optuna: A Next-generation Hyperparameter Optimization Framework , 2019, KDD.

[34]  Junhao Wen,et al.  Automatic Detection of Diabetic Retinopathy: A Review on Datasets, Methods and Evaluation Metrics , 2020, IEEE Access.

[35]  Daniel Rubin,et al.  Retinal Lesion Detection With Deep Learning Using Image Patches , 2018, Investigative ophthalmology & visual science.

[36]  Manoranjan Paul,et al.  Deep Learning Models for Retinal Blood Vessels Segmentation: A Review , 2019, IEEE Access.

[37]  Jignesh S. Bhatt,et al.  A Multi-class Deep All-CNN for Detection of Diabetic Retinopathy Using Retinal Fundus Images , 2019, PReMI.

[38]  Abdullah Al Nahid,et al.  Early Blindness Detection Based on Retinal Images Using Ensemble Learning , 2019, 2019 22nd International Conference on Computer and Information Technology (ICCIT).

[39]  Luca Zappella,et al.  Filter Distillation for Network Compression , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[40]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[41]  Qiaoping Zhang,et al.  A New and Efficient K-Medoid Algorithm for Spatial Clustering , 2005, ICCSA.

[42]  B. Klein,et al.  Global Prevalence and Major Risk Factors of Diabetic Retinopathy , 2012, Diabetes Care.

[43]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[45]  Amrita Roy Chowdhury,et al.  A Random Forest classifier-based approach in the detection of abnormalities in the retina , 2018, Medical & Biological Engineering & Computing.