Diabetic Retinal Grading Using Attention-Based Bilinear Convolutional Neural Network and Complement Cross Entropy

Diabetic retinopathy (DR) is a common complication of diabetes mellitus (DM), and it is necessary to diagnose DR in the early stages of treatment. With the rapid development of convolutional neural networks in the field of image processing, deep learning methods have achieved great success in the field of medical image processing. Various medical lesion detection systems have been proposed to detect fundus lesions. At present, in the image classification process of diabetic retinopathy, the fine-grained properties of the diseased image are ignored and most of the retinopathy image data sets have serious uneven distribution problems, which limits the ability of the network to predict the classification of lesions to a large extent. We propose a new non-homologous bilinear pooling convolutional neural network model and combine it with the attention mechanism to further improve the network’s ability to extract specific features of the image. The experimental results show that, compared with the most popular fundus image classification models, the network model we proposed can greatly improve the prediction accuracy of the network while maintaining computational efficiency.

[1]  U. Rajendra Acharya,et al.  Application of Higher Order Spectra for the Identification of Diabetes Retinopathy Stages , 2008, Journal of Medical Systems.

[2]  Xiaohui Zhang,et al.  Detection and classification of bright lesions in color fundus images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Pablo Andrés Arbeláez,et al.  Automatic diabetic retinopathy classification , 2017, Symposium on Medical Information Processing and Analysis.

[4]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Hung T. Nguyen,et al.  Classification of diabetic retinopathy using neural networks , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Pietro Perona,et al.  The Caltech-UCSD Birds-200-2011 Dataset , 2011 .

[8]  Moongu Jeon,et al.  Imbalanced Image Classification with Complement Cross Entropy , 2020, Pattern Recognit. Lett..

[9]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[10]  Diogo Almeida,et al.  Resnet in Resnet: Generalizing Residual Architectures , 2016, ArXiv.

[11]  Alex Varghese,et al.  Ensemble of Convolutional Neural Networks for Automatic Grading of Diabetic Retinopathy and Macular Edema , 2018, ArXiv.

[12]  Tao Mei,et al.  Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Zhiguang Wang,et al.  Diabetic Retinopathy Detection via Deep Convolutional Networks for Discriminative Localization and Visual Explanation , 2017, AAAI Workshops.

[15]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Subhransu Maji,et al.  Bilinear Convolutional Neural Networks for Fine-Grained Visual Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Chanjira Sinthanayothin,et al.  Automated screening system for diabetic retinopathy , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[18]  Emilio Soria Olivas,et al.  Handbook of Research on Machine Learning Applications and Trends : Algorithms , Methods , and Techniques , 2009 .

[19]  Xiaohui Zhang,et al.  Top-down and bottom-up strategies in lesion detection of background diabetic retinopathy , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Hanwang Zhang,et al.  Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect , 2020, NeurIPS.

[23]  Shuqian Luo,et al.  Support vector machine based method for identifying hard exudates in retinal images , 2009, 2009 IEEE Youth Conference on Information, Computing and Telecommunication.

[24]  Marios S. Pattichis,et al.  Automatic system for diabetic retinopathy screening based on AM-FM, partial least squares, and support vector machines , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  Ana Maria Mendonça,et al.  DR|GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images , 2020, Medical Image Anal..

[26]  Marcus Rohrbach,et al.  Decoupling Representation and Classifier for Long-Tailed Recognition , 2020, ICLR.

[27]  Jialin Peng,et al.  Medical Image Segmentation With Limited Supervision: A Review of Deep Network Models , 2021, IEEE Access.

[28]  Li Chen,et al.  BiRA-Net: Bilinear Attention Net for Diabetic Retinopathy Grading , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[29]  Xiaohui Zhang,et al.  A SVM approach for detection of hemorrhages in background diabetic retinopathy , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[30]  Xiaoli Li,et al.  Sea-Net: Squeeze-And-Excitation Attention Net For Diabetic Retinopathy Grading , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[31]  Xiu-Shen Wei,et al.  BBN: Bilateral-Branch Network With Cumulative Learning for Long-Tailed Visual Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).