Cost-Sensitive Regularization for Diabetic Retinopathy Grading from Eye Fundus Images

Assessing the degree of disease severity in biomedical images is a task similar to standard classification but constrained by an underlying structure in the label space. Such a structure reflects the monotonic relationship between different disease grades. In this paper, we propose a straightforward approach to enforce this constraint for the task of predicting Diabetic Retinopathy (DR) severity from eye fundus images based on the well-known notion of Cost-Sensitive classification. We expand standard classification losses with an extra term that acts as a regularizer, imposing greater penalties on predicted grades when they are farther away from the true grade associated to a particular image. Furthermore, we show how to adapt our method to the modelling of label noise in each of the sub-problems associated to DR grading, an approach we refer to as Atomic Sub-Task modeling. This yields models that can implicitly take into account the inherent noise present in DR grade annotations. Our experimental analysis on several public datasets reveals that, when a standard Convolutional Neural Network is trained using this simple strategy, improvements of 3-5\% of quadratic-weighted kappa scores can be achieved at a negligible computational cost. Code to reproduce our results is released at this https URL.

[1]  Adrian Galdran,et al.  A Weakly-Supervised Framework for Interpretable Diabetic Retinopathy Detection on Retinal Images , 2018, IEEE Access.

[2]  Kimmo Kaski,et al.  Deep Learning Fundus Image Analysis for Diabetic Retinopathy and Macular Edema Grading , 2019, Scientific Reports.

[3]  Matthew D. Davis,et al.  Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. , 2003, Ophthalmology.

[4]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[6]  Jonathan Krause,et al.  Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy , 2017, Ophthalmology.

[7]  David J. Hand,et al.  A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems , 2001, Machine Learning.

[8]  Feng Li,et al.  Automatic Detection of Diabetic Retinopathy in Retinal Fundus Photographs Based on Deep Learning Algorithm , 2019, Translational vision science & technology.

[9]  Lars Ailo Bongo,et al.  Reproduction study using public data of: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs , 2018, PloS one.

[10]  Lars Schmidt-Thieme,et al.  Cost-sensitive learning methods for imbalanced data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[11]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[12]  Hervé Lombaert,et al.  Non-uniform Label Smoothing for Diabetic Retinopathy Grading from Retinal Fundus Images with Deep Neural Networks , 2020, Translational vision science & technology.

[13]  Hossein Mobahi,et al.  Learning with a Wasserstein Loss , 2015, NIPS.

[14]  Li Chen,et al.  BiRA-Net: Bilinear Attention Net for Diabetic Retinopathy Grading , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[15]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[16]  Gabriel Peyré,et al.  Geometric Losses for Distributional Learning , 2019, ICML.

[17]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Aïda Valls,et al.  Weighted kappa loss function for multi-class classification of ordinal data in deep learning , 2018, Pattern Recognit. Lett..

[20]  Ana Maria Mendonça,et al.  DR|GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images , 2020, Medical Image Anal..

[21]  Stéphan Clémençon,et al.  On Bootstrapping the ROC Curve , 2008, NIPS.

[22]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[23]  Yaojie Lu,et al.  Cost-sensitive Regularization for Label Confusion-aware Event Detection , 2019, ACL.

[24]  Tien Yin Wong,et al.  Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. , 2019, The Lancet. Digital health.