Residual-CycleGAN based Camera Adaptation for Robust Diabetic Retinopathy Screening

There are extensive researches focusing on automated diabetic retinopathy (DR) detection from fundus images. However, the accuracy drop is observed when applying these models in real-world DR screening, where the fundus camera brands are different from the ones used to capture the training images. How can we train a classification model on labeled fundus images acquired from only one camera brand, yet still achieves good performance on images taken by other brands of cameras? In this paper, we quantitatively verify the impact of fundus camera brands related domain shift on the performance of DR classification models, from an experimental perspective. Further, we propose camera-oriented residual-CycleGAN to mitigate the camera brand difference by domain adaptation and achieve increased classification performance on target camera images. Extensive ablation experiments on both the EyePACS dataset and a private dataset show that the camera brand difference can significantly impact the classification performance and prove that our proposed method can effectively improve the model performance on the target domain. We have inferred and labeled the camera brand for each image in the EyePACS dataset and will publicize the camera brand labels for further research on domain adaptation.

[1]  A. Piva An Overview on Image Forensics , 2013 .

[2]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[3]  M. Abràmoff,et al.  Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices , 2018, npj Digital Medicine.

[4]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[5]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[6]  Gabriela Csurka,et al.  Deep Visual Domain Adaptation , 2020, 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC).

[7]  Michael Kampffmeyer,et al.  Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratio , 2018, MICCAI.

[8]  J. Keeffe,et al.  Diabetic retinopathy management guidelines , 2012 .

[9]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Peng Liu,et al.  CFEA: Collaborative Feature Ensembling Adaptation for Domain Adaptation in Unsupervised Optic Disc and Cup Segmentation , 2019, MICCAI.

[11]  A. Motala,et al.  Global estimates of undiagnosed diabetes in adults. , 2014, Diabetes research and clinical practice.

[12]  Gabriela Csurka,et al.  Domain Adaptation for Visual Applications: A Comprehensive Survey , 2017, ArXiv.

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  Tao Li,et al.  Lesion Detection and Grading of Diabetic Retinopathy via Two-Stages Deep Convolutional Neural Networks , 2017, MICCAI.

[15]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[16]  H R Taylor,et al.  Prevalence of diabetic retinopathy in Type 2 diabetes in developing and developed countries , 2013, Diabetic medicine : a journal of the British Diabetic Association.

[17]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[18]  Xin Qi,et al.  Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images , 2018, MICCAI.

[19]  Nico Karssemeijer,et al.  Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation , 2017, MICCAI.

[20]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[21]  Davide Cozzolino,et al.  Noiseprint: A CNN-Based Camera Model Fingerprint , 2018, IEEE Transactions on Information Forensics and Security.