Assessment of central serous chorioretinopathy (CSC) depicted on color fundus photographs using deep Learning

PURPOSE To investigate whether and to what extent central serous chorioretinopathy (CSC) depicted on color fundus photographs can be assessed using deep learning technology. METHODS We collected a total of 2,504 fundus images acquired on different subjects. We verified the CSC status of these images using their corresponding optical coherence tomography images. A total of 1,329 images depicted CSC. These images were preprocessed and normalized. This resulting data set was randomly split into three parts in the ratio of 8:1:1, respectively, for training, validation, and testing purposes. We used the deep learning architecture termed Inception-V3 to train the classifier. We performed nonparametric receiver operating characteristic analyses to assess the capability of the developed algorithm to identify CSC. To study the inter-reader variability and compare the performance of the computerized scheme and human experts, we asked two ophthalmologists (i.e., Rater #1 and #2) to independently review the same testing data set in a blind manner. We assessed the performance difference between the computer algorithms and the two experts using the receiver operating characteristic curves and computed their pair-wise agreements using Cohen's Kappa coefficients. RESULTS The areas under the receiver operating characteristic curve for the computer, Rater #1, and Rater #2 were 0.934 (95% confidence interval = 0.905-0.963), 0.859 (95% confidence interval = 0.809-0.908), and 0.725 (95% confidence interval = 0.662-0.788). The Kappa coefficient between the two raters was 0.48 (P < 0.001), while the Kappa coefficients between the computer and the two raters were 0.59 (P < 0.001) and 0.33 (P < 0.05). CONCLUSION Our experiments showed that the computer algorithm based on deep learning can assess CSC depicted on color fundus photographs in a relatively reliable and consistent way.

[1]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[2]  Jay S Duker,et al.  Association of Choroidal Neovascularization and Central Serous Chorioretinopathy With Optical Coherence Tomography Angiography. , 2015, JAMA ophthalmology.

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[7]  C. A. Murthy,et al.  Hue-preserving color image enhancement without gamut problem , 2003, IEEE Trans. Image Process..

[8]  Taimur Hassan,et al.  Fully Automated Robust System to Detect Retinal Edema, Central Serous Chorioretinopathy, and Age Related Macular Degeneration from Optical Coherence Tomography Images , 2017, BioMed research international.

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  David Gur,et al.  An ellipse-fitting based method for efficient registration of breast masses on two mammographic views. , 2008, Medical physics.

[11]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[12]  Taimur Hassan,et al.  Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces , 2016, Comput. Methods Programs Biomed..

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[15]  Michael V. McConnell,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[16]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[17]  Min Zhao,et al.  Central serous chorioretinopathy: Recent findings and new physiopathology hypothesis , 2015, Progress in Retinal and Eye Research.

[18]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.