Comparing humans and deep learning performance for grading AMD: A study in using universal deep features and transfer learning for automated AMD analysis

BACKGROUND When left untreated, age-related macular degeneration (AMD) is the leading cause of vision loss in people over fifty in the US. Currently it is estimated that about eight million US individuals have the intermediate stage of AMD that is often asymptomatic with regard to visual deficit. These individuals are at high risk for progressing to the advanced stage where the often treatable choroidal neovascular form of AMD can occur. Careful monitoring to detect the onset and prompt treatment of the neovascular form as well as dietary supplementation can reduce the risk of vision loss from AMD, therefore, preferred practice patterns recommend identifying individuals with the intermediate stage in a timely manner. METHODS Past automated retinal image analysis (ARIA) methods applied on fundus imagery have relied on engineered and hand-designed visual features. We instead detail the novel application of a machine learning approach using deep learning for the problem of ARIA and AMD analysis. We use transfer learning and universal features derived from deep convolutional neural networks (DCNN). We address clinically relevant 4-class, 3-class, and 2-class AMD severity classification problems. RESULTS Using 5664 color fundus images from the NIH AREDS dataset and DCNN universal features, we obtain values for accuracy for the (4-, 3-, 2-) class classification problem of (79.4%, 81.5%, 93.4%) for machine vs. (75.8%, 85.0%, 95.2%) for physician grading. DISCUSSION This study demonstrates the efficacy of machine grading based on deep universal features/transfer learning when applied to ARIA and is a promising step in providing a pre-screener to identify individuals with intermediate AMD and also as a tool that can facilitate identifying such individuals for clinical studies aimed at developing improved therapies. It also demonstrates comparable performance between computer and physician grading.

[1]  Johanna M Seddon,et al.  Potential public health impact of Age-Related Eye Disease Study results: AREDS report no. 11. , 2003, Archives of ophthalmology.

[2]  Steffen Schmitz-Valckenberg,et al.  Geographic atrophy: clinical features and potential therapeutic approaches. , 2014, Ophthalmology.

[3]  Philippe Burlina,et al.  Automated segmentation of geographic atrophy of the retinal epithelium via random forests in AREDS color fundus images , 2015, Comput. Biol. Medicine.

[4]  M. Tolentino,et al.  Drugs in Phase II clinical trials for the treatment of age-related macular degeneration , 2015, Expert opinion on investigational drugs.

[5]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Philippe Burlina,et al.  Detection of age-related macular degeneration via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[9]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[10]  Jennifer I. Lim,et al.  A randomized, placebo-controlled, clinical trial of high-dose supplementation with vitamins C and E, beta carotene, and zinc for age-related macular degeneration and vision loss: AREDS report no. 8. , 2001, Archives of ophthalmology.

[11]  P T de Jong,et al.  An international classification and grading system for age-related maculopathy and age-related macular degeneration , 1995 .

[12]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[13]  Philippe Burlina,et al.  Evaluation of automated drusen detection system for fundus photographs of patients with age-related macular degeneration , 2016 .

[14]  N. Bressler Age-related macular degeneration is the leading cause of blindness... , 2004, JAMA.

[15]  Philippe Burlina,et al.  Automated detection of drusen in the macula , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[19]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Rama Chellappa,et al.  Detection of people in images , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[22]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Michael Stur,et al.  Effect of lesion size, visual acuity, and lesion composition on visual acuity change with and without verteporfin therapy for choroidal neovascularization secondary to age-related macular degeneration: TAP and VIP report no. 1. , 2003, American journal of ophthalmology.

[25]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[26]  Philippe Burlina,et al.  Automatic screening of age-related macular degeneration and retinal abnormalities , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[28]  Frederick L Ferris,et al.  Change in area of geographic atrophy in the Age-Related Eye Disease Study: AREDS report number 26. , 2009, Archives of ophthalmology.

[29]  Dinesh Kumar,et al.  Validating retinal fundus image analysis algorithms: issues and a proposal. , 2013, Investigative ophthalmology & visual science.

[30]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[31]  Tien Yin Wong,et al.  Ophthalmology 1 Age-related macular degeneration , 2012 .

[32]  Neil M Bressler,et al.  Vision-related function after ranibizumab treatment by better- or worse-seeing eye: clinical trial results from MARINA and ANCHOR. , 2010, Ophthalmology.