Fully automated, deep learning segmentation of oxygen-induced retinopathy images.

Oxygen-induced retinopathy (OIR) is a widely used model to study ischemia-driven neovascularization (NV) in the retina and to serve in proof-of-concept studies in evaluating antiangiogenic drugs for ocular, as well as nonocular, diseases. The primary parameters that are analyzed in this mouse model include the percentage of retina with vaso-obliteration (VO) and NV areas. However, quantification of these two key variables comes with a great challenge due to the requirement of human experts to read the images. Human readers are costly, time-consuming, and subject to bias. Using recent advances in machine learning and computer vision, we trained deep learning neural networks using over a thousand segmentations to fully automate segmentation in OIR images. While determining the percentage area of VO, our algorithm achieved a similar range of correlation coefficients to that of expert inter-human correlation coefficients. In addition, our algorithm achieved a higher range of correlation coefficients compared with inter-expert correlation coefficients for quantification of the percentage area of neovascular tufts. In summary, we have created an open-source, fully automated pipeline for the quantification of key values of OIR images using deep learning neural networks.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jing Chen,et al.  The mouse retina as an angiogenesis model. , 2010, Investigative ophthalmology & visual science.

[7]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[8]  A. Stahl,et al.  Computer-aided quantification of retinal neovascularization , 2009, Angiogenesis.

[9]  Andreas Stahl,et al.  Quantification of oxygen-induced retinopathy in the mouse: a model of vessel loss, vessel regrowth and pathological angiogenesis , 2009, Nature Protocols.

[10]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[11]  Gordon C Jayson,et al.  Antiangiogenic therapy in oncology: current status and future directions , 2016, The Lancet.

[12]  Shinsuke Nakamura,et al.  Morphological and Functional Changes in the Retina after Chronic Oxygen-Induced Retinopathy , 2012, PloS one.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  George N. Lambrou,et al.  Automated Objective Quantification of Vascular Morphology in Rodent Oxygen-induced Retinopathy , 2003 .

[15]  Marcus Fruttiger,et al.  Quantification of vascular tortuosity as an early outcome measure in oxygen induced retinopathy (OIR). , 2014, Experimental eye research.

[16]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[17]  Sven Loncaric,et al.  Segmentation of the foveal microvasculature using deep learning networks , 2016, Journal of biomedical optics.

[18]  Lois E. H. Smith,et al.  Oxygen-induced retinopathy in the mouse. , 1994, Investigative ophthalmology & visual science.

[19]  George N. Lambrou,et al.  Validation of a Novel Automated System for the Quantification of Capillary Non-Perfusion Areas in the Retina of Rats With Oxygen-Induced Retinopathy (OIR) , 2003 .

[20]  Martin Friedlander,et al.  T2-TrpRS inhibits preretinal neovascularization and enhances physiological vascular regrowth in OIR as assessed by a new method of quantification. , 2006, Investigative ophthalmology & visual science.

[21]  Andreas Stahl Anti-Angiogenic Therapy in Ophthalmology , 2016 .

[22]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[23]  Jing Chen,et al.  Postnatal weight gain modifies severity and functional outcome of oxygen-induced proliferative retinopathy. , 2010, The American journal of pathology.