Imaging Features of Vessels and Leakage Patterns Predict Extended Interval Aflibercept Dosing Using Ultra-Widefield Angiography in Retinal Vascular Disease: Findings From the PERMEATE Study

Diabetic Macular Edema (DME) and macular edema secondary to retinal occlusion (RVO) are the two most common retinal vascular causes of visual impairment and leading cause of worldwide vision loss. The blood-retinal barrier is the key barrier for maintaining fluid balance within the retinal tissue. Vascular Endothelial Growth Factor (VEGF) has a significant role in the permeability of the blood-retinal barrier, which also leads to appearance of leakage foci. Intravitreal anti-VEGF therapy is the current gold standard treatment and has been demonstrated to improve macular thickening, improve vision acuity and reduce vascular leakage. However, treatment response and required dosing interval can vary widely across patients. Given the role of the blood-retinal barrier and vascular leakage in the pathogenesis of these disorders, the goal of this study was to present and evaluate new computer extracted features relating to morphology, spatial architecture and tortuosity of vessels and leakages from baseline ultra-widefield fluorescein angiography (UWFA) images. Specifically, we sought to evaluate the role of these computer extracted features from baseline UWFA images. Notably, these UWFA images were obtained from IRB-approved PERMEATE clinical trial [1], [2] to distinguish eyes tolerating extended dosing intervals (n = 16) who are referred to as non-rebounders and those who require more frequent dosing (n = 12) and are called rebounders based on visual acuity loss with extended dosing challenges. A total of 64 features encapsulating different morphological and geometrical attributes of leakage patches including the anatomical (shape, size, density, area, minor and major axis, orientation, area, extent ratio, perimeter, radii) and geometrical characteristics (the proximity of each leakage foci to main vessels, to other leakage foci and to optical disc) as well as 54 tortuosity features (tortuosity of whole vessel network, local tortuosity of vessels in the vicinity of leakage foci) were extracted. The most significant and predictive biomarkers related to treatment response were proximity of leakage nodes to major and minor eye vessels as well as local vasculature tortuosity in the vicinity of the leakages. The imaging features were then used in conjunction with a Linear Discriminant Analysis (LDA) classifier to distinguish rebounders from non-rebounders. The 3-fold cross-validated Area Under Curve (AUC) was found to be 0.82 for the morphological based features and 0.85 for the tortuosity based features. Our findings suggest higher variation in leakage node proximity to retinal vessels in eyes tolerating extended interval dosing. In contrast, eyes with increased local vascular tortuosity demonstrated less tolerance of increased dosing interval. Moreover, a class activation map generated by a deep learning model identified regions that corresponded to regions of leakages proximal to the vessels, providing confirmation of the validity of predictive image features extracted from these regions in this study.

[1]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[2]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[3]  J. Berlin,et al.  Aflibercept—a Decoy VEGF Receptor , 2014, Current Oncology Reports.

[4]  N. Bressler,et al.  Prevalence of and risk factors for diabetic macular edema in the United States. , 2014, JAMA ophthalmology.

[5]  M. Martinez-Castellanos,et al.  Retinal fluorescein angiographic changes following intravitreal anti-VEGF therapy. , 2014, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[6]  S. Wild,et al.  Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. , 2004, Diabetes care.

[7]  Katherine E. Talcott,et al.  Longitudinal Panretinal Leakage and Ischemic Indices in Retinal Vascular Disease after Aflibercept Therapy: The PERMEATE Study. , 2019, Ophthalmology. Retina.

[8]  J. Duker,et al.  Visualization of changes in the foveal avascular zone in both observed and treated diabetic macular edema using optical coherence tomography angiography , 2017, International Journal of Retina and Vitreous.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Quan Dong Nguyen,et al.  Ranibizumab for diabetic macular edema: results from 2 phase III randomized trials: RISE and RIDE. , 2012, Ophthalmology.

[11]  Yoshua Bengio,et al.  Maxout Networks , 2013, ICML.

[12]  Enrico Grisan,et al.  A Novel Method for the Automatic Grading of Retinal Vessel Tortuosity , 2008, IEEE Transactions on Medical Imaging.

[13]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Francesco Bandello,et al.  The RESTORE study: ranibizumab monotherapy or combined with laser versus laser monotherapy for diabetic macular edema. , 2011, Ophthalmology.

[15]  Christian Simader,et al.  The Distribution of Leakage on Fluorescein Angiography in Diabetic Macular Edema: A New Approach to Its Etiology. , 2017, Investigative ophthalmology & visual science.

[16]  Sina Farsiu,et al.  A Quantitative Approach to Predict Differential Effects of Anti-VEGF Treatment on Diffuse and Focal Leakage in Patients with Diabetic Macular Edema: A Pilot Study , 2016, Translational vision science & technology.

[17]  Michael H. Goldbaum,et al.  Measurement and classification of retinal vascular tortuosity , 1999, Int. J. Medical Informatics.

[18]  G. Bresnick Diabetic maculopathy. A critical review highlighting diffuse macular edema. , 1983, Ophthalmology.

[19]  J. Cunha-Vaz,et al.  MEASUREMENTS OF RETINAL FLUID BY OPTICAL COHERENCE TOMOGRAPHY LEAKAGE IN DIABETIC MACULAR EDEMA: A Biomarker of Visual Acuity Response to Treatment , 2017, Retina.

[20]  Dr. W. Lotmar,et al.  Measurement of vessel tortuosity on fundus photographs , 1979, Albrecht von Graefes Archiv für klinische und experimentelle Ophthalmologie.

[21]  Justis P. Ehlers,et al.  Repeatability of automated leakage quantification and microaneurysm identification utilising an analysis platform for ultra-widefield fluorescein angiography , 2019, British Journal of Ophthalmology.

[22]  K. G. Goh,et al.  ADRIS : an Automatic Diabetic Retinal Image Screening system , 2001 .

[23]  Einar Stefánsson,et al.  Retinal vessel dilatation and elongation precedes diabetic macular oedema , 1997, The British journal of ophthalmology.

[24]  Mitko Veta,et al.  Approximation of a pipeline of unsupervised retina image analysis methods with a CNN , 2019, Medical Imaging: Image Processing.

[25]  José Cunha-Vaz,et al.  The Blood-Retinal Barrier in the Management of Retinal Disease: EURETINA Award Lecture , 2017, Ophthalmologica.

[26]  J. Cunha-Vaz,et al.  Mapping retinal fluorescein leakage with confocal scanning laser fluorometry of the human vitreous. , 1999, Archives of ophthalmology.

[27]  Justis P. Ehlers,et al.  Automated quantitative characterisation of retinal vascular leakage and microaneurysms in ultra-widefield fluorescein angiography , 2017, British Journal of Ophthalmology.

[28]  Katherine E. Talcott,et al.  Quantitative Ultra-Widefield Angiography and Diabetic Retinopathy Severity: An Assessment of Panretinal Leakage Index, Ischemic Index and Microaneurysm Count. , 2019, Ophthalmology.

[29]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[30]  Hamid Reza Pourreza,et al.  A Novel Curvature-Based Algorithm for Automatic Grading of Retinal Blood Vessel Tortuosity , 2016, IEEE Journal of Biomedical and Health Informatics.

[31]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[32]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[33]  Brendan J. Frey,et al.  Adaptive dropout for training deep neural networks , 2013, NIPS.

[34]  J. Bullard,et al.  Numerical methods for computing interfacial mean curvature , 1995 .

[35]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[36]  Justis P. Ehlers,et al.  Higher-Order Assessment of OCT in Diabetic Macular Edema from the VISTA Study: Ellipsoid Zone Dynamics and the Retinal Fluid Index. , 2019, Ophthalmology. Retina.

[37]  Lloyd Paul Aiello,et al.  Randomized trial evaluating ranibizumab plus prompt or deferred laser or triamcinolone plus prompt laser for diabetic macular edema , 2010, Ophthalmology.

[38]  Matthias Schonlau,et al.  The Clustergram: A Graph for Visualizing Hierarchical and Nonhierarchical Cluster Analyses , 2002 .