Lightweight Learning-based Automatic Segmentation of Subretinal Blebs on Microscope-Integrated Optical Coherence Tomography Images.

PURPOSE Subretinal injections of therapeutics are commonly used to treat ocular diseases. Accurate dosing of therapeutics at target locations is crucial but difficult to achieve using subretinal injections due to leakage, and there is no method available to measure the volume of therapeutics successfully administered to the subretinal location during surgery. Here we introduce the first automatic method for quantifying the volume of subretinal blebs, using porcine eyes injected with Ringer's lactate solution as samples. DESIGN Experimental study. METHODS Microscope-integrated optical coherence tomography was utilized to obtain 3D visualization of subretinal blebs in porcine eyes at Duke Eye Center. Two different injection phases were imaged and analyzed in 15 eyes (30 volumes), selected from a total of 37 eyes. The inclusion/exclusion criteria were set independently from the algorithm-development and testing team. A novel lightweight, deep learning-based algorithm was designed to segment subretinal blebs boundaries. A cross-validation method was used to avoid selection bias. An ensemble-classifier strategy was applied to generate final results for the test dataset. RESULTS The algorithm performs significantly better than four other state-of-the-art deep learning-based segmentation methods, achieving an F1 score of 93.86 ± 1.17% and 96.90 ± 0.59% on the independent test data for entry and full blebs, respectively. CONCLUSION The proposed algorithm accurately segmented the volumetric boundaries of Ringer's lactate solution delivered into the subretinal space of porcine eyes with robust performance and real-time speed. This is the first step for future applications in computer-guided delivery of therapeutics into the subretinal space in human subjects.

[1]  Liang Liu,et al.  Automated volumetric segmentation of retinal fluid on optical coherence tomography. , 2016, Biomedical optics express.

[2]  Martin Friedlander,et al.  Performing subretinal injections in rodents to deliver retinal pigment epithelium cells in suspension. , 2015, Journal of visualized experiments : JoVE.

[3]  Sina Farsiu,et al.  Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning , 2019, Proceedings of the National Academy of Sciences.

[4]  Joseph A. Izatt,et al.  Robust automatic segmentation of corneal layer boundaries in SDOCT images using graph theory and dynamic programming , 2011, Biomedical optics express.

[5]  Milan Sonka,et al.  Stratified Sampling Voxel Classification for Segmentation of Intraretinal and Subretinal Fluid in Longitudinal Clinical OCT Data , 2015, IEEE Transactions on Medical Imaging.

[6]  Adeel M. Syed,et al.  Automated segmentation of subretinal layers for the detection of macular edema. , 2016, Applied optics.

[7]  Joseph A. Izatt,et al.  Real-time corneal segmentation and 3D needle tracking in intrasurgical OCT , 2018, Biomedical optics express.

[8]  L. D. Del Priore,et al.  Treatment of Macular Degeneration Using Embryonic Stem Cell-Derived Retinal Pigment Epithelium: Preliminary Results in Asian Patients , 2015, Stem cell reports.

[9]  Daniel F. Martin,et al.  Evolution of Intravitreal Therapy for Retinal Diseases-From CMV to CNV: The LXXIV Edward Jackson Memorial Lecture. , 2018, American journal of ophthalmology.

[10]  Mark S. Humayun,et al.  Subretinal implantation of a monolayer of human embryonic stem cell-derived retinal pigment epithelium: a feasibility and safety study in Yucatán minipigs , 2016, Graefe's Archive for Clinical and Experimental Ophthalmology.

[11]  Sina Farsiu,et al.  Visualization of Real-Time Intraoperative Maneuvers with a Microscope-Mounted Spectral Domain Optical Coherence Tomography System , 2013, Retina.

[12]  K. Xue,et al.  Technique of retinal gene therapy: delivery of viral vector into the subretinal space , 2017, Eye.

[13]  K. Bartz-Schmidt,et al.  Retinal Gene Therapy: Surgical Vector Delivery in the Translation to Clinical Trials , 2017, Front. Neurosci..

[14]  S. Farsiu,et al.  Live volumetric (4D) visualization and guidance of in vivo human ophthalmic surgery with intraoperative optical coherence tomography , 2016, Scientific Reports.

[15]  Sina Farsiu,et al.  Open source software for automatic detection of cone photoreceptors in adaptive optics ophthalmoscopy using convolutional neural networks , 2017, Scientific Reports.

[16]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Hyunjin Park,et al.  Three-dimensional continuous max flow optimization-based serous retinal detachment segmentation in SD-OCT for central serous chorioretinopathy. , 2017, Biomedical optics express.

[19]  Marie Louise Beauchemin,et al.  The fine structure of the pig's retina , 1974, Albrecht von Graefes Archiv für klinische und experimentelle Ophthalmologie.

[20]  Jerry L Prince,et al.  Automatic segmentation of microcystic macular edema in OCT. , 2014, Biomedical optics express.

[21]  Janet L Davis,et al.  Intraoperative Use of Microscope-Integrated Optical Coherence Tomography for Subretinal Gene Therapy Delivery. , 2017, Retina.

[22]  Allen C Ho,et al.  Experience With a Subretinal Cell-based Therapy in Patients With Geographic Atrophy Secondary to Age-related Macular Degeneration. , 2017, American journal of ophthalmology.

[23]  Matthäus Pilch,et al.  Automated segmentation of pathological cavities in optical coherence tomography scans. , 2013, Investigative ophthalmology & visual science.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Junichi Kiryu,et al.  Characterization of Human Induced Pluripotent Stem Cell-Derived Retinal Pigment Epithelium Cell Sheets Aiming for Clinical Application , 2014, Stem cell reports.

[26]  Joseph A. Izatt,et al.  Automatic segmentation of closed-contour features in ophthalmic images using graph theory and dynamic programming , 2012, Biomedical optics express.

[27]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[28]  Jayanthi Sivaswamy,et al.  Segmentation of Retinal Cysts From Optical Coherence Tomography Volumes Via Selective Enhancement , 2017, IEEE Journal of Biomedical and Health Informatics.

[29]  Sina Farsiu,et al.  INTRAOPERATIVE USE OF HANDHELD SPECTRAL DOMAIN OPTICAL COHERENCE TOMOGRAPHY IMAGING IN MACULAR SURGERY , 2009, Retina.

[30]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[31]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[32]  Takashi Daimon,et al.  Autologous Induced Stem‐Cell–Derived Retinal Cells for Macular Degeneration: Brief Report , 2017, The New England journal of medicine.

[33]  P. Rosenfeld,et al.  Human embryonic stem cell-derived retinal pigment epithelium in patients with age-related macular degeneration and Stargardt's macular dystrophy: follow-up of two open-label phase 1/2 studies , 2015, The Lancet.

[34]  Sina Farsiu,et al.  Deep longitudinal transfer learning-based automatic segmentation of photoreceptor ellipsoid zone defects on optical coherence tomography images of macular telangiectasia type 2 , 2018, Biomedical optics express.

[35]  M. Mandai,et al.  Tumorigenicity Studies of Induced Pluripotent Stem Cell (iPSC)-Derived Retinal Pigment Epithelium (RPE) for the Treatment of Age-Related Macular Degeneration , 2014, PloS one.

[36]  Martin Biel,et al.  Subretinal Injection for Gene Therapy Does Not Cause Clinically Significant Outer Nuclear Layer Thinning in Normal Primate Foveae. , 2017, Investigative ophthalmology & visual science.

[37]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[38]  Kazunori Okada,et al.  Ensemble segmentation for GBM brain tumors on MR images using confidence-based averaging. , 2013, Medical physics.

[39]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[40]  Hiroshi Murata,et al.  Using Deep Learning and Transfer Learning to Accurately Diagnose Early-Onset Glaucoma From Macular Optical Coherence Tomography Images. , 2019, American journal of ophthalmology.

[41]  Andrew M. Rollins,et al.  Intraoperative optical coherence tomography using an optimized reflective optical relay, real-time heads-up display, and semitransparent surgical instrumentation , 2015, Photonics West - Biomedical Optics.

[42]  Jianhua Wang,et al.  Optical coherence tomography for ocular surface and corneal diseases: a review , 2018, Eye and Vision.

[43]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[44]  Leopold Schmetterer,et al.  CorneaNet: fast segmentation of cornea OCT scans of healthy and keratoconic eyes using deep learning. , 2019, Biomedical optics express.

[45]  Oscar J. Perdomo,et al.  3D deep convolutional neural network for predicting neurosensory retinal thickness map from spectral domain optical coherence tomography volumes , 2018, Symposium on Medical Information Processing and Analysis.

[46]  W. Hauswirth,et al.  Stability and Safety of an AAV Vector for Treating RPGR-ORF15 X-Linked Retinitis Pigmentosa. , 2015, Human gene therapy.

[47]  Hamed Fahimi,et al.  Intra-Retinal Layer Segmentation of Optical Coherence Tomography Using 3D Fully Convolutional Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[48]  Steven Nusinowitz,et al.  Functional and morphological analysis of the subretinal injection of retinal pigment epithelium cells , 2012, Visual Neuroscience.

[49]  Mark E Pennesi,et al.  Adeno-Associated Viral Gene Therapy for Inherited Retinal Disease , 2019, Pharmaceutical Research.

[50]  Sina Farsiu,et al.  Integration of a spectral domain optical coherence tomography system into a surgical microscope for intraoperative imaging. , 2011, Investigative ophthalmology & visual science.

[51]  Pablo Lamata,et al.  V-FCNN: Volumetric Fully Convolution Neural Network For Automatic Atrial Segmentation , 2018, STACOM@MICCAI.

[52]  I J Constable,et al.  Three-year follow-up of Phase 1 and 2a rAAV.sFLT-1 subretinal gene therapy trials for exudative age related macular degeneration. , 2019, American journal of ophthalmology.

[53]  Amy L. Oldenburg,et al.  Automated Segmentation of Intraretinal Cystoid Fluid in Optical Coherence Tomography , 2012, IEEE Transactions on Biomedical Engineering.

[54]  Xinjian Chen,et al.  Automatic Segmentation of Retinal Layer in OCT Images With Choroidal Neovascularization , 2018, IEEE Transactions on Image Processing.

[55]  Elena Vecino,et al.  The pig eye as a novel model of glaucoma. , 2005, Experimental eye research.

[56]  Hyunjin Park,et al.  Automatic Subretinal Fluid Segmentation of Retinal SD-OCT Images With Neurosensory Retinal Detachment Guided by Enface Fundus Imaging , 2018, IEEE Transactions on Biomedical Engineering.

[57]  Thomas Theelen,et al.  Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. , 2018, Biomedical optics express.

[58]  Joseph A. Izatt,et al.  Volumetric Measurement of Subretinal Blebs Using Microscope-Integrated Optical Coherence Tomography , 2018, Translational vision science & technology.

[59]  Sina Farsiu,et al.  Analysis of pars plana vitrectomy for optic pit-related maculopathy with intraoperative optical coherence tomography: a possible connection with the vitreous cavity. , 2011, Archives of ophthalmology.

[60]  Ian J Constable,et al.  Gene Therapy in Neovascular Age-related Macular Degeneration: Three-Year Follow-up of a Phase 1 Randomized Dose Escalation Trial. , 2017, American journal of ophthalmology.

[61]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[62]  Luosheng Tang,et al.  Subretinal Injection: A Review on the Novel Route of Therapeutic Delivery for Vitreoretinal Diseases , 2017, Ophthalmic Research.

[63]  Raphael Sznitman,et al.  Pathological OCT Retinal Layer Segmentation Using Branch Residual U-Shape Networks , 2017, MICCAI.

[64]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.