Deep iterative vessel segmentation in OCT angiography

This paper addresses retinal vessel segmentation on optical coherence tomography angiography (OCT-A) images of the human retina. Our approach is motivated by the need for high precision image-guided delivery of regenerative therapies in vitreo-retinal surgery. OCT-A visualizes macular vasculature, the main landmark of the surgically targeted area, at a level of detail and spatial extent unattainable by other imaging modalities. Thus, automatic extraction of detailed vessel maps can ultimately inform surgical planning. We address the task of delineation of the Superficial Vascular Plexus in 2D Maximum Intensity Projections (MIP) of OCT-A using convolutional neural networks that iteratively refine the quality of the produced vessel segmentations. We demonstrate that the proposed approach compares favourably to alternative network baselines and graph-based methodologies through extensive experimental analysis, using data collected from 50 subjects, including both individuals that underwent surgery for structural macular abnormalities and healthy subjects. Additionally, we demonstrate generalization to 3D segmentation and narrower field-of-view OCT-A. In the future, the extracted vessel maps will be leveraged for surgical planning and semi-automated intraoperative navigation in vitreo-retinal surgery.

[1]  Ayman El-Baz,et al.  Automatic blood vessels segmentation based on different retinal maps from OCTA scans , 2017, Comput. Biol. Medicine.

[2]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[3]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[4]  Adnan Tufail,et al.  Phase 1 clinical study of an embryonic stem cell–derived retinal pigment epithelium patch in age-related macular degeneration , 2018, Nature Biotechnology.

[5]  Vincent Lepetit,et al.  Multiscale Centerline Detection by Learning a Scale-Space Distance Transform , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  P. Fua,et al.  Learning rotational features for filament detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  David Huang,et al.  MEDnet, a neural network for automated detection of avascular area in OCT angiography. , 2018, Biomedical optics express.

[8]  Benita J. O’Colmain,et al.  Prevalence of age-related macular degeneration in the United States. , 2004, Archives of ophthalmology.

[9]  Ronan Collobert,et al.  Recurrent Convolutional Neural Networks for Scene Labeling , 2014, ICML.

[10]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Christian Heipke,et al.  EMPIRICAL EVALUATION OF AUTOMATICALLY EXTRACTED ROAD AXES , 1998 .

[12]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[13]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[14]  Pascal Fua,et al.  Detecting Irregular Curvilinear Structures in Gray Scale and Color Imagery Using Multi-directional Oriented Flux , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Pascal Fua,et al.  Beyond the Pixel-Wise Loss for Topology-Aware Delineation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[17]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[19]  A C S Tan,et al.  An overview of the clinical applications of optical coherence tomography angiography , 2018, Eye.

[20]  Laurent D. Cohen,et al.  Tubular Structure Segmentation Based on Minimal Path Method and Anisotropic Enhancement , 2011, International Journal of Computer Vision.

[21]  Larry Lindsey,et al.  High-precision automated reconstruction of neurons with flood-filling networks , 2017, Nature Methods.

[22]  Matthew B. Blaschko,et al.  Learning Fully-Connected CRFs for Blood Vessel Segmentation in Retinal Images , 2014, MICCAI.

[23]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[24]  Vincent Lepetit,et al.  Accurate and Efficient Linear Structure Segmentation by Leveraging Ad Hoc Features with Learned Filters , 2012, MICCAI.

[25]  P. Jong.  Prevalence of age-related macular degeneration in the United States. , 2004 .

[26]  Sushma G. Thorat.  Locating the Optic Nerve in a Retinal Image Using the Fuzzy Convergence of the Blood Vessels , 2014 .

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  James G. Fujimoto,et al.  Image Artifacts in Optical Coherence Angiography , 2016 .

[29]  Karl Rohr,et al.  Progressive Minimal Path Method for Segmentation of 2D and 3D Line Structures , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Pascal Fua,et al.  Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  R S Sobel,et al.  Fluorescein angiography complication survey. , 1986, Ophthalmology.

[32]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[33]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Rangasami L. Kashyap,et al.  Building Skeleton Models via 3-D Medial Surface/Axis Thinning Algorithms , 1994, CVGIP Graph. Model. Image Process..

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[37]  Robert W. Massof,et al.  Racial variations in causes of vision loss in nursing homes: The Salisbury Eye Evaluation in Nursing Home Groups (SEEING) Study. , 2004, Archives of ophthalmology.

[38]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[39]  Sven Loncaric,et al.  Segmentation of the foveal microvasculature using deep learning networks , 2016, Journal of biomedical optics.

[40]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[41]  Keith A. Soper,et al.  Diagnosis of diabetic eye disease. , 1982, JAMA.

[42]  Amani A. Fawzi,et al.  Human Parafoveal Capillary Vascular Anatomy and Connectivity Revealed by Optical Coherence Tomography Angiography , 2018, Investigative ophthalmology & visual science.

[43]  T. Sano,et al.  [Diabetic retinopathy]. , 2001, Nihon rinsho. Japanese journal of clinical medicine.

[44]  Gangjun Liu,et al.  Optical Coherence Tomography Angiography , 2016, Investigative ophthalmology & visual science.

[45]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[46]  Pascal Fua,et al.  Automated Reconstruction of Dendritic and Axonal Trees by Global Optimization with Geometric Priors , 2011, Neuroinformatics.

[47]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  J. Fujimoto,et al.  IMAGE ARTIFACTS IN OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY , 2015, Retina.

[50]  Jin U. Kang,et al.  Robotic Retinal Surgery , 2020, Handbook of Robotic and Image-Guided Surgery.

[51]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[52]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[54]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[55]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.