Segmentation of the foveal microvasculature using deep learning networks

Abstract. Accurate segmentation of the retinal microvasculature is a critical step in the quantitative analysis of the retinal circulation, which can be an important marker in evaluating the severity of retinal diseases. As manual segmentation remains the gold standard for segmentation of optical coherence tomography angiography (OCT-A) images, we present a method for automating the segmentation of OCT-A images using deep neural networks (DNNs). Eighty OCT-A images of the foveal region in 12 eyes from 6 healthy volunteers were acquired using a prototype OCT-A system and subsequently manually segmented. The automated segmentation of the blood vessels in the OCT-A images was then performed by classifying each pixel into vessel or nonvessel class using deep convolutional neural networks. When the automated results were compared against the manual segmentation results, a maximum mean accuracy of 0.83 was obtained. When the automated results were compared with inter and intrarater accuracies, the automated results were shown to be comparable to the human raters suggesting that segmentation using DNNs is comparable to a second manual rater. As manually segmenting the retinal microvasculature is a tedious task, having a reliable automated output such as automated segmentation by DNNs, is an important step in creating an automated output.

[1]  Ting Liu,et al.  Segmentation and quantification of blood vessels for OCT-based micro-angiograms using hybrid shape/intensity compounding. , 2015, Microvascular research.

[2]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[3]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[4]  R S Sobel,et al.  Fluorescein angiography complication survey. , 1986, Ophthalmology.

[5]  Luca Maria Gambardella,et al.  Convolutional Neural Network Committees for Handwritten Character Classification , 2011, 2011 International Conference on Document Analysis and Recognition.

[6]  Paula K. Yu,et al.  Label-Free Density Measurements of Radial Peripapillary Capillaries in the Human Retina , 2015, PloS one.

[7]  Ruikang K. Wang,et al.  Methods and algorithms for optical coherence tomography-based angiography: a review and comparison , 2015, Journal of biomedical optics.

[8]  Mohammad Sultan Mahmud,et al.  Review of speckle and phase variance optical coherence tomography to visualize microvascular networks , 2013, Journal of biomedical optics.

[9]  Brian Kingsbury,et al.  New types of deep neural network learning for speech recognition and related applications: an overview , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Qienyuan Zhou,et al.  RETINAL VASCULAR PERFUSION DENSITY MAPPING USING OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY IN NORMALS AND DIABETIC RETINOPATHY PATIENTS , 2015, Retina.

[11]  Michelle Cua,et al.  Retinal angiography with real-time speckle variance optical coherence tomography , 2015, British Journal of Ophthalmology.

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Mona Kathryn Garvin,et al.  Multimodal Retinal Vessel Segmentation From Spectral-Domain Optical Coherence Tomography and Fundus Photography , 2012, IEEE Transactions on Medical Imaging.

[15]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[16]  Dao-Yi Yu,et al.  Quantitative Comparison of Retinal Capillary Images Derived By Speckle Variance Optical Coherence Tomography With Histology. , 2015, Investigative ophthalmology & visual science.

[17]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[18]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Marinko V Sarunic,et al.  Quantitative Noninvasive Angiography of the Fovea Centralis Using Speckle Variance Optical Coherence Tomography. , 2015, Investigative ophthalmology & visual science.

[20]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[21]  Marinko V Sarunic,et al.  In vivo optical imaging of human retinal capillary networks using speckle variance optical coherence tomography with quantitative clinico-histological correlation. , 2015, Microvascular research.

[22]  Seiyo Harino,et al.  Relationship of macular microcirculation and retinal thickness with visual acuity in diabetic macular edema. , 2007, Ophthalmology.

[23]  Dao-Yi Yu,et al.  Quantitative morphometry of perifoveal capillary networks in the human retina. , 2012, Investigative ophthalmology & visual science.

[24]  David Huang,et al.  Automated Quantification of Capillary Nonperfusion Using Optical Coherence Tomography Angiography in Diabetic Retinopathy. , 2016, JAMA ophthalmology.

[25]  Dao-Yi Yu,et al.  Correlation of histologic and clinical images to determine the diagnostic value of fluorescein angiography for studying retinal capillary detail. , 2010, Investigative ophthalmology & visual science.

[26]  Kevin Wong,et al.  Real-time acquisition and display of flow contrast using speckle variance optical coherence tomography in a graphics processing unit , 2014, Journal of biomedical optics.

[27]  J. F. Cullen Retinal Vascular Disease , 1968, Scottish medical journal.