ChoroidNET: A Dense Dilated U-Net Model for Choroid Layer and Vessel Segmentation in Optical Coherence Tomography Images

Understanding the changes in choroidal thickness and vasculature is important to monitor the development and progression of various ophthalmic diseases. Accurate segmentation of the choroid layer and choroidal vessels is critical to better analyze and understand the choroidal changes. In this study, we develop a dense dilated U-Net model (ChoroidNET) for segmenting the choroid layer and choroidal vessels in optical coherence tomography (OCT) images. The performance of ChoroidNET is evaluated using an OCT dataset that contains images with various retinal pathologies. Overall Dice coefficient of 95.1 ± 0.4 and 82.4 ± 2.4 were obtained for choroid layer and vessel segmentation, respectively. Comparisons show that among state-of-the-art models, ChoroidNET, which produces results that are consistent with ground truths, is the most robust segmentation framework.

[1]  Wei Ping Hsia,et al.  Automatic Segmentation of Choroid Layer Using Deep Learning on Spectral Domain Optical Coherence Tomography , 2021, Applied Sciences.

[2]  R. Asaoka,et al.  Correlation between choroidal structure and smoking in eyes with central serous chorioretinopathy , 2020, PloS one.

[3]  Yanfeng Jiang,et al.  Deep learning algorithms to segment and quantify the choroidal thickness and vasculature in swept-source optical coherence tomography images , 2020, Journal of Innovative Optical Health Sciences.

[4]  Jiang Liu,et al.  Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning , 2020, IEEE Journal of Biomedical and Health Informatics.

[5]  David Alonso-Caneiro,et al.  Automatic choroidal segmentation in OCT images using supervised deep learning methods , 2019, Scientific Reports.

[6]  P. Scheltens,et al.  Retinal thickness as potential biomarker in posterior cortical atrophy and typical Alzheimer’s disease , 2019, Alzheimer's Research & Therapy.

[7]  Kiran Kumar Vupparaboina,et al.  Choroidal imaging biomarkers. , 2019, Survey of ophthalmology.

[8]  Quoc V. Le,et al.  NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Xun Xu,et al.  Robust deep learning method for choroidal vessel segmentation on swept source optical coherence tomography images. , 2019, Biomedical optics express.

[10]  P. Li,et al.  Automatic Choroid Layer Segmentation from Optical Coherence Tomography Images Using Deep Learning , 2019, Scientific Reports.

[11]  Abdolreza Rashno,et al.  Automatic Segmentation of Choroid Layer in EDI OCT Images Using Graph Theory in Neutrosophic Space , 2018, 1812.01989.

[12]  David Alonso-Caneiro,et al.  Automatic Retinal and Choroidal Boundary Segmentation in OCT Images Using Patch-Based Supervised Machine Learning Methods , 2018, ACCV Workshops.

[13]  Ruikang K. Wang,et al.  Attenuation correction assisted automatic segmentation for assessing choroidal thickness and vasculature with swept-source OCT. , 2018, Biomedical optics express.

[14]  Quoc V. Le,et al.  DropBlock: A regularization method for convolutional networks , 2018, NeurIPS.

[15]  S. Sonoda,et al.  CORRELATIONS BETWEEN CHOROIDAL STRUCTURES AND VISUAL FUNCTIONS IN EYES WITH RETINITIS PIGMENTOSA , 2018, Retina.

[16]  J. Chhablani,et al.  Choroidal Structural Changes Correlate With Neovascular Activity in Neovascular Age Related Macular Degeneration. , 2018, Investigative ophthalmology & visual science.

[17]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[18]  David Alonso-Caneiro,et al.  Effect of patch size and network architecture on a convolutional neural network approach for automatic segmentation of OCT retinal layers. , 2018, Biomedical optics express.

[19]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[20]  R. Agrawal,et al.  Choroidal Vascularity Index in Retinitis Pigmentosa: An OCT Study. , 2018, Ophthalmic surgery, lasers & imaging retina.

[21]  Andre J. Witkin,et al.  Swept Source Optical Coherence Tomography: a Review , 2018, Current Ophthalmology Reports.

[22]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Min Chen,et al.  Automated Segmentation of the Choroid in EDI-OCT Images with Retinal Pathology Using Convolution Neural Networks , 2017, FIFI/OMIA@MICCAI.

[24]  Keisuke Nemoto,et al.  Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[25]  Yilong Yin,et al.  Choroid segmentation from Optical Coherence Tomography with graph-edge weights learned from deep convolutional neural networks , 2017, Neurocomputing.

[26]  H. Ahmadieh,et al.  CHANGES IN CENTRAL CHOROIDAL THICKNESS AFTER TREATMENT OF DIABETIC MACULAR EDEMA WITH INTRAVITREAL BEVACIZUMAB CORRELATION WITH CENTRAL MACULAR THICKNESS AND BEST-CORRECTED VISUAL ACUITY , 2017, Retina.

[27]  Ya Xing Wang,et al.  Automatic Choroidal Layer Segmentation Using Markov Random Field and Level Set Method , 2017, IEEE Journal of Biomedical and Health Informatics.

[28]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[30]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[32]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Honglie Shen,et al.  Automated choroid segmentation based on gradual intensity distance in HD-OCT images. , 2015, Optics express.

[34]  T. Saba,et al.  An innovative technique for contrast enhancement of computed tomography images using normalized gamma-corrected contrast-limited adaptive histogram equalization , 2015, EURASIP J. Adv. Signal Process..

[35]  Sina Farsiu,et al.  Relationship of central choroidal thickness with age-related macular degeneration status. , 2015, American journal of ophthalmology.

[36]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[37]  Soumya Jana,et al.  Automated detection of choroid boundary and vessels in optical coherence tomography images , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Hossein Rabbani,et al.  Segmentation of Choroidal Boundary in Enhanced Depth Imaging OCTs Using a Multiresolution Texture Based Modeling in Graph Cuts , 2014, Comput. Math. Methods Medicine.

[39]  Yalin Zheng,et al.  Automated segmentation of the choroid in retinal optical coherence tomography images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[40]  Xiaodong Wu,et al.  Semiautomated segmentation of the choroid in spectral-domain optical coherence tomography volume scans. , 2013, Investigative ophthalmology & visual science.

[41]  Tin Aung Tun,et al.  Automatic segmentation of the choroid in enhanced depth imaging optical coherence tomography images , 2013, Biomedical optics express.

[42]  Justis P. Ehlers,et al.  Evaluation of choroidal thickness in retinitis pigmentosa using enhanced depth imaging optical coherence tomography , 2012, British Journal of Ophthalmology.

[43]  Hideki Koizumi,et al.  Enhanced depth imaging optical coherence tomography. , 2011, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[44]  Kotagiri Ramamohanarao,et al.  An automated method for choroidal thickness measurement from Enhanced Depth Imaging Optical Coherence Tomography images , 2018, Comput. Medical Imaging Graph..

[45]  Qiang Wu,et al.  Automatic choroid layer segmentation using normalized graph cut , 2018, IET Image Process..

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..