Multiclass retinal disease classification and lesion segmentation in OCT B-scan images using cascaded convolutional networks.

Disease classification and lesion segmentation of retinal optical coherence tomography images play important roles in ophthalmic computer-aided diagnosis. However, existing methods achieve the two tasks separately, which is insufficient for clinical application and ignores the internal relation of disease and lesion features. In this paper, a framework of cascaded convolutional networks is proposed to jointly classify retinal diseases and segment lesions. First, we adopt an auxiliary binary classification network to identify normal and abnormal images. Then a novel, to the best of our knowledge, U-shaped multi-task network, BDA-Net, combined with a bidirectional decoder and self-attention mechanism, is used to further analyze abnormal images. Experimental results show that the proposed method reaches an accuracy of 0.9913 in classification and achieves an improvement of around 3% in Dice compared to the baseline U-shaped model in segmentation.

[1]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[2]  Thomas Theelen,et al.  Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. , 2018, Biomedical optics express.

[3]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sijie Niu,et al.  RMPPNet: residual multiple pyramid pooling network for subretinal fluid segmentation in SD-OCT images , 2020, OSA Continuum.

[5]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[6]  Pascal A. Dufour,et al.  Graph-Based Multi-Surface Segmentation of OCT Data Using Trained Hard and Soft Constraints , 2013, IEEE Transactions on Medical Imaging.

[7]  Fei Li,et al.  Joint retina segmentation and classification for early glaucoma diagnosis. , 2019, Biomedical optics express.

[8]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[9]  Zhang Yi,et al.  Automated segmentation of macular edema in OCT using deep neural networks , 2019, Medical Image Anal..

[10]  Alireza Mehridehnavi,et al.  Macular OCT Classification Using a Multi-Scale Convolutional Neural Network Ensemble , 2018, IEEE Transactions on Medical Imaging.

[11]  Keshab K. Parhi,et al.  RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge , 2019, IEEE Transactions on Medical Imaging.

[12]  Qiang Chen,et al.  Automated drusen segmentation and quantification in SD-OCT images , 2013, Medical Image Anal..

[13]  Hao Wei,et al.  Automated segmentation of fluid regions in optical coherence tomography B-scan images of age-related macular degeneration , 2020 .

[14]  Qiang Chen,et al.  MPB-CNN: a multi-scale parallel branch CNN for choroidal neovascularization segmentation in SD-OCT images , 2019, OSA Continuum.

[15]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[16]  Kotagiri Ramamohanarao,et al.  Classification of healthy and diseased retina using SD-OCT imaging and Random Forest algorithm , 2018, PloS one.

[17]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[18]  C. F. Costa,et al.  The role of optical coherence tomography in Alzheimer’s disease , 2016, International Journal of Retina and Vitreous.

[19]  Marinko V Sarunic,et al.  Deep‐learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network , 2019, Medical Image Anal..

[20]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[21]  Xinjian Chen,et al.  Surrogate-Assisted Retinal OCT Image Classification Based on Convolutional Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[22]  Leyuan Fang,et al.  Iterative fusion convolutional neural networks for classification of optical coherence tomography images , 2019, J. Vis. Commun. Image Represent..

[23]  Eric L Yuan,et al.  Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. , 2014, Ophthalmology.