Automatic Classification of Retinal Optical Coherence Tomography Images With Layer Guided Convolutional Neural Network

Optical coherence tomography (OCT) enables instant and direct imaging of morphological retinal tissue and has become an essential imaging modality for ophthalmology diagnosis. As one of the important morphological retinal characteristics, the structural information of retinal layers provides meaningful diagnostic information and is closely related to several retinal diseases. In this letter, we propose a novel layer guided convolutional neural network (LGCNN) to identify normal retina and three common types of macular pathologies, namely, diabetic macular edema, drusen, and choroidal neovascularization. Specifically, an efficient segmentation network is first employed to generate the retinal layer segmentation maps, which can delineate two lesion-related retinal layers associated with the meaningful retinal lesions. Then, two well-designed subnetworks in LGCNN are utilized to integrate the information of two lesion-related layers. Consequently, LGCNN can efficiently focus on the meaningful lesion-related layer regions to improve OCT classification. The experimental results conducted on two clinically acquired datasets demonstrate the effectiveness of the proposed method.

[1]  Alireza Mehridehnavi,et al.  Automatic diagnosis of abnormal macula in retinal optical coherence tomography images using wavelet-based convolutional neural network features and random forests classifier , 2018, Journal of biomedical optics.

[2]  Bram van Ginneken,et al.  Automated age-related macular degeneration classification in OCT using unsupervised feature learning , 2015, Medical Imaging.

[3]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[4]  Alireza Mehridehnavi,et al.  Macular OCT Classification Using a Multi-Scale Convolutional Neural Network Ensemble , 2018, IEEE Transactions on Medical Imaging.

[5]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[6]  Xinjian Chen,et al.  Surrogate-Assisted Retinal OCT Image Classification Based on Convolutional Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[7]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[8]  Nicolás Cuenca,et al.  Cellular Characterization of OCT and Outer Retinal Bands Using Specific Immunohistochemistry Markers and Clinical Implications. , 2017, Ophthalmology.

[9]  L. D. Del Priore,et al.  Drusen in age-related macular degeneration: pathogenesis, natural course, and laser photocoagulation-induced regression. , 1999, Survey of ophthalmology.

[10]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  F. Mériaudeau,et al.  Classification of SD-OCT Volumes Using Local Binary Patterns: Experimental Validation for DME Detection , 2016, Journal of ophthalmology.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[16]  Leyuan Fang,et al.  Iterative fusion convolutional neural networks for classification of optical coherence tomography images , 2019, J. Vis. Commun. Image Represent..

[17]  Chen Xu,et al.  MS-CapsNet: A Novel Multi-Scale Capsule Network , 2018, IEEE Signal Processing Letters.

[18]  Zhongyang Sun,et al.  Fully automated macular pathology detection in retina optical coherence tomography images using sparse coding and dictionary learning , 2017, Journal of biomedical optics.

[19]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Shaohua Zhang,et al.  Transferred Deep Convolutional Neural Network Features for Extensive Facial Landmark Localization , 2016, IEEE Signal Processing Letters.

[23]  Frans Coenen,et al.  Age-related Macular Degeneration Identification In Volumetric Optical Coherence Tomography Using Decomposition and Local Feature Extraction , 2013 .

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[26]  Justin Salamon,et al.  Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification , 2016, IEEE Signal Processing Letters.

[27]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Zygmunt Wróbel,et al.  Automatic analysis of selected choroidal diseases in OCT images of the eye fundus , 2013, Biomedical engineering online.

[30]  R. Klein,et al.  Clinically significant macular edema and survival in type 1 and type 2 diabetes. , 2008, American journal of ophthalmology.

[31]  Adnan Tufail,et al.  Evaluation of age-related macular degeneration with optical coherence tomography. , 2012, Survey of ophthalmology.

[32]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[33]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.