AttenNet: Deep Attention Based Retinal Disease Classification in OCT Images

An optical coherence tomography (OCT) image is becoming the standard imaging modality in diagnosing retinal diseases and the assessment of their progression. However, the manual evaluation of the volumetric scan is time consuming, expensive and the signs of the early disease are easy to miss. In this paper, we mainly present an attention-based deep learning method for the retinal disease classification in OCT images, which can assist the large-scale screening or the diagnosis recommendation for an ophthalmologist. First, according to the unique characteristic of a retinal OCT image, we design a customized pre-processing method to improve image quality. Second, in order to guide the network optimization more effectively, a specially designed attention model, which pays more attention to critical regions containing pathological anomalies, is integrated into a typical deep learning network. We evaluate our proposed method on two data sets, and the results consistently show that it outperforms the state-of-the-art methods. We report an overall four-class accuracy of 97.4%, a two-class sensitivity of 100.0%, and a two-class specificity of 100.0% on a public data set shared by Zhang et al. with 1,000 testing B-scans in four disease classes. Compared to their work, our method improves the numbers by 0.8%, 2.2%, and 2.6% respectively.

[1]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[3]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[4]  Muhammad Awais,et al.  Classification of SD-OCT images using a Deep learning approach , 2017, 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[5]  Bram van Ginneken,et al.  Automated age-related macular degeneration classification in OCT using unsupervised feature learning , 2015, Medical Imaging.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xianghua Xie,et al.  Learning feature extractors for AMD classification in OCT using convolutional neural networks , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[8]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[9]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  James M. Rehg,et al.  Automated macular pathology diagnosis in retinal OCT images using multi-scale spatial pyramid and local binary patterns in texture and shape encoding , 2011, Medical Image Anal..

[11]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[12]  Kuanquan Wang,et al.  Fundus Lesion Detection Based on Visual Attention Model , 2016, ICYCSEE.

[13]  B. Zinman,et al.  Diabetic retinopathy and diabetic macular edema: pathophysiology, screening, and novel therapies. , 2003, Diabetes care.

[14]  Wolfgang Drexler,et al.  State-of-the-art retinal optical coherence tomography , 2008, Progress in Retinal and Eye Research.

[15]  Taimur Hassan,et al.  A practical approach to OCT based classification of Diabetic Macular Edema , 2017, 2017 International Conference on Signals and Systems (ICSigSys).

[16]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[17]  Fabio A. González,et al.  Classification of diabetes-related retinal diseases using a deep learning approach in optical coherence tomography , 2019, Comput. Methods Programs Biomed..

[18]  Utku Baran,et al.  Motion artifact and background noise suppression on optical microangiography frames using a naïve Bayes mask. , 2014, Applied optics.

[19]  Gregory S. Corrado,et al.  Deep learning for predicting refractive error from retinal fundus images , 2017, Investigative ophthalmology & visual science.

[20]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[21]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[22]  Taimur Hassan,et al.  Review of OCT and fundus images for detection of Macular Edema , 2015, 2015 IEEE International Conference on Imaging Systems and Techniques (IST).

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.