Multi-Scale Learning with Sparse Residual Network for Explainable Multi-Disease Diagnosis in OCT Images

In recent decades, medical imaging techniques have revolutionized the field of disease diagnosis, enabling healthcare professionals to noninvasively observe the internal structures of the human body. Among these techniques, optical coherence tomography (OCT) has emerged as a powerful and versatile tool that allows high-resolution, non-invasive, and real-time imaging of biological tissues. Deep learning algorithms have been successfully employed to detect and classify various retinal diseases in OCT images, enabling early diagnosis and treatment planning. However, existing deep learning algorithms are primarily designed for single-disease diagnosis, which limits their practical application in clinical settings where OCT images often contain symptoms of multiple diseases. In this paper, we propose an effective approach for multi-disease diagnosis in OCT images using a multi-scale learning (MSL) method and a sparse residual network (SRN). Specifically, the MSL method extracts and fuses useful features from images of different sizes to enhance the discriminative capability of a classifier and make the disease predictions interpretable. The SRN is a minimal residual network, where convolutional layers with large kernel sizes are replaced with multiple convolutional layers that have smaller kernel sizes, thereby reducing model complexity while achieving a performance similar to that of existing convolutional neural networks. The proposed multi-scale sparse residual network significantly outperforms existing methods, exhibiting 97.40% accuracy, 95.38% sensitivity, and 98.25% specificity. Experimental results show the potential of our method to improve explainable diagnosis systems for various eye diseases via visual discrimination.

[1]  Fatma M. Talaat,et al.  Enhanced Deep Learning Model for Classification of Retinal Optical Coherence Tomography Images , 2023, Sensors.

[2]  M. Mahadevappa,et al.  Convolution neural networks for optical coherence tomography (OCT) image classification , 2023, Biomed. Signal Process. Control..

[3]  J. Liu,et al.  A Multimodal Auxiliary Classification System for Osteosarcoma Histopathological Images Based on Deep Active Learning , 2022, Healthcare.

[4]  Sina Farsiu,et al.  RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation , 2022, IEEE Transactions on Medical Imaging.

[5]  Yanping Huang,et al.  Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network , 2022, Biomed. Signal Process. Control..

[6]  Xiangxi Meng,et al.  Triplet Cross-Fusion Learning for Unpaired Image Denoising in Optical Coherence Tomography , 2022, IEEE Transactions on Medical Imaging.

[7]  S. Ourselin,et al.  Surgical biomicroscopy-guided intra-operative optical coherence tomography (iOCT) image super-resolution , 2022, International Journal of Computer Assisted Radiology and Surgery.

[8]  Mingkui Tan,et al.  Intra- and Inter-Slice Contrastive Learning for Point Supervised OCT Fluid Segmentation , 2022, IEEE Transactions on Image Processing.

[9]  Hong Wang,et al.  Multi-Scale Pathological Fluid Segmentation in OCT With a Novel Curvature Loss in Convolutional Neural Network , 2022, IEEE Transactions on Medical Imaging.

[10]  H. Soltanian-Zadeh,et al.  Multi-Scale Convolutional Neural Network for Automated AMD Classification using Retinal OCT Images , 2021, Comput. Biol. Medicine.

[11]  Weifang Zhu,et al.  MsTGANet: Automatic Drusen Segmentation From Retinal OCT Images , 2021, IEEE Transactions on Medical Imaging.

[12]  Varun P. Gopi,et al.  A novel multiscale convolutional neural network based age-related macular degeneration detection using OCT images , 2021, Biomed. Signal Process. Control..

[13]  Gayathri S,et al.  OctNET: A Lightweight CNN for Retinal Disease Classification from Optical Coherence Tomography Images , 2020, Comput. Methods Programs Biomed..

[14]  Xi Liu,et al.  Noise reduction in optical coherence tomography images using a deep neural network with perceptually-sensitive loss function. , 2020, Biomedical optics express.

[15]  Prabin Kumar Bora,et al.  Multi-scale deep feature fusion for automated classification of macular pathologies from OCT images , 2019, Biomed. Signal Process. Control..

[16]  Leyuan Fang,et al.  Automatic Classification of Retinal Optical Coherence Tomography Images With Layer Guided Convolutional Neural Network , 2019, IEEE Signal Processing Letters.

[17]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[18]  Feng Li,et al.  Fully automated detection of retinal disorders by image-based deep learning , 2019, Graefe's Archive for Clinical and Experimental Ophthalmology.

[19]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[20]  Mark J J P van Grinsven,et al.  Automated Staging of Age-Related Macular Degeneration Using Optical Coherence Tomography. , 2017, Investigative ophthalmology & visual science.

[21]  F. Mériaudeau,et al.  Classification of SD-OCT Volumes Using Local Binary Patterns: Experimental Validation for DME Detection , 2016, Journal of ophthalmology.

[22]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Xuming Zhang,et al.  Self-supervised transformer based non-local means despeckling of optical coherence tomography images , 2023, Biomed. Signal Process. Control..

[26]  V. Lakshminarayanan,et al.  A Dual-Discriminator Fourier Acquisitive GAN for Generating Retinal Optical Coherence Tomography Images , 2022, IEEE Transactions on Instrumentation and Measurement.