Weakly Supervised Anomaly Localization and Segmentation of Biomarkers in OCT Images

Identifying biomarkers from optical coherence tomography images is critical in diagnosing and treating ophthalmic diseases. Most existing biomarker segmentation methods require pixel-level annotations for training, which is time-consuming and labor-intensive. This paper proposed a novel weakly supervised biomarker localization and segmentation method. The framework includes a classification network and a teacher-student network to exploit category annotated data through contrastive learning and anomaly localization strategies based on knowledge distillation. The classification network combines cross-entropy loss and self- supervised contrastive loss to ensure that the model focuses on the characteristics of the biomarker of interest. We introduce a knowledge distillation-based anomaly localization method to localize biomarker-related pathological regions accurately. The trained classification network acts as a teacher model to guide the training of the student network to learn the features of normal OCT images. The biomarker regions can be accurately localized by the differences between the feature maps generated by the two networks. Experiment results on the public dataset demonstrate the effectiveness of the proposed method.

[1]  Mingkui Tan,et al.  Intra- and Inter-Slice Contrastive Learning for Point Supervised OCT Fluid Segmentation , 2022, IEEE Transactions on Image Processing.

[2]  Saurabh Malhotra,et al.  Automatic extraction and stenosis evaluation of coronary arteries in invasive coronary angiograms , 2021, Comput. Biol. Medicine.

[3]  Jingfeng Jiang,et al.  Progressive global perception and local polishing network for lung infection segmentation of COVID-19 CT images , 2021, Pattern Recognition.

[4]  Jinshan Tang,et al.  MDC-net: A new convolutional neural network for nucleus segmentation in histopathology images with distance maps and contour information , 2021, Comput. Biol. Medicine.

[5]  Errui Ding,et al.  Student-Teacher Feature Pyramid Matching for Anomaly Detection , 2021, BMVC.

[6]  Wei Hu,et al.  Automatic fluid segmentation in retinal optical coherence tomography images using attention based deep learning , 2021, Neurocomputing.

[7]  Hamid R. Rabiee,et al.  Multiresolution Knowledge Distillation for Anomaly Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xiaoming Liu,et al.  Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning , 2020, IEEE Journal of Selected Topics in Signal Processing.

[9]  Qiang Chen,et al.  MS-CAM: Multi-Scale Class Activation Maps for Weakly-Supervised Segmentation of Geographic Atrophy Lesions in SD-OCT Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[10]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[11]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[12]  Paul Bergmann,et al.  Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Dong Liu,et al.  Automated Layer Segmentation of Retinal Optical Coherence Tomography Images Using a Deep Feature Enhanced Structured Random Forests Classifier , 2019, IEEE Journal of Biomedical and Health Informatics.

[14]  Marinko V Sarunic,et al.  Deep‐learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network , 2019, Medical Image Anal..

[15]  Zhi Zhang,et al.  Bag of Tricks for Image Classification with Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Suha Kwak,et al.  Learning Pixel-Level Semantic Affinity with Image-Level Supervision for Weakly Supervised Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[18]  A. Loewenstein,et al.  OCT Biomarkers as Functional Outcome Predictors in Diabetic Macular Edema Treated with Dexamethasone Implant. , 2017, Ophthalmology.

[19]  Thomas Schultz,et al.  CNNs Enable Accurate and Fast Segmentation of Drusen in Optical Coherence Tomography , 2017, DLMIA/ML-CDS@MICCAI.

[20]  U. Schmidt-Erfurth,et al.  A paradigm shift in imaging biomarkers in neovascular age-related macular degeneration , 2016, Progress in Retinal and Eye Research.

[21]  Wolfgang Drexler,et al.  State-of-the-art retinal optical coherence tomography , 2008, Progress in Retinal and Eye Research.

[22]  Ying Zhang,et al.  Joint disease classification and lesion segmentation via one-stage attention-based convolutional neural network in OCT images , 2022, Biomed. Signal Process. Control..

[23]  Ying Zhang,et al.  Confidence-Guided Topology-Preserving Layer Segmentation for Optical Coherence Tomography Images With Focus-Column Module , 2021, IEEE Transactions on Instrumentation and Measurement.

[24]  W. Marsden I and J , 2012 .

[25]  Neil Genzlinger A. and Q , 2006 .