Fused Detection of Retinal Biomarkers in OCT Volumes

Optical Coherence Tomography (OCT) is the primary imaging modality for detecting pathological biomarkers associated to retinal diseases such as Age-Related Macular Degeneration. In practice, clinical diagnosis and treatment strategies are closely linked to biomarkers visible in OCT volumes and the ability to identify these plays an important role in the development of ophthalmic pharmaceutical products. In this context, we present a method that automatically predicts the presence of biomarkers in OCT cross-sections by incorporating information from the entire volume. We do so by adding a bidirectional LSTM to fuse the outputs of a Convolutional Neural Network that predicts individual biomarkers. We thus avoid the need to use pixel-wise annotations to train our method, and instead provide fine-grained biomarker information regardless. On a dataset of 416 volumes, we show that our approach imposes coherence between biomarker predictions across volume slices and our predictions are superior to several existing approaches.

[1]  Gretchen A. Stevens,et al.  Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[2]  Kotagiri Ramamohanarao,et al.  Automatic Identification of Pathology-Distorted Retinal Layer Boundaries Using SD-OCT Imaging , 2017, IEEE Transactions on Biomedical Engineering.

[3]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.

[4]  Keshab K. Parhi,et al.  RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge , 2019, IEEE Transactions on Medical Imaging.

[5]  Raphael Sznitman,et al.  Pathological OCT Retinal Layer Segmentation Using Branch Residual U-Shape Networks , 2017, MICCAI.

[6]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[7]  Jürgen Schmidhuber,et al.  Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition , 2005, ICANN.

[8]  Dengwang Li,et al.  Automated drusen detection in dry age-related macular degeneration by multiple-depth, en face optical coherence tomography. , 2017, Biomedical optics express.

[9]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.