Automated Region of Interest Selection Improves Deep Learning-Based Segmentation of Hyper-Reflective Foci in Optical Coherence Tomography Images

Hyperreflective foci (HRF) have been associated with retinal disease progression and demonstrated as a negative prognostic biomarker for visual function. Automated segmentation of HRF in retinal optical coherence tomography (OCT) scans can be beneficial to identify the formation and movement of the HRF biomarker as a retinal disease progresses and can serve as the first step in understanding the nature and severity of the disease. In this paper, we propose a fully automated deep neural network based HRF segmentation model in OCT images. We enhance the model’s performance by using a patch-based strategy that increases the model’s compute on the HRF pixels. The patch-based strategy is evaluated against state of the art HRF segmentation pipelines on clinical retinal image data. Our results shows that the patch-based approach demonstrates a high precision score and intersection over union (IOU) using a ResNet34 segmentation model with Binary Cross Entropy loss function. The HRF segmentation pipeline can be used for analyzing HRF biomarkers for different retinopathies.

[1]  Vedrana Andersen Dahl,et al.  Automated detection of hyperreflective foci in the outer nuclear layer of the retina , 2022, Acta ophthalmologica.

[2]  Weifang Zhu,et al.  Joint Segmentation of Multi-Class Hyper-Reflective Foci in Retinal Optical Coherence Tomography Images , 2021, IEEE Transactions on Biomedical Engineering.

[3]  E. Pilotto,et al.  OCT Hyperreflective Retinal Foci in Diabetic Retinopathy: A Semi-Automatic Detection Comparative Study , 2021, Frontiers in Immunology.

[4]  Qinghua Qiu,et al.  Imaging Hyperreflective Foci as an Inflammatory Biomarker after Anti-VEGF Treatment in Neovascular Age-Related Macular Degeneration Patients with Optical Coherence Tomography Angiography , 2021, BioMed research international.

[5]  D. Rubin,et al.  Progression of Photoreceptor Degeneration in Geographic Atrophy Secondary to Age-related Macular Degeneration. , 2020, JAMA ophthalmology.

[6]  Qiang Chen,et al.  Hyper-reflective Foci Segmentation in SD-OCT Retinal Images with Diabetic Retinopathy using Deep Convolutional Neural Networks. , 2019, Medical physics.

[7]  Shulin Liu,et al.  Hyperreflective foci in OCT image as a biomarker of poor prognosis in diabetic macular edema patients treating with Conbercept in China , 2019, BMC Ophthalmology.

[8]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[9]  Amir Sadeghipour,et al.  Fully Automated Segmentation of Hyperreflective Foci in Optical Coherence Tomography Images , 2018, ArXiv.

[10]  Sina Farsiu,et al.  Optical Coherence Tomography Predictors of Risk for Progression to Non-Neovascular Atrophic Age-Related Macular Degeneration. , 2017, Ophthalmology.

[11]  Hans Limburg,et al.  Global causes of blindness and distance vision impairment 1990-2020: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[12]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[13]  Igor Vainer,et al.  PROGNOSTIC VALUE OF HYPERREFLECTIVE FOCI IN NEOVASCULAR AGE-RELATED MACULAR DEGENERATION TREATED WITH BEVACIZUMAB , 2016, Retina.

[14]  Sobha Sivaprasad,et al.  HYPERREFLECTIVE FOCI AS AN INDEPENDENT VISUAL OUTCOME PREDICTOR IN MACULAR EDEMA DUE TO RETINAL VASCULAR DISEASES TREATED WITH INTRAVITREAL DEXAMETHASONE OR RANIBIZUMAB , 2016, Retina.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Francesco Bandello,et al.  OPTICAL COHERENCE TOMOGRAPHIC HYPERREFLECTIVE FOCI IN EARLY STAGES OF DIABETIC RETINOPATHY , 2015, Retina.

[18]  Sina Farsiu,et al.  Progression of intermediate age-related macular degeneration with proliferation and inner retinal migration of hyperreflective foci. , 2013, Ophthalmology.

[19]  Sina Farsiu,et al.  Photoreceptor layer thinning over drusen in eyes with age-related macular degeneration imaged in vivo with spectral-domain optical coherence tomography. , 2009, Ophthalmology.

[20]  Edward Korot,et al.  Algorithm for the Measure of Vitreous Hyperreflective Foci in Optical Coherence Tomographic Scans of Patients With Diabetic Macular Edema. , 2016, JAMA ophthalmology.