Deep learning for artery–vein classification in optical coherence tomography angiography

Major retinopathies can differentially impact the arteries and veins. Traditional fundus photography provides limited resolution for visualizing retinal vascular details. Optical coherence tomography (OCT) can provide improved resolution for retinal imaging. However, it cannot discern capillary-level structures due to the limited image contrast. As a functional extension of OCT modality, optical coherence tomography angiography (OCTA) is a non-invasive, label-free method for enhanced contrast visualization of retinal vasculatures at the capillary level. Recently differential artery–vein (AV) analysis in OCTA has been demonstrated to improve the sensitivity for staging of retinopathies. Therefore, AV classification is an essential step for disease detection and diagnosis. However, current methods for AV classification in OCTA have employed multiple imagers, that is, fundus photography and OCT, and complex algorithms, thereby making it difficult for clinical deployment. On the contrary, deep learning (DL) algorithms may be able to reduce computational complexity and automate AV classification. In this article, we summarize traditional AV classification methods, recent DL methods for AV classification in OCTA, and discuss methods for interpretability in DL models.

[1]  Jennifer I. Lim,et al.  An open-source deep learning network AVA-Net for arterial-venous area segmentation in optical coherence tomography angiography. , 2023, Communications medicine.

[2]  Jennifer I. Lim,et al.  Normalized Blood Flow Index in Optical Coherence Tomography Angiography Provides a Sensitive Biomarker of Early Diabetic Retinopathy , 2022, Translational vision science & technology.

[3]  Hong Wang,et al.  AV-casNet: Fully Automatic Arteriole-Venule Segmentation and Differentiation in OCT Angiography , 2022, IEEE Transactions on Medical Imaging.

[4]  Jennifer I. Lim,et al.  MF-AV-Net: an open-source deep learning network with multimodal fusion options for artery-vein segmentation in OCT angiography. , 2022, Biomedical optics express.

[5]  Keyan Wang,et al.  Wide-field swept-source OCT angiography of the periarterial capillary-free zone before and after anti-VEGF therapy for branch retinal vein occlusion , 2022, Eye and Vision.

[6]  Tristan T. Hormel,et al.  A Deep Learning Network for Classifying Arteries and Veins in Montaged Widefield OCT Angiograms , 2022, Ophthalmology science.

[7]  Ruikang K. Wang,et al.  OCTA Derived Vessel Skeleton Density Versus Flux and Their Associations With Systemic Determinants of Health , 2022, Investigative ophthalmology & visual science.

[8]  T. Son,et al.  Depth-resolved profile features for differentiating arteries and veins in OCT and OCT angiography of the human retina , 2021, BiOS.

[9]  Abdenour Amamra,et al.  Early, intermediate and late fusion strategies for robust deep learning-based multimodal action recognition , 2021, Machine Vision and Applications.

[10]  Hyungsik Jung,et al.  Towards Better Explanations of Class Activation Mapping , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  T. Son,et al.  Vascular morphology and blood flow signatures for differential artery-vein analysis in optical coherence tomography of the retina. , 2020, Biomedical optics express.

[12]  Hao Lu,et al.  SESV: Accurate Medical Image Segmentation by Predicting and Correcting Errors , 2020, IEEE Transactions on Medical Imaging.

[13]  Felipe A. Medeiros,et al.  A Review of Deep Learning for Screening, Diagnosis, and Detection of Glaucoma Progression , 2020, Translational vision science & technology.

[14]  Taeyoon Son,et al.  AV-Net: deep learning for fully automated artery-vein classification in optical coherence tomography angiography. , 2020, Biomedical optics express.

[15]  Mirza Faisal Beg,et al.  Ensemble Deep Learning for Diabetic Retinopathy Detection Using Optical Coherence Tomography Angiography , 2020, Translational vision science & technology.

[16]  H. Tabuchi,et al.  Automated detection of a nonperfusion area caused by retinal vein occlusion in optical coherence tomography angiography images using deep learning , 2019, PloS one.

[17]  James G. Fujimoto,et al.  Retinal Nonperfusion Relationship to Arteries or Veins Observed on Widefield Optical Coherence Tomography Angiography in Diabetic Retinopathy , 2019, Investigative ophthalmology & visual science.

[18]  Nihaal Mehta,et al.  Impact of Binarization Thresholding and Brightness/Contrast Adjustment Methodology on Optical Coherence Tomography Angiography Image Quantification. , 2019, American journal of ophthalmology.

[19]  A. Tsujikawa,et al.  Arteriovenous crossing associated with branch retinal vein occlusion , 2019, Japanese Journal of Ophthalmology.

[20]  T. Son,et al.  Highlight article: Near infrared oximetry-guided artery–vein classification in optical coherence tomography angiography , 2019, Experimental biology and medicine.

[21]  Xincheng Yao,et al.  OCT feature analysis guided artery-vein differentiation in OCTA. , 2019, Biomedical optics express.

[22]  Jennifer I. Lim,et al.  Differential Artery–Vein Analysis Improves the Performance of OCTA Staging of Sickle Cell Retinopathy , 2019, Translational Vision Science & Technology.

[23]  Jennifer I. Lim,et al.  Color Fundus Image Guided Artery-Vein Differentiation in Optical Coherence Tomography Angiography , 2018, Investigative ophthalmology & visual science.

[24]  Taeyoon Son,et al.  Combining ODR and Blood Vessel Tracking for Artery–Vein Classification and Analysis in Color Fundus Images , 2018, Translational vision science & technology.

[25]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[26]  Luc Van Gool,et al.  Error Correction for Dense Semantic Image Labeling , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[27]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[28]  Aaron Y. Lee,et al.  Reply. , 2016, Ophthalmology. Retina.

[29]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[30]  Mei Chen,et al.  Targeting the complement system for the management of retinal inflammatory and degenerative diseases , 2016, European journal of pharmacology.

[31]  Chen Xin,et al.  Quantitative assessment of the retinal microvasculature using optical coherence tomography angiography , 2016, Journal of biomedical optics.

[32]  Jiss Kuruvilla,et al.  A review on image processing and image segmentation , 2016, 2016 International Conference on Data Mining and Advanced Computing (SAPIENCE).

[33]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[34]  J. Flammer,et al.  Retinal vein occlusions: The potential impact of a dysregulation of the retinal veins , 2010, EPMA Journal.

[35]  Ingrid U Scott,et al.  Single-field fundus photography for diabetic retinopathy screening: a report by the American Academy of Ophthalmology. , 2004, Ophthalmology.

[36]  Tien Yin Wong,et al.  Retinal arteriolar narrowing and risk of diabetes mellitus in middle-aged persons. , 2002, JAMA.

[37]  RETINAL VASCULITIS , 1989, The Lancet.

[38]  Angiographie Fluorescéinique Fluorescein Angiography , 1968 .

[39]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..