Resolution enhancement in low transverse sampling optical coherence tomography angiography using deep learning

Optical coherence tomography angiography (OCTA) requires high transverse sampling density for visualizing retinal and choroidal capillaries. Low transverse sampling causes resolution degradation, such as the angiograms in wide-field OCTA. In this paper, we propose to address this problem using deep learning. We conducted extensive experiments on converting the centrally cropped 3 x 3 mm2 field of view (FOV) of the 8 x 8 mm2 foveal OCTA images (a sampling density of 22.9 $\mu$m) to the native 3 x 3 mm2 en face OCTA images (a sampling density of 12.2 $\mu$m). We employed a cycle-consistent adversarial network architecture in this conversion. The quantitative analysis using the perceptual similarity measures shows the generated OCTA images are closer to the native 3 x 3 mm2 scans. Besides, the results show the proposed method could also enhance signal-to-noise ratio. We further applied our method to enhance diseased cases and calculate vascular biomarkers, which demonstrates its generalization performance and clinical perspective.

[1]  Xuejin Chen,et al.  LinesToFacePhoto: Face Photo Generation From Lines With Conditional Self-Attention Generative Adversarial Networks , 2019, ACM Multimedia.

[2]  Wolfgang Drexler,et al.  Visualization of micro-capillaries using optical coherence tomography angiography with and without adaptive optics. , 2017, Biomedical optics express.

[3]  N. Kung,et al.  Association of Preclinical Alzheimer Disease With Optical Coherence Tomographic Angiography Findings , 2018, JAMA ophthalmology.

[4]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[5]  Aydogan Ozcan,et al.  Resolution enhancement in scanning electron microscopy using deep learning , 2019, Scientific Reports.

[6]  David Huang,et al.  Automated registration and enhanced processing of clinical optical coherence tomography angiography. , 2016, Quantitative imaging in medicine and surgery.

[7]  Austin Roorda,et al.  Real-time eye motion correction in phase-resolved OCT angiography with tracking SLO , 2012, Biomedical optics express.

[8]  Ruikang K. Wang,et al.  Optical Microangiography: A Label-Free 3-D Imaging Technology to Visualize and Quantify Blood Circulations Within Tissue Beds In Vivo , 2010, IEEE Journal of Selected Topics in Quantum Electronics.

[9]  Chen Xin,et al.  Quantitative assessment of the retinal microvasculature using optical coherence tomography angiography , 2016, Journal of biomedical optics.

[10]  Mayss Al-Sheikh,et al.  Impact of image quality on OCT angiography based quantitative measurements , 2017, International Journal of Retina and Vitreous.

[11]  Wei Wei,et al.  Repeatability of vessel density measurement in human skin by OCT‐based microangiography , 2017, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[12]  H. Lim,et al.  Repeatability of vessel density measurements using optical coherence tomography angiography in retinal diseases , 2018, British Journal of Ophthalmology.

[13]  Gangjun Liu,et al.  Handheld Optical Coherence Tomography Angiography and Ultra–Wide-Field Optical Coherence Tomography in Retinopathy of Prematurity , 2017, JAMA ophthalmology.

[14]  Martin F. Kraus,et al.  Split-spectrum amplitude-decorrelation angiography with optical coherence tomography , 2012, Optics express.

[15]  Yue Shi,et al.  Repeatability and Reproducibility of Superficial Macular Retinal Vessel Density Measurements Using Optical Coherence Tomography Angiography En Face Images , 2017, JAMA ophthalmology.

[16]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[17]  David Huang,et al.  Evaluation of artifact reduction in optical coherence tomography angiography with real-time tracking and motion correction technology. , 2016, Biomedical optics express.

[18]  Ali Borji,et al.  Pros and Cons of GAN Evaluation Measures , 2018, Comput. Vis. Image Underst..

[19]  Gangjun Liu,et al.  Regression-based algorithm for bulk motion subtraction in optical coherence tomography angiography. , 2017, Biomedical optics express.

[20]  Thomas Klein,et al.  High-speed OCT light sources and systems [Invited]. , 2017, Biomedical optics express.

[21]  Hao Zhou,et al.  A quantitative comparison of five optical coherence tomography angiography systems in clinical performance. , 2018, International journal of ophthalmology.

[22]  Giovanni Gregori,et al.  Altered Macular Microvasculature in Mild Cognitive Impairment and Alzheimer Disease , 2017, Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society.

[23]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[24]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[25]  David J. Wilson,et al.  Quantitative optical coherence tomography angiography of vascular abnormalities in the living human eye , 2015, Proceedings of the National Academy of Sciences.

[26]  M. Doughty,et al.  Further Analysis of the Human Spontaneous Eye Blink Rate by a Cluster Analysis-Based Approach to Categorize Individuals With ‘Normal’ Versus ‘Frequent’ Eye Blink Activity , 2006, Eye & contact lens.

[27]  Yibo Zhang,et al.  Deep learning enhanced mobile-phone microscopy , 2017, ACS Photonics.

[28]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[29]  Ruikang K. Wang,et al.  Optical coherence tomography based angiography [Invited]. , 2017, Biomedical optics express.

[30]  Xincheng Yao,et al.  Quantitative characteristics of sickle cell retinopathy in optical coherence tomography angiography. , 2017, Biomedical optics express.

[31]  Gangjun Liu,et al.  Optical Coherence Tomography Angiography , 2016, Investigative ophthalmology & visual science.

[32]  David Huang,et al.  Optical Coherence Tomography Angiography of the Peripapillary Retina in Glaucoma. , 2015, JAMA ophthalmology.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.