Reconstruction of visible light optical coherence tomography images retrieved from discontinuous spectral data using a conditional generative adversarial network

Achieving high resolution in optical coherence tomography typically requires the continuous extension of the spectral bandwidth of the light source. This work demonstrates an alternative approach: combining two discrete spectral windows located in the visible spectrum with a trained conditional generative adversarial network (cGAN) to reconstruct a high-resolution image equivalent to that generated using a continuous spectral band. The cGAN was trained using OCT image pairs acquired with the continuous and discontinuous visible range spectra to learn the relation between low- and high-resolution data. The reconstruction performance was tested using 6000 B-scans of a layered phantom, micro-beads and ex-vivo mouse ear tissue. The resultant cGAN-generated images demonstrate an image quality and axial resolution which approaches that of the high-resolution system.

[1]  Yanmei Liang,et al.  Axial Super-Resolution Study for Optical Coherence Tomography Images Via Deep Learning , 2020, IEEE Access.

[2]  R. Hogg,et al.  Development of a broadband superluminescent diode based on self-assembled InAs quantum dots and demonstration of high-axial-resolution optical coherence tomography imaging , 2019, Journal of Physics D: Applied Physics.

[3]  Marco Augustin,et al.  Revealing brain pathologies with multimodal visible light optical coherence microscopy and fluorescence imaging , 2019, Journal of biomedical optics.

[4]  Marco Augustin,et al.  Assessment of pathological features in Alzheimer’s disease brain tissue with a large field-of-view visible-light optical coherence microscope , 2018, Neurophotonics.

[5]  Shenghua Gao,et al.  Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders , 2019, Translational vision science & technology.

[6]  Yu Gan,et al.  Super-resolution technology to simultaneously improve optical & digital resolution of optical coherence tomography via deep learning , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[7]  Mohammad Shorif Uddin,et al.  Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study , 2019, Journal of Computer and Communications.

[8]  Hao F. Zhang,et al.  Visible-light optical coherence tomography: a review , 2017, Journal of biomedical optics.

[9]  Theo Lasser,et al.  Visible spectrum extended-focus optical coherence microscopy for label-free sub-cellular tomography. , 2017, Biomedical optics express.

[10]  Jianjun Lei,et al.  Loss Functions of Generative Adversarial Networks (GANs): Opportunities and Challenges , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.

[11]  Dacheng Tao,et al.  Perceptual Adversarial Networks for Image-to-Image Transformation , 2017, IEEE Transactions on Image Processing.

[12]  Guang Yang,et al.  Generative Adversarial Networks (GAN) Powered Fast Magnetic Resonance Imaging - Mini Review, Comparison and Perspectives , 2021, ArXiv.

[13]  Wei Wang,et al.  Deep Learning for Single Image Super-Resolution: A Brief Review , 2018, IEEE Transactions on Multimedia.

[14]  Tadaaki Kirita,et al.  Regularized Three-Dimensional Generative Adversarial Nets for Unsupervised Metal Artifact Reduction in Head and Neck CT Images , 2020, IEEE Access.

[15]  Zheping Yan,et al.  Improving the Resolution of Retinal OCT with Deep Learning , 2018, MIUA.

[16]  Renu Tripathi,et al.  Spectral shaping for non-Gaussian source spectra in optical coherence tomography. , 2002, Optics letters.

[17]  Linbo Liu,et al.  Spectral estimation optical coherence tomography for axial super-resolution. , 2015, Optics express.

[18]  Bor-Wen Yang,et al.  Full-color skin imaging using RGB LED and floating lens in optical coherence tomography , 2010, Biomedical optics express.

[19]  Stefan Kray,et al.  Simultaneous dual-band ultra-high resolution optical coherence tomography. , 2007, Optics express.

[20]  Yu-Min Lin,et al.  Applying RGB LED in full-field optical coherence tomography for real-time full-color tissue imaging. , 2014, Applied optics.

[21]  Ziyang Zeng,et al.  DN-GAN: Denoising generative adversarial networks for speckle noise reduction in optical coherence tomography images , 2020, Biomed. Signal Process. Control..

[22]  Amir Mosavi,et al.  Deep Learning: A Review , 2018 .

[23]  O. Bang,et al.  A comparative study of noise in supercontinuum light sources for ultra-high resolution optical coherence tomography , 2017, BiOS.

[24]  Bernhard Baumann,et al.  Optical Coherence Tomography for Brain Imaging , 2019 .

[25]  Christoph K. Hitzenberger,et al.  Spectroscopic imaging with spectral domain visible light optical coherence microscopy in Alzheimer’s disease brain samples , 2017, Biomedical optics express.

[26]  P. Alam ‘T’ , 2021, Composites Engineering: An A–Z Guide.

[27]  Adam Wax,et al.  Noise characterization of supercontinuum sources for low-coherence interferometry applications. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Faraz Oloumi,et al.  Deep learning in ophthalmology: a review. , 2018, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[29]  Danielle J. Harper,et al.  Hyperspectral optical coherence tomography for in vivo visualization of melanin in the retinal pigment epithelium , 2019, Journal of biophotonics.

[30]  Christoph K. Hitzenberger,et al.  White light polarization sensitive optical coherence tomography for sub-micron axial resolution and spectroscopic contrast in the murine retina , 2018, Biomedical optics express.

[31]  S. Gloor,et al.  840-nm combined-SLED source integrated in 14-pin butterfly module with 140-nm bandwidth , 2019, European Conference on Biomedical Optics.

[32]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[33]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[34]  Thilo Gambichler,et al.  Applications of optical coherence tomography in dermatology. , 2005, Journal of dermatological science.

[35]  Evgenia Bousi,et al.  Axial resolution improvement by modulated deconvolution in Fourier domain optical coherence tomography , 2012, Journal of biomedical optics.

[36]  Yue Wu,et al.  Generating retinal flow maps from structural optical coherence tomography with artificial intelligence , 2018, Scientific Reports.

[37]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[38]  A. Fercher,et al.  Submicrometer axial resolution optical coherence tomography. , 2002, Optics letters.

[39]  Michal Lipson,et al.  Chip-based frequency comb sources for optical coherence tomography. , 2019, Optics express.

[40]  Nanshuo Wang,et al.  Optical Coherence Tomography With Gapped Spectrum , 2019, IEEE Photonics Journal.

[41]  Mathias Fink,et al.  Dynamic multimodal full-field optical coherence tomography and fluorescence structured illumination microscopy , 2017, Journal of biomedical optics.

[42]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[43]  Felipe A. Medeiros,et al.  From Machine to Machine: An OCT-trained Deep Learning Algorithm for Objective Quantification of Glaucomatous Damage in Fundus Photographs , 2018, Ophthalmology.

[44]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[45]  Yochai Blau,et al.  The Perception-Distortion Tradeoff , 2017, CVPR.

[46]  Kaicheng Liang,et al.  Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography. , 2020, Biomedical optics express.

[47]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Ali Borji,et al.  Cross-View Image Synthesis Using Conditional GANs , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[49]  Deok Won Kim,et al.  The possibility of the combination of OCT and fundus images for improving the diagnostic accuracy of deep learning for age-related macular degeneration: a preliminary experiment , 2018, Medical & Biological Engineering & Computing.

[50]  Bin Yang,et al.  MedGAN: Medical Image Translation using GANs , 2018, Comput. Medical Imaging Graph..

[51]  Thomas Klein,et al.  High-speed OCT light sources and systems [Invited]. , 2017, Biomedical optics express.

[52]  Aaron Y. Lee,et al.  Artificial intelligence and deep learning in ophthalmology , 2018, British Journal of Ophthalmology.

[53]  Michalina J Gora,et al.  Endoscopic optical coherence tomography: technologies and clinical applications [Invited]. , 2017, Biomedical optics express.

[54]  Bor-Wen Yang,et al.  Applying LED in full-field optical coherence tomography for gastrointestinal endoscopy , 2015 .

[55]  Ali Borji,et al.  Pros and Cons of GAN Evaluation Measures , 2018, Comput. Vis. Image Underst..

[56]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[57]  W. Drexler,et al.  Ultra-high-resolution SD-OCM imaging with a compact polarization-aligned 840 nm broadband combined-SLED source. , 2020, Biomedical optics express.

[58]  Ji Yi,et al.  In vivo functional microangiography by visible-light optical coherence tomography. , 2014, Biomedical optics express.

[59]  S. Gloor,et al.  A compact red-green-blue superluminescent diode module: A novel light source for AR microdisplays , 2019, Other Conferences.

[60]  Wolfgang Drexler,et al.  State-of-the-art retinal optical coherence tomography , 2008, Progress in Retinal and Eye Research.

[61]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[62]  Jiliu Zhou,et al.  Simultaneous denoising and super-resolution of optical coherence tomography images based on generative adversarial network. , 2019, Optics express.