Learnable despeckling framework for optical coherence tomography images

Abstract. Optical coherence tomography (OCT) is a prevalent, interferometric, high-resolution imaging method with broad biomedical applications. Nonetheless, OCT images suffer from an artifact called speckle, which degrades the image quality. Digital filters offer an opportunity for image improvement in clinical OCT devices, where hardware modification to enhance images is expensive. To reduce speckle, a wide variety of digital filters have been proposed; selecting the most appropriate filter for an OCT image/image set is a challenging decision, especially in dermatology applications of OCT where a different variety of tissues are imaged. To tackle this challenge, we propose an expandable learnable despeckling framework, we call LDF. LDF decides which speckle reduction algorithm is most effective on a given image by learning a figure of merit (FOM) as a single quantitative image assessment measure. LDF is learnable, which means when implemented on an OCT machine, each given image/image set is retrained and its performance is improved. Also, LDF is expandable, meaning that any despeckling algorithm can easily be added to it. The architecture of LDF includes two main parts: (i) an autoencoder neural network and (ii) filter classifier. The autoencoder learns the FOM based on several quality assessment measures obtained from the OCT image including signal-to-noise ratio, contrast-to-noise ratio, equivalent number of looks, edge preservation index, and mean structural similarity index. Subsequently, the filter classifier identifies the most efficient filter from the following categories: (a) sliding window filters including median, mean, and symmetric nearest neighborhood, (b) adaptive statistical-based filters including Wiener, homomorphic Lee, and Kuwahara, and (c) edge preserved patch or pixel correlation-based filters including nonlocal mean, total variation, and block matching three-dimensional filtering.

[1]  Peter E. Andersen,et al.  Speckle reduction in optical coherence tomography images of human skin by a spatial diversity method , 2007, European Conference on Biomedical Optics.

[2]  Ali Hojjatoleslami,et al.  OCT skin image enhancement through attenuation compensation. , 2012, Applied optics.

[3]  Daniel S. Elson,et al.  Morphological analysis of optical coherence tomography images for automated classification of gastrointestinal tissues , 2011, Biomedical optics express.

[4]  James O. Ramsay,et al.  Functional Data Analysis , 2005 .

[5]  Daniel L Marks,et al.  Speckle reduction by I-divergence regularization in optical coherence tomography. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Yrjö Neuvo,et al.  A New Class of Detail-Preserving Filters for Image Processing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  J. Schmitt,et al.  Speckle in optical coherence tomography. , 1999, Journal of biomedical optics.

[8]  Alexander Wong,et al.  General Bayesian estimation for speckle noise reduction in optical coherence tomography retinal imagery. , 2010, Optics express.

[9]  Aydogan Ozcan,et al.  Speckle reduction in optical coherence tomography images using digital filtering. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  Adrian Stern,et al.  Speckle denoising in digital holography by nonlocal means filtering. , 2013, Applied optics.

[11]  Joseph M. Schmitt,et al.  Optical coherence tomography (OCT): a review , 1999 .

[12]  Ahmed H. Samak,et al.  A New Nonlinear Anisotropic - Wiener Method for Speckle Noise Reduction in Optical Coherence Tomography , 2013 .

[13]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Dacheng Tao,et al.  Speckle Reduction in 3D Optical Coherence Tomography of Retina by A-Scan Reconstruction , 2016, IEEE Trans. Medical Imaging.

[15]  Adrian Podoleanu,et al.  En-face time-domain optical coherence tomography with dynamic focus for high-resolution imaging , 2017, Journal of biomedical optics.

[16]  Kostadinka Bizheva,et al.  Speckle noise reduction algorithm for optical coherence tomography based on interval type II fuzzy set. , 2007, Optics express.

[17]  Yu Chen,et al.  Effects of axial resolution improvement on optical coherence tomography (OCT) imaging of gastrointestinal tissues. , 2008, Optics express.

[18]  P. Shankar Speckle Reduction in Ultrasound B-Scans Using Weighted Averaging in Spatial Compounding , 1986, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[19]  T. Tkaczyk,et al.  Texture analysis of optical coherence tomography images: feasibility for tissue classification. , 2003, Journal of biomedical optics.

[20]  Mohammadreza Nasiriavanaki,et al.  An overview of methods to mitigate artifacts in optical coherence tomography imaging of the skin , 2018, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[21]  Jong-Sen Lee,et al.  Speckle analysis and smoothing of synthetic aperture radar images , 1981 .

[22]  Mohammad R. N. Avanaki,et al.  Spatial Compounding Algorithm for Speckle Reduction of Dynamic Focus OCT Images , 2013, IEEE Photonics Technology Letters.

[23]  H. M. Salinas,et al.  Comparison of PDE-Based Nonlinear Diffusion Approaches for Image Enhancement and Denoising in Optical Coherence Tomography , 2007, IEEE Transactions on Medical Imaging.

[24]  H. Lemij,et al.  Depth-resolved model-based reconstruction of attenuation coefficients in optical coherence tomography. , 2013, Biomedical optics express.

[25]  Mark E. Brezinski,et al.  Evaluation of the adaptive speckle suppression filter for coronary optical coherence tomography imaging , 2000, IEEE Transactions on Medical Imaging.

[26]  J. Goodman Speckle Phenomena in Optics: Theory and Applications , 2020 .

[27]  Lucas J. van Vliet,et al.  Edge preserving orientation adaptive filtering , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Stuart K Williams,et al.  Texture analysis of speckle in optical coherence tomography images of tissue phantoms. , 2006, Physics in medicine and biology.

[29]  Yoshinori Funama,et al.  Reduction of artifacts in degraded CT image by adaptive Wiener filter , 2002 .

[30]  Tae Joong Eom,et al.  Speckle reduction using an artificial neural network algorithm. , 2013, Applied optics.

[31]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[32]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[33]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[34]  Larry S. Davis,et al.  A new class of edge-preserving smoothing filters , 1987, Pattern Recognit. Lett..

[35]  E. Nezry,et al.  Adaptive speckle filters and scene heterogeneity , 1990 .

[36]  Shoude Chang,et al.  Signal attenuation and box-counting fractal analysis of optical coherence tomography images of arterial tissue , 2010, Biomedical optics express.

[37]  J. Fujimoto,et al.  Speckle reduction in optical coherence tomography images by use of a spatially adaptive wavelet filter. , 2004, Optics letters.

[38]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[39]  安藤 寛,et al.  Cross-Validation , 1952, Encyclopedia of Machine Learning and Data Mining.

[40]  Changhuei Yang,et al.  Sensitivity advantage of swept source and Fourier domain optical coherence tomography. , 2003, Optics express.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  S. A. Hojjatoleslami,et al.  Image quality improvement in optical coherence tomography using Lucy-Richardson deconvolution algorithm. , 2013, Applied optics.

[43]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[44]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[45]  Karen O. Egiazarian,et al.  Image restoration by sparse 3D transform-domain collaborative filtering , 2008, Electronic Imaging.

[46]  Freddy T. Nguyen,et al.  Optical coherence tomography: a review of clinical development from bench to bedside. , 2007, Journal of biomedical optics.

[47]  Angelika Unterhuber,et al.  Optical coherence tomography today: speed, contrast, and multimodality , 2014, Journal of biomedical optics.

[48]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.