OCT Image Restoration Using Non-Local Deep Image Prior

In recent years, convolutional neural networks (CNN) have been widely used in image denoising for their high performance. One difficulty in applying the CNN to medical image denoising such as speckle reduction in the optical coherence tomography (OCT) image is that a large amount of high-quality data is required for training, which is an inherent limitation for OCT despeckling. Recently, deep image prior (DIP) networks have been proposed for image restoration without pre-training since the CNN structures have the intrinsic ability to capture the low-level statistics of a single image. However, the DIP has difficulty finding a good balance between maintaining details and suppressing speckle noise. Inspired by DIP, in this paper, a sorted non-local statics which measures the signal autocorrelation in the differences between the constructed image and the input image is proposed for OCT image restoration. By adding the sorted non-local statics as a regularization loss in the DIP learning, more low-level image statistics are captured by CNN networks in the process of OCT image restoration. The experimental results demonstrate the superior performance of the proposed method over other state-of-the-art despeckling methods, in terms of objective metrics and visual quality.

[1]  Theo Lasser,et al.  Speckle statistics in optical coherence tomography. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Shutao Li,et al.  Fast Acquisition and Reconstruction of Optical Coherence Tomography Images via Sparse Representation , 2013, IEEE Transactions on Medical Imaging.

[3]  Qiong Zhang,et al.  Multi-focus image fusion via morphological similarity-based dictionary construction and sparse representation , 2018, CAAI Trans. Intell. Technol..

[4]  Yuan-Kai Wang,et al.  Fully Symmetric Convolutional Network for Effective Image Denoising , 2019, Applied Sciences.

[5]  Changhuei Yang,et al.  Sensitivity advantage of swept source and Fourier domain optical coherence tomography. , 2003, Optics express.

[6]  Zhaoxia Yu,et al.  Speckle attenuation in optical coherence tomography by curvelet shrinkage. , 2009, Optics letters.

[7]  Nguyen Quoc Khanh Le,et al.  ET-GRU: using multi-layer gated recurrent units to identify electron transport proteins , 2019, BMC Bioinformatics.

[8]  Zhenkun Lei,et al.  BM3D-based total variation algorithm for speckle removal with structure-preserving in OCT images. , 2019, Applied optics.

[9]  Jichai Jeong,et al.  Effective speckle noise suppression in optical coherence tomography images using nonlocal means denoising filter with double Gaussian anisotropic kernels , 2015 .

[10]  Eric L Yuan,et al.  Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. , 2014, Ophthalmology.

[11]  Shutao Li,et al.  Sparsity based denoising of spectral domain optical coherence tomography images , 2012, Biomedical optics express.

[12]  Nguyen Quoc Khanh Le,et al.  Fertility-GRU: Identifying fertility-related proteins by incorporating deep gated recurrent units and original PSSM profiles. , 2019, Journal of proteome research.

[13]  P. C. Chui,et al.  Speckle reduction of retinal optical coherence tomography based on contourlet shrinkage. , 2013, Optics letters.

[14]  Xi Liu,et al.  Noise reduction in optical coherence tomography images using a deep neural network with perceptually-sensitive loss function. , 2020, Biomedical optics express.

[15]  Jianlin Gao,et al.  Probability-based non-local means filter for speckle noise suppression in optical coherence tomography images. , 2016, Optics letters.

[16]  Guangming Shi,et al.  Denoising Prior Driven Deep Neural Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xin Yuan,et al.  Noise adaptive wavelet thresholding for speckle noise removal in optical coherence tomography. , 2017, Biomedical optics express.

[18]  Hiroshi Ishikawa,et al.  Retinal optical coherence tomography image enhancement via deep learning. , 2018, Biomedical optics express.

[19]  René Restrepo,et al.  Volumetric non-local-means based speckle reduction for optical coherence tomography. , 2018, Biomedical optics express.

[20]  Joachim Hornegger,et al.  Wavelet denoising of multiframe optical coherence tomography data , 2012, Biomedical optics express.

[21]  Yu-Yen Ou,et al.  Incorporating deep learning with convolutional neural networks and position specific scoring matrices for identifying electron transport proteins , 2017, J. Comput. Chem..

[22]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.