Despeckling of clinical ultrasound images using deep residual learning

Background and objective Ultrasound is the non-radioactive imaging modality used in the diagnosis of various diseases related to the internal organs of the body. The presence of speckle noise in ultrasound image (UI) is inevitable and may affect resolution and contrast of the image. Existence of the speckle noise degrades the visual evaluation of the image. The despeckling of UI is a desirable pre-processing step in computer-aided UI based diagnosis systems. Methods This paper proposes a novel method for despeckling UIs using pre-trained residual learning network (RLN). Initially, RLN is trained with pristine and its corresponding noisy images in order to achieve a better performance. The developed method chooses a pre-trained RLN for despeckling UIs with less computational resources. But the training procedure of RLN from scratch is computationally demanding. The pre-trained RLN is a blind despeckling approach and does not require any fine tuning and noise level estimation. The presented approach shows superiority in the removal of speckle noise as compared to the existing state-of-art methods. Results To highlight the effectiveness of the proposed method the pristine images from the Waterloo dataset has been considered. The proposed pre-trained RLN based UI despeckling method resulted in a better peak signal to noise ratio (PSNR) and structural similarity index measure (SSIM) at different speckle noise levels. The no-reference image quality approach is adopted to ensure robustness of the established method for real time UI. From results it is obvious that, the performance of the proposed method is superior than the existing methods in terms of naturalness image quality evaluator (NIQE). Conclusions From the experimental results, it is clear that the proposed method outperforms the existing despeckling methods in terms of both artificially added and naturally occurring speckle images.

[1]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[2]  K Kirk Shung,et al.  High Frequency Ultrasonic Imaging. , 2009, Journal of medical ultrasound.

[3]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[4]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[5]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Truong Q. Nguyen,et al.  Adaptive Image Denoising by Targeted Databases , 2014, IEEE Transactions on Image Processing.

[7]  Xiaorong Gao,et al.  Multi-Scale Nonlinear Thresholding for Ultrasonic Speckle Suppression , 1999, IEEE Trans. Medical Imaging.

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[10]  C. Burckhardt Speckle in ultrasound B-mode scans , 1978, IEEE Transactions on Sonics and Ultrasonics.

[11]  M. Ziskin,et al.  Fundamental physics of ultrasound and its propagation in tissue. , 1993, Radiographics : a review publication of the Radiological Society of North America, Inc.

[12]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[14]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[15]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Annupan Rodtook,et al.  Automatic initialization of active contours and level set method in ultrasound images of breast abnormalities , 2018, Pattern Recognit..

[18]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Lei Zhang,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models , 2017, IEEE Transactions on Image Processing.

[20]  Mahmoud R. El-Sakka,et al.  Patch-based models and algorithms for image denoising: a comparative review between patch-based images denoising methods for additive noise reduction , 2017, EURASIP Journal on Image and Video Processing.

[21]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Hadj Batatia,et al.  Iterative methods for anisotropic diffusion of speckled medical images , 2010 .

[25]  Prema T. Akkasaligar,et al.  Speckle Noise Reduction in Medical Ultrasound Images , 2013 .

[26]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Tzong-Jer Chen,et al.  Quality of Compressed Medical Images , 2007, Journal of Digital Imaging.

[28]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[29]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[30]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).