Despeckling CNN with Ensembles of Classical Outputs

Ultrasound (US) image despeckling is a problem of high clinical importance. Machine learning solutions to the problem are considered impractical due to the unavailability of speckle-free US image dataset. On the other hand, the classical approaches, which are able to provide the desired outputs, have limitations like input dependent parameter tuning. In this work, a convolutional neural network (CNN) is developed which learns to remove speckle from US images using the outputs of these classical approaches. It is observed that the existing approaches can be combined in a complementary manner to generate an output better than their individual outputs. Thus, the CNN is trained using the individual outputs as well as the output ensembles. It eliminates the cumbersome process of parameter tuning required by the existing approaches for every new input. Further, the proposed CNN is able to outperform the state-of-the-art despeckling approaches and produces the outputs even better than the ensembles for certain images.

[1]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[2]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[3]  Santiago Aja-Fernández,et al.  On the estimation of the coefficient of variation for anisotropic diffusion speckle filtering , 2006, IEEE Transactions on Image Processing.

[4]  Yuzhong Shen,et al.  Speckle reduction of ultrasound images based on Rayleigh-trimmed anisotropic diffusion filter , 2011, Pattern Recognit. Lett..

[5]  Xinghao Ding,et al.  Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal , 2016, IEEE Transactions on Image Processing.

[6]  Fan Zhang,et al.  Nonlinear Diffusion in Laplacian Pyramid Domain for Ultrasonic Speckle Reduction , 2007, IEEE Transactions on Medical Imaging.

[7]  Cristian Munteanu,et al.  Speckle Reduction Through Interactive Evolution of a General Order Statistics Filter for Clinical Ultrasound Imaging , 2008, IEEE Transactions on Biomedical Engineering.

[8]  Santanu Chaudhury,et al.  Edge Aware Geometric Filter for Ultrasound Image Enhancement , 2017, MIUA.

[9]  Purang Abolmaesumi,et al.  Nonlocal means filter-based speckle tracking , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  John W. Clark,et al.  Nonlinear multiscale wavelet diffusion for speckle suppression and edge enhancement in ultrasound images , 2006, IEEE Transactions on Medical Imaging.

[12]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Santanu Chaudhury,et al.  Unsupervised Despeckling , 2018, ArXiv.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Carl-Fredrik Westin,et al.  Oriented Speckle Reducing Anisotropic Diffusion , 2007, IEEE Transactions on Image Processing.

[17]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[18]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[19]  Alexander M. Bronstein,et al.  Towards CT-quality Ultrasound Imaging using Deep Learning , 2017, ArXiv.

[20]  Santanu Chaudhury,et al.  Edge Probability and Pixel Relativity-Based Speckle Reducing Anisotropic Diffusion , 2018, IEEE Transactions on Image Processing.

[21]  Jae Young Lee,et al.  A New Feature-Enhanced Speckle Reduction Method Based on Multiscale Analysis for Ultrasound B-Mode Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[22]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[23]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[24]  Vishal M. Patel,et al.  SAR Image Despeckling Using a Convolutional Neural Network , 2017, IEEE Signal Processing Letters.

[25]  Scott T. Acton,et al.  Ultrasound Despeckling for Contrast Enhancement , 2010, IEEE Transactions on Image Processing.

[26]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Benny Bürger,et al.  Real-Time GPU-Based Ultrasound Simulation Using Deformable Mesh Models , 2013, IEEE Transactions on Medical Imaging.

[29]  Petia Radeva,et al.  SRBF: Speckle reducing bilateral filtering. , 2010, Ultrasound in medicine & biology.

[30]  Marcos Martin-Fernandez,et al.  Anisotropic Diffusion Filter With Memory Based on Speckle Statistics for Ultrasound Images , 2015, IEEE Transactions on Image Processing.