Blind Deblurring via a Novel Recursive Deep CNN Improved by Wavelet Transform

Blind image deconvolution is an ill-posed problem, which is mainly addressed by the regularization methods. Wavelet transform is an effective denoising method related to regularized inversion. In this paper, wavelet transform is utilized to decompose and extract the low- and high-frequency information of the blurred image, which is taken as the first step of the presented deblurring methods in this paper. However, when the process highlights the approximate portion of the image feature, the blurry image will be smoothed so that the image is distorted. Simultaneously, the overall wavelet transform will result in excessive data redundancy for the image. Thus, in the second step, based upon the recursive convolution neural network, a deep recursive convolutional neural network (R-DbCNN) is designed, which can eliminate or weaken the characteristics of high data redundancy and image smoothness caused by wavelet transform to remove the blur of corrupted image. Comparing with the traditional convolution neural network in image restoration, R-DbCNN has better performance in deblurring with fast training speed. Thereafter, a novel loss function is built to attain the best deblurring effect of the proposed method based on the $L_{2}$ regularization term. The experiment results demonstrate that our method has practical applicability for image restoration with different blurs, such as the motion blur, Gaussian blur, and out-of-focus by camera.

[1]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[2]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[3]  Michael Möller,et al.  Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Dinesh Rajan,et al.  Unified Blind Method for Multi-Image Super-Resolution and Single/Multi-Image Blur Deconvolution , 2013, IEEE Transactions on Image Processing.

[5]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[6]  Chinchen Chang,et al.  An Adaptive Median Filter for Image Denoising , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[7]  Wolfgang Heidrich,et al.  Stochastic Blind Motion Deblurring , 2015, IEEE Transactions on Image Processing.

[8]  Sebastian Nowozin,et al.  Discriminative Non-blind Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Graham W. Taylor,et al.  Deconvolutional networks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Shiqiang Yang,et al.  Multi-scale blind motion deblurring using local minimum , 2009 .

[11]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[12]  Javier Portilla,et al.  Image Restoration Using Space-Variant Gaussian Scale Mixtures in Overcomplete Pyramids , 2008, IEEE Transactions on Image Processing.

[13]  Yo-Sung Ho,et al.  High-quality non-blind image deconvolution with adaptive regularization , 2011, J. Vis. Commun. Image Represent..

[14]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[15]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[16]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[17]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  M. Ekstrom,et al.  Digital image processing , 1980, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[19]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[22]  Andrew Zisserman,et al.  Deblurring shaken and partially saturated images , 2011, ICCV Workshops.

[23]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[24]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jos B. T. M. Roerdink,et al.  Denoising functional MR images: a comparison of wavelet denoising and Gaussian smoothing , 2004, IEEE Transactions on Medical Imaging.

[26]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[27]  Stefan Roth,et al.  Bayesian deblurring with integrated noise estimation , 2011, CVPR 2011.

[28]  S. Jiang,et al.  Hybrid Fourier-wavelet image denoising , 2007 .

[29]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[30]  Bernhard Schölkopf,et al.  A Machine Learning Approach for Non-blind Image Deconvolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[33]  Paul W. Fieguth,et al.  Adaptive Wiener filtering of noisy images and image sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[34]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[35]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[36]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[37]  Kai-Kuang Ma,et al.  Tri-state median filter for image denoising , 1999, IEEE Trans. Image Process..

[38]  Pierre Weiss,et al.  A Variational Model for Multiplicative Structured Noise Removal , 2016, Journal of Mathematical Imaging and Vision.

[39]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).