Efficient learning-based blur removal method based on sparse optimization for image restoration

In imaging systems, image blurs are a major source of degradation. This paper proposes a parameter estimation technique for linear motion blur, defocus blur, and atmospheric turbulence blur, and a nonlinear deconvolution algorithm based on sparse representation. Most blur removal techniques use image priors to estimate the point spread function (PSF); however, many common forms of image priors are unable to exploit local image information fully. In this paper, the proposed method does not require models of image priors. Further, it is capable of estimating the PSF accurately from a single input image. First, a blur feature in the image gradient domain is introduced, which has a positive correlation with the degree of blur. Next, the parameters for each blur type are estimated by a learning-based method using a general regression neural network. Finally, image restoration is performed using a half-quadratic optimization algorithm. Evaluation tests confirmed that the proposed method outperforms other similar methods and is suitable for dealing with motion blur in real-life applications.

[1]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[2]  Xin Zhang,et al.  Restoration of single image based on kernel estimation with L1-regularization method , 2017, International Conference on Digital Image Processing.

[3]  Jiaya Jia,et al.  Reducing boundary artifacts in image deconvolution , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[5]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[6]  Jing Wu,et al.  Method of Image Quality Improvement for Atmospheric Turbulence Degradation Sequence Based on Graph Laplacian Filter and Nonrigid Registration , 2018, Mathematical Problems in Engineering.

[7]  John G. Proakis,et al.  Digital Signal Processing Using MATLAB: A Problem Solving Companion , 2016 .

[8]  Kun Il Park,et al.  Fundamentals of Probability and Stochastic Processes with Applications to Communications , 2017 .

[9]  M. Moghaddam,et al.  A Mathematical Model to Estimate Out of Focus Blur , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[10]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[11]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[12]  Josiane Zerubia,et al.  An adaptive Gaussian model for satellite image deblurring , 2004, IEEE Transactions on Image Processing.

[13]  Wesley E. Snyder,et al.  Machine Vision: Index , 2010 .

[14]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[15]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[16]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[17]  K. Siddaraju,et al.  DIGITAL IMAGE RESTORATION , 2011 .

[18]  Bernhard Schölkopf,et al.  A Machine Learning Approach for Non-blind Image Deconvolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  João Pedro Hespanha,et al.  Linear Systems Theory , 2009 .

[21]  Banshidhar Majhi,et al.  Motion blur parameters estimation for image restoration , 2014 .

[22]  Franck Vermet,et al.  Statistical Learning Methods , 2018 .

[23]  Thomas S. Huang,et al.  Sparse representation based blind image deblurring , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  Hamid Hassanpour,et al.  Local motion deblurring using an effective image prior based on both the first- and second-order gradients , 2017, Machine Vision and Applications.

[26]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[27]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Richard Szeliski,et al.  Image deblurring and denoising using color priors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[30]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[31]  K. Egiazarian,et al.  Blind image deconvolution , 2007 .

[32]  Hore,et al.  [IEEE 2010 20th International Conference on Pattern Recognition (ICPR) - Istanbul, Turkey (2010.08.23-2010.08.26)] 2010 20th International Conference on Pattern Recognition - Image Quality Metrics: PSNR vs. SSIM , 2010 .

[33]  Raveendran Paramesran,et al.  Tchebichef moment based restoration of Gaussian blurred images. , 2016, Applied optics.

[34]  Mansour Jamzad,et al.  Linear Motion Blur Parameter Estimation in Noisy Images Using Fuzzy Sets and Power Spectrum , 2007, EURASIP J. Adv. Signal Process..

[35]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[36]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[37]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[38]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[39]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[40]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[41]  Hujun Yin,et al.  Independent component analysis and nongaussianity for blind image deconvolution and deblurring , 2008, Integr. Comput. Aided Eng..

[42]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[43]  William T. Freeman,et al.  What makes a good model of natural images? , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  P. Good,et al.  Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses , 1995 .

[45]  David H. Kaye,et al.  Reference Guide on Statistics , 2011 .

[46]  Gene H. Golub,et al.  Matrix computations , 1983 .

[47]  Ling Shao,et al.  Blind Image Blur Estimation via Deep Learning , 2016, IEEE Transactions on Image Processing.

[48]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[50]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[51]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[52]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[53]  Andrey S. Krylov,et al.  Adaptive Image Deblurring with Ringing Control , 2009, 2009 Fifth International Conference on Image and Graphics.

[54]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[55]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[58]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[59]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..