Explicit Ringing Removal in Image Deblurring

In this paper, we present a simple yet effective image deblurring method to produce ringing-free deblurred images. Our work is inspired by the observation that large-scale deblurring ringing artifacts are measurable through a multi-resolution pyramid of low-pass filtering of the blurred-deblurred image pair. We propose to model such a quantification as a convex cost function and minimize it directly in the deblurring process in order to reduce ringing regardless of its cause. An efficient primal-dual algorithm is proposed as a solution to this optimization problem. Since the regularization is more biased toward ringing patterns, the details of the reconstructed image are prevented from over-smoothing. An inevitable source of ringing is sensor saturation which can be detected costlessly contrary to most other sources of ringing. However, dealing with the saturation effect in deblurring introduces a non-linear operator in optimization problem. In this paper, we also introduce a linear approximation as a solution to handling saturation in the proposed deblurring method. As a result of these steps, we significantly enhance the quality of the deblurred images. Experimental results and quantitative evaluations demonstrate that the proposed method performs favorably against state-of-the-art image deblurring methods.

[1]  Daniele Perrone,et al.  A Clearer Picture of Total Variation Blind Deconvolution , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jean-Michel Morel,et al.  The Non-parametric Sub-pixel Local Point Spread Function Estimation Is a Well Posed Problem , 2011, International Journal of Computer Vision.

[3]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[4]  Yanning Zhang,et al.  Multi-Observation Blind Deconvolution with an Adaptive Sparse Prior , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Andrew Zisserman,et al.  Deblurring shaken and partially saturated images , 2011, ICCV Workshops.

[7]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[8]  Gwendoline Blanchet,et al.  Automatic detection of well sampled images via a new ringing measure , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[10]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[11]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[12]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[13]  Michael S. Brown,et al.  Nonlinear camera response functions and image deblurring , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Ming-Hsuan Yang,et al.  $L_0$ -Regularized Intensity and Gradient Prior for Deblurring Text Images and Beyond , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Stephen Lin,et al.  Image/video deblurring using a hybrid camera , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Narendra Ahuja,et al.  A Comparative Study for Single Image Blind Deblurring , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Lionel Moisan,et al.  The Shannon Total Variation , 2017, Journal of Mathematical Imaging and Vision.

[18]  Luís B. Almeida,et al.  Blind and Semi-Blind Deblurring of Natural Images , 2010, IEEE Transactions on Image Processing.

[19]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[20]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[21]  Ming-Hsuan Yang,et al.  Deblurring Text Images via L0-Regularized Intensity and Gradient Prior , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Junfeng Yang,et al.  An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise , 2009, SIAM J. Sci. Comput..

[23]  Lionel Moisan,et al.  No-Reference Image Quality Assessment and Blind Deblurring with Sharpness Metrics Exploiting Fourier Phase Information , 2015, Journal of Mathematical Imaging and Vision.

[24]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[26]  Olvi L. Mangasarian,et al.  A class of smoothing functions for nonlinear and mixed complementarity problems , 1996, Comput. Optim. Appl..

[27]  Truong Q. Nguyen,et al.  An Augmented Lagrangian Method for Total Variation Video Restoration , 2011, IEEE Transactions on Image Processing.

[28]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[29]  Nikolas P. Galatsanos,et al.  Regularized constrained total least-squares image restoration , 1994, Other Conferences.

[30]  Adam Finkelstein,et al.  A no-reference metric for evaluating the quality of motion deblurring , 2013, ACM Trans. Graph..

[31]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[32]  Michael S. Brown,et al.  Nonlinear Camera Response Functions and Image Deblurring: Theoretical Analysis and Practice , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[34]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[35]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Hui Ma,et al.  Image Deblurring with Blurred / Noisy Image Pairs , 2013 .

[37]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[38]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  J. M. Pierre Langlois,et al.  Image Deconvolution Ringing Artifact Detection and Removal via PSF Frequency Analysis , 2014, ECCV.

[40]  Bernhard Schölkopf,et al.  Learning to Deblur , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[42]  J. M. Pierre Langlois,et al.  Camera intrinsic blur kernel estimation: A reliable framework , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  S. B. Kang,et al.  Image deblurring using inertial measurement sensors , 2010, SIGGRAPH 2010.

[44]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[45]  Jian Sun,et al.  Progressive inter-scale and intra-scale non-blind image deconvolution , 2008, SIGGRAPH 2008.

[46]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[47]  Yuanyuan Ding,et al.  Design and Estimation of Coded Exposure Point Spread Functions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[49]  Feng Li,et al.  A Theoretical Analysis of Camera Response Functions in Image Deblurring , 2012, ECCV.

[50]  Nahum Kiryati,et al.  Image Deblurring in the Presence of Impulsive Noise , 2006, International Journal of Computer Vision.

[51]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[52]  Ingrid Heynderickx,et al.  A Perceptually Relevant Approach to Ringing Region Detection , 2010, IEEE Transactions on Image Processing.

[53]  Aggelos K. Katsaggelos,et al.  Bayesian Blind Deconvolution with General Sparse Image Priors , 2012, ECCV.

[54]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[55]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[56]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[57]  Qionghai Dai,et al.  Exploring aligned complementary image pair for blind motion deblurring , 2011, CVPR 2011.