A Flexible Space-Variant Anisotropic Regularization for Image Restoration with Automated Parameter Selection

We propose a new space-variant anisotropic regularisation term for variational image restoration, based on the statistical assumption that the gradients of the target image distribute locally according to a bivariate generalised Gaussian distribution. The highly flexible variational structure of the corresponding regulariser encodes several free parameters which hold the potential for faithfully modelling the local geometry in the image and describing local orientation preferences. For an automatic estimation of such parameters, we design a robust maximum likelihood approach and report results on its reliability on synthetic data and natural images. For the numerical solution of the corresponding image restoration model, we use an iterative algorithm based on the Alternating Direction Method of Multipliers (ADMM). A suitable preliminary variable splitting together with a novel result in multivariate non-convex proximal calculus yield a very efficient minimisation algorithm. Several numerical results showing significant quality-improvement of the proposed model with respect to some related state-of-the-art competitors are reported, in particular in terms of texture and detail preservation.

[1]  Joachim Weickert,et al.  Justifying Tensor-Driven Diffusion from Structure-Adaptive Statistics of Natural Images , 2015, EMMCVPR.

[2]  Serena Morigi,et al.  Image restoration with Poisson–Gaussian mixed noise , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[3]  L. Vese A Study in the BV Space of a Denoising—Deblurring Variational Problem , 2001 .

[4]  Marta M. Betcke,et al.  Multicontrast MRI Reconstruction with Structure-Guided Total Variation , 2015, SIAM J. Imaging Sci..

[5]  Serena Morigi,et al.  Constrained TV p -ℓ 2 Model for Image Restoration. , 2016 .

[6]  Martin Burger,et al.  ERROR ESTIMATES FOR GENERAL FIDELITIES , 2011 .

[7]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[8]  Chak-Kuen Wong,et al.  Total variation image restoration: numerical methods and extensions , 1997, Proceedings of International Conference on Image Processing.

[9]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[10]  Kai-Sheng Song,et al.  A globally convergent and consistent method for estimating the shape parameter of a generalized Gaussian distribution , 2006, IEEE Transactions on Information Theory.

[11]  Trust-Region Regularization,et al.  Nonconvex TV q -Models in Image Restoration: Analysis and a , 2011 .

[12]  Carola-Bibiane Schönlieb,et al.  Bilevel approaches for learning of variational imaging models , 2015, ArXiv.

[13]  Bingsheng He,et al.  On the O(1/n) Convergence Rate of the Douglas-Rachford Alternating Direction Method , 2012, SIAM J. Numer. Anal..

[14]  Tieyong Zeng,et al.  Variational Approach for Restoring Blurred Images with Cauchy Noise , 2015, SIAM J. Imaging Sci..

[15]  Yiqiu Dong,et al.  Directional Total Generalized Variation Regularization for Impulse Noise Removal , 2017, SSVM.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[19]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[20]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[21]  Paul Rodríguez Multiplicative updates algorithm to minimize the generalized total variation functional with a non-negativity constraint , 2010, 2010 IEEE International Conference on Image Processing.

[22]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[23]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[24]  L. Reichel,et al.  Majorization–minimization generalized Krylov subspace methods for $${\ell _p}$$ℓp–$${\ell _q}$$ℓq optimization applied to image restoration , 2017 .

[25]  Serena Morigi,et al.  Space-variant generalised Gaussian regularisation for image restoration , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[26]  Serena Morigi,et al.  Space-Variant TV Regularization for Image Restoration , 2017, 1906.11827.

[27]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[28]  Michael Hintermüller,et al.  Limiting Aspects of Nonconvex TVφ Models , 2014, SIAM J. Imaging Sci..

[29]  Yann Gousseau,et al.  The TVL1 Model: A Geometric Point of View , 2009, Multiscale Model. Simul..

[30]  Martin Benning,et al.  Directional sinogram inpainting for limited angle tomography , 2018, Inverse Problems.

[31]  Serena Morigi,et al.  A Generalized Krylov Subspace Method for ℓp-ℓq Minimization , 2015, SIAM J. Sci. Comput..

[32]  Wei Zhang,et al.  A Fast Adaptive Parameter Estimation for Total Variation Image Restoration , 2014, IEEE Transactions on Image Processing.

[33]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[34]  Jean-Yves Tourneret,et al.  Parameter Estimation For Multivariate Generalized Gaussian Distributions , 2013, IEEE Transactions on Signal Processing.

[35]  Zhibin Li,et al.  Variable exponent functionals in image restoration , 2010, Appl. Math. Comput..

[36]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[37]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2015, ICASSP.

[38]  Hanno Scharr,et al.  Image statistics and anisotropic diffusion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[39]  Andreas Langer,et al.  Automated Parameter Selection for Total Variation Minimization in Image Restoration , 2015, Journal of Mathematical Imaging and Vision.

[40]  T. Brox,et al.  Diffusion and regularization of vector- and matrix-valued images , 2002 .

[41]  Antonin Chambolle,et al.  An introduction to continuous optimization for imaging , 2016, Acta Numerica.

[42]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[43]  Yuanquan Wang,et al.  Edge adaptive directional total variation , 2013 .

[44]  J. Preston Ξ-filters , 1983 .

[45]  René Ciak Coercive functions from a topological viewpoint and properties of minimizing sets of convex functions appearing in image restoration , 2015, ArXiv.

[46]  Raymond H. Chan,et al.  Parameter selection for total-variation-based image restoration using discrepancy principle , 2012, IEEE Transactions on Image Processing.

[47]  Song-Chun Zhu Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998 .

[48]  Marc Teboulle,et al.  Nonconvex Lagrangian-Based Optimization: Monitoring Schemes and Global Convergence , 2018, Math. Oper. Res..

[49]  Petros Maragos,et al.  Tensor-based image diffusions derived from generalizations of the Total Variation and Beltrami Functionals , 2010, 2010 IEEE International Conference on Image Processing.

[50]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[51]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[52]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[53]  Tülay Adali,et al.  A New Riemannian Averaged Fixed-Point Algorithm for MGGD Parameter Estimation , 2015, IEEE Signal Processing Letters.

[54]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.

[55]  Warren Hare,et al.  Computing proximal points of nonconvex functions , 2008, Math. Program..

[56]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .