Half-Quadratic Image Restoration with a Non-parallelism Constraint

The problem of image restoration from blur and noise is studied. By regularization techniques, a solution of the problem is found as the minimum of a primal energy function, which is formed by two terms. The former deals with faithfulness to the data, and the latter is associated with the smoothness constraints. We impose that the obtained results are images piecewise continuous and with thin edges. In correspondence with the primal energy function, there is a dual energy function, which deals with discontinuities implicitly. We present a unified approach of the duality theory, also to consider the non-parallelism constraint. We construct a dual energy function, which is convex and imposes such a constraint. To reconstruct images with Boolean discontinuities, the proposed energy function can be used as an initial approximation in a graduated non-convexity algorithm. The experimental results confirm that such a technique inhibits the formation of parallel lines.

[1]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[2]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  J. Idier,et al.  On global and local convergence of half-quadratic algorithms , 2002, Proceedings. International Conference on Image Processing.

[4]  Xingbao Gao,et al.  A Improvement for GNC Method of Nonconvex Nonsmooth Image Restoration , 2013 .

[5]  Charles R. Johnson,et al.  Matrix Analysis, 2nd Ed , 2012 .

[6]  Ivan W. Selesnick,et al.  Convex Denoising using Non-Convex Tight Frame Regularization , 2015, IEEE Signal Processing Letters.

[7]  Jianhua Luo,et al.  Edge-preserving reconstruction with contour-line smoothing and non-quadratic data-fidelity , 2013 .

[8]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[9]  E. Salerno,et al.  Models and Algorithms for Edge-Preserving Image Reconstruction , 1996 .

[10]  G. Aubert,et al.  Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (Applied Mathematical Sciences) , 2006 .

[11]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[12]  Ivan Gerace,et al.  On Regularization Parameters Estimation in Edge-Preserving Image Reconstruction , 2008, ICCSA.

[13]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[14]  Anna Tonazzini,et al.  A Deterministic Algorithm for Reconstructing Images with Interacting Discontinuities , 1994, CVGIP Graph. Model. Image Process..

[15]  I. Gijbels,et al.  Penalized likelihood regression for generalized linear models with non-quadratic penalties , 2011 .

[16]  Mila Nikolova,et al.  Markovian reconstruction using a GNC approach , 1999, IEEE Trans. Image Process..

[17]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Masoud Ahookhosh,et al.  Optimization: a Journal of Mathematical Programming and Operations Research a Class of Nonmonotone Armijo-type Line Search Method for Unconstrained Optimization a Class of Nonmonotone Armijo-type Line Search Method for Unconstrained Optimization , 2022 .

[19]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[20]  Freddie Åström,et al.  Color image regularization via channel mixing and half quadratic minimization , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[21]  Hossein Mobahi,et al.  A Theoretical Analysis of Optimization by Gaussian Continuation , 2015, AAAI.

[22]  Gianluca Vinti,et al.  Enhancement of thermographic images as tool for structural analysis in earthquake engineering , 2015 .

[23]  H. Brezis Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[24]  Catalina Sbert,et al.  An algorithm for nonconvex functional minimization and applications to image restoration , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Ivan W. Selesnick,et al.  Group-Sparse Signal Denoising: Non-Convex Regularization, Convex Optimization , 2013, IEEE Transactions on Signal Processing.

[26]  J. Stoer,et al.  Introduction to Numerical Analysis , 2002 .

[27]  Mila Nikolova,et al.  Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares , 2005, Multiscale Model. Simul..

[28]  Jérôme Idier,et al.  Convex half-quadratic criteria and interacting auxiliary variables for image restoration , 2001, IEEE Trans. Image Process..

[29]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[30]  C. Xiao,et al.  A high-efficiency edge-preserving Bayesian method for image interpolation , 2008, 2008 9th International Conference on Signal Processing.

[31]  R. Chan,et al.  Restoration of Manifold-Valued Images by Half-Quadratic Minimization , 2015, 1505.07029.

[32]  Gianluca Vinti,et al.  Applications of sampling Kantorovich operators to thermographic images for seismic engineering , 2014, ArXiv.

[33]  Bernd Jähne,et al.  BOOK REVIEW: Digital Image Processing, 5th revised and extended edition , 2002 .

[34]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[35]  Tieniu Tan,et al.  Half-Quadratic-Based Iterative Minimization for Robust Sparse Representation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Josiane Mothe,et al.  Nonconvex Regularizations for Feature Selection in Ranking With Sparse SVM , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[37]  J. Borwein,et al.  Convex Functions: Constructions, Characterizations and Counterexamples: References , 2010 .

[38]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[39]  Ivan W. Selesnick,et al.  Nonconvex nonsmooth optimization via convex–nonconvex majorization–minimization , 2017, Numerische Mathematik.

[40]  Yue Min Zhu,et al.  Generic Half-Quadratic Optimization for Image Reconstruction , 2015, SIAM J. Imaging Sci..

[41]  Ivan W. Selesnick,et al.  Enhanced Low-Rank Matrix Approximation , 2015, IEEE Signal Processing Letters.

[42]  Isabelle E. Magnin,et al.  Optimization by Stochastic Continuation , 2010, SIAM J. Imaging Sci..

[43]  Yu-Mei Huang,et al.  A preconditioned conjugate gradient method for multiplicative half-quadratic image restoration , 2013, Appl. Math. Comput..

[44]  Heinz H. Bauschke,et al.  What is... a Fenchel Conjugate , 2012 .

[45]  Anthony G. Constantinides,et al.  A modified Armijo rule for the online selection of learning rate of the LMS algorithm , 2010, Digit. Signal Process..

[46]  Qi Li,et al.  A novel method of infrared image denoising and edge enhancement , 2008, Signal Process..

[47]  R. Lucchetti The Fenchel conjugate , 2006 .

[48]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[49]  Michael J. Black,et al.  On the unification of line processes , 1996 .

[50]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[51]  Xudong Lv,et al.  Inexact half-quadratic optimization for image reconstruction , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[52]  Mila Nikolova,et al.  Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery , 2005, SIAM J. Sci. Comput..

[53]  J. Borwein,et al.  Convex Functions: Constructions, Characterizations and Counterexamples , 2010 .

[54]  Xiangzhi Bai,et al.  Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform , 2011 .

[55]  Nicola Cavalagli,et al.  Evaluation of a Statistically Equivalent Periodic Unit Cell for a quasi-periodic masonry , 2013 .

[56]  C. N. hyndhavi,et al.  Group-sparse signal denoising : Non-convex Regularization , Convex Optimization , 2018 .

[57]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[58]  Ivan Gerace,et al.  Convex Approximation Technique for Interacting Line Elements Deblurring: a New Approach , 2011, Journal of Mathematical Imaging and Vision.

[59]  M. Nikolova Analytical bounds on the minimizers of (nonconvex) regularized least-squares , 2008 .

[60]  Raymond H. Chan,et al.  The Equivalence of Half-Quadratic Minimization and the Gradient Linearization Iteration , 2007, IEEE Transactions on Image Processing.

[61]  Mila Nikolova,et al.  Efficient Reconstruction of Piecewise Constant Images Using Nonsmooth Nonconvex Minimization , 2008, SIAM J. Imaging Sci..

[62]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[63]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[64]  Xiaojun Chen,et al.  Non-Lipschitz $\ell_{p}$-Regularization and Box Constrained Model for Image Restoration , 2012, IEEE Transactions on Image Processing.

[65]  Ivan W. Selesnick,et al.  Artifact-Free Wavelet Denoising: Non-convex Sparse Regularization, Convex Optimization , 2015, IEEE Signal Processing Letters.

[66]  Gianluca Vinti,et al.  Approximation by Nonlinear Multivariate Sampling Kantorovich Type Operators and Applications to Image Processing , 2013 .

[67]  Ivan W. Selesnick,et al.  Convex 1-D Total Variation Denoising with Non-convex Regularization , 2015, IEEE Signal Processing Letters.

[68]  Tomaso Poggio,et al.  Probabilistic Solution of Ill-Posed Problems in Computational Vision , 1987 .

[69]  Gianluca Vinti,et al.  Digital image processing algorithms for diagnosis in arterial diseases , 2015 .

[70]  L. Armijo Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[71]  Xingbao Gao,et al.  Image Restoration Combining Tikhonov with Different Order Nonconvex Nonsmooth Regularizations , 2013, 2013 Ninth International Conference on Computational Intelligence and Security.

[72]  Wesley E. Snyder,et al.  Image Relaxation: Restoration and Feature Extraction , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[73]  Andrew Blake,et al.  Comparison of the Efficiency of Deterministic and Stochastic Algorithms for Visual Reconstruction , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[75]  Gerry Leversha,et al.  Introduction to numerical analysis (3rd edn), by J. Stoer and R. Bulirsch. Pp. 744. £49. 2002. ISBN 0 387 95452 X (Springer-Verlag). , 2004, The Mathematical Gazette.

[76]  Michel Barlaud,et al.  Nonconvex Regularization in Remote Sensing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Serena Morigi,et al.  Convex Image Denoising via Non-convex Regularization with Parameter Selection , 2016, Journal of Mathematical Imaging and Vision.

[78]  Serena Morigi,et al.  Convex Image Denoising via Non-Convex Regularization , 2015, SSVM.

[79]  Gianluca Vinti,et al.  Applications of Approximation Theory to thermographic images in earthquake engineering , 2015 .

[80]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[81]  Hai-Dong Liang,et al.  Medical ultrasound: imaging of soft tissue strain and elasticity , 2011, Journal of The Royal Society Interface.

[82]  LUMINITA VESEy,et al.  Reduced Non-convex Functional Approximations for Image Restoration & Segmentation , 1997 .

[83]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[84]  Mila Nikolova,et al.  On 퓁1 Data Fitting and Concave Regularization for Image Recovery , 2013, SIAM J. Sci. Comput..

[85]  S. Setzer,et al.  Signal recovery from incomplete measurements in the presence of outliers , 2007 .