A predictor-corrector iterated Tikhonov regularization for linear ill-posed inverse problems

Many questions in science and engineering often give rise to linear ill-posed inverse problems. To enable meaningful approximate solutions of the inverse problems, various regularization methods have subsequently been proposed to make these problems less sensitive to perturbations. One of the most popular regularization techniques is iterated Tikhonov regularization, which has attracted considerable attention due to its interesting applications in practical. However, this regularization often suffers from inaccurate results and low computational efficiency in some situations. In this paper, we proposed an accelerated predictor-corrector iterated Tikhonov regularization. This method combined the classical iterated Tikhonov regularization with modified Euler method, which could improve computational efficiency without sacrificing numerical accuracy. The convergence rate of the accelerated regularization was investigated theoretically when the right-hand side was corrupted by noise. In particular, we derived an error estimate of optimal order for the convergence of the accelerated regularization. Both one-and two-dimensional numerical experiments were implemented to illustrate the accuracy and efficiency of the accelerated version of iterated Tikhonov regularization.

[1]  Huang Xiao-wei,et al.  A fast convergent method of iterated regularization , 2009 .

[2]  Yanfei Wang,et al.  Iterated Adaptive Regularization for the Operator Equations of the First Kind , 2006 .

[3]  Lothar Reichel,et al.  Arnoldi-Tikhonov regularization methods , 2009 .

[4]  P. Hansen The truncatedSVD as a method for regularization , 1987 .

[5]  K. Kunisch,et al.  Iterative choices of regularization parameters in linear inverse problems , 1998 .

[6]  M. Hanke,et al.  Nonstationary Iterated Tikhonov Regularization , 1998 .

[7]  Robert Plato,et al.  Optimal algorithms for linear ill-posed problems yield regularization methods , 1990 .

[8]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[9]  Kamil S. Kazimierski,et al.  Accelerated Landweber iteration in Banach spaces , 2010 .

[10]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[11]  Zewen Wang,et al.  Multi-parameter Tikhonov regularization and model function approach to the damped Morozov principle for choosing regularization parameters , 2012, J. Comput. Appl. Math..

[12]  James G. Nagy,et al.  Iterative Methods for Image Deblurring: A Matlab Object-Oriented Approach , 2004, Numerical Algorithms.

[13]  Fabiana Zama,et al.  An iterative method for linear discrete ill-posed problems with box constraints , 2007 .

[14]  Toomas Raus,et al.  Extrapolation of Tikhonov regularization method , 2010 .

[15]  D. Chillingworth,et al.  Approximation of generalized inverses by iterated regularization , 1979 .

[16]  Marco Donatelli,et al.  On nondecreasing sequences of regularization parameters for nonstationary iterated Tikhonov , 2012, Numerical Algorithms.

[17]  Mark A. Lukas,et al.  Comparing parameter choice methods for regularization of ill-posed problems , 2011, Math. Comput. Simul..

[18]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[19]  V. A. Morozov,et al.  Methods for Solving Incorrectly Posed Problems , 1984 .

[20]  Jun Zou,et al.  An improved model function method for choosing regularization parameters in linear inverse problems , 2002 .

[21]  M. P. Rajan,et al.  A posteriori parameter choice with an efficient discretization scheme for solving ill-posed problems , 2008, Appl. Math. Comput..

[22]  Per Christian Hansen,et al.  Smoothing-Norm Preconditioning for Regularizing Minimum-Residual Methods , 2006, SIAM J. Matrix Anal. Appl..

[23]  Bangti Jin,et al.  Conjugate gradient method for the Robin inverse problem associated with the Laplace equation , 2007 .

[24]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[25]  M. Hanke Accelerated Landweber iterations for the solution of ill-posed equations , 1991 .

[26]  I. Daubechies,et al.  Accelerated Projected Gradient Method for Linear Inverse Problems with Sparsity Constraints , 2007, 0706.4297.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Per Christian Hansen,et al.  REGULARIZATION TOOLS: A Matlab package for analysis and solution of discrete ill-posed problems , 1994, Numerical Algorithms.

[29]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[30]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[31]  E. Miller,et al.  Efficient determination of multiple regularization parameters in a generalized L-curve framework , 2002 .

[32]  L. Landweber An iteration formula for Fredholm integral equations of the first kind , 1951 .

[33]  C. B. Shaw,et al.  Improvement of the resolution of an instrument by numerical solution of an integral equation , 1972 .

[34]  R. Ramlau A modified landweber method for inverse problems , 1999 .

[35]  C. W. Groetsch,et al.  The theory of Tikhonov regularization for Fredholm equations of the first kind , 1984 .

[36]  Heinz W. Engl,et al.  On the choice of the regularization parameter for iterated Tikhonov regularization of ill-posed problems , 1987 .

[37]  Toomas Raus,et al.  New rule for choice of the regularization parameter in (iterated) tikhonov method , 2009 .

[38]  Hassane Sadok,et al.  Greedy Tikhonov regularization for large linear ill-posed problems , 2007, Int. J. Comput. Math..

[39]  Qinian Jin,et al.  Nonstationary iterated Tikhonov regularization for ill-posed problems in Banach spaces , 2012 .

[40]  G. Hahn A modified Euler method for dynamic analyses , 1991 .

[41]  Zhe Chen,et al.  Convergence analysis of Tikhonov-type regularization algorithms for multiobjective optimization problems , 2009, Appl. Math. Comput..

[42]  A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems , 1996, Applied Mathematical Sciences.

[43]  M. A. Lukas Robust generalized cross-validation for choosing the regularization parameter , 2006 .

[44]  Seyed Mohammad Hosseini,et al.  A new variant of L-curve for Tikhonov regularization , 2009, J. Comput. Appl. Math..

[45]  Rosemary A. Renaut,et al.  Computational Statistics and Data Analysis , 2022 .

[46]  G. Golub,et al.  Generalized cross-validation for large scale problems , 1997 .