Fractional regularization matrices for linear discrete ill-posed problems

The numerical solution of linear discrete ill-posed problems typically requires regularization. Two of the most popular regularization methods are due to Tikhonov and Lavrentiev. These methods require the choice of a regularization matrix. Common choices include the identity matrix and finite difference approximations of a derivative operator. It is the purpose of the present paper to explore the use of fractional powers of the matrices $$A^\mathrm{T}\!A$$ATA (for Tikhonov regularization) and A (for Lavrentiev regularization) as regularization matrices, where A is the matrix that defines the linear discrete ill-posed problem. Both small- and large-scale problems are considered.

[1]  Joseph F. McGrath,et al.  A Primer on Integral Equations of the First Kind: The Problem of Deconvolution and Unfolding (G. Milton Wing with the assistance of John D. Zahrt) , 1993, SIAM Rev..

[2]  L. Reichel,et al.  An iterative Lavrentiev regularization method , 2006 .

[3]  Danny C. Sorensen,et al.  Accelerating the LSTRS Algorithm , 2010, SIAM J. Sci. Comput..

[4]  L. Reichel,et al.  Fractional Tikhonov regularization for linear discrete ill-posed problems , 2011 .

[5]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[6]  Danny C. Sorensen,et al.  A Trust-Region Approach to the Regularization of Large-Scale Discrete Forms of Ill-Posed Problems , 2001, SIAM J. Sci. Comput..

[7]  Lothar Reichel,et al.  Tikhonov Regularization with a Solution Constraint , 2004, SIAM J. Sci. Comput..

[8]  Beresford N. Parlett,et al.  Refined Interlacing Properties , 1992, SIAM J. Matrix Anal. Appl..

[9]  Michiel E. Hochstenbach,et al.  Discrete ill-posed least-squares problems with a solution norm constraint , 2012 .

[10]  R. Ramlau,et al.  Regularization by fractional filter methods and data smoothing , 2008 .

[11]  M. Baart.  The Use of Auto-correlation for Pseudo-rank Determination in Noisy III-conditioned Linear Least-squares Problems , 1982 .

[12]  C. Groetsch,et al.  Arcangeli’s method for Fredholm equations of the first kind , 1987 .

[13]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[14]  Zhi-Pei Liang,et al.  An efficient method for dynamic magnetic resonance imaging , 1994, IEEE Trans. Medical Imaging.

[15]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[16]  Per Christian Hansen,et al.  Regularization Tools version 4.0 for Matlab 7.3 , 2007, Numerical Algorithms.

[17]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[18]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[19]  C. W. Groetsch,et al.  The theory of Tikhonov regularization for Fredholm equations of the first kind , 1984 .