Tikhonov Regularization and Total Least Squares

Discretizations of inverse problems lead to systems of linear equations with a highly ill-conditioned coefficient matrix, and in order to compute stable solutions to these systems it is necessary to apply regularization methods. We show how Tikhonov's regularization method, which in its original formulation involves a least squares problem, can be recast in a total least squares formulation suited for problems in which both the coefficient matrix and the right-hand side are known only approximately. We analyze the regularizing properties of this method and demonstrate by a numerical example that, in certain cases with large perturbations, the new method is superior to standard regularization methods.

[1]  J. Varah.  On the Numerical Solution of Ill-Conditioned Linear Systems with Applications to Ill-Posed Problems , 1973 .

[2]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[3]  R. Gunst,et al.  Generalized ridge regression: a note on negative ridge parameters , 1983 .

[4]  G. Stewart.  On the invariance of perturbed null vectors under column scaling , 1984 .

[5]  P. Hansen.  Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[6]  S. Nash,et al.  Linear and Nonlinear Programming , 1987 .

[7]  Sabine Van Huffel,et al.  Total least squares problem - computational aspects and analysis , 1991, Frontiers in applied mathematics.

[8]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[9]  C. W. Groetsch,et al.  Inverse Problems in the Mathematical Sciences , 1993 .

[10]  Per Christian Hansen,et al.  Regularization methods for large-scale problems , 1993 .

[11]  J. Navarro-Pedreño.  Numerical Methods for Least Squares Problems , 1996 .

[12]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[13]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[14]  Sabine Van Huffel,et al.  Recent advances in total least squares techniques and errors-in-variables modeling , 1997 .

[15]  Gene H. Golub,et al.  Regularization by Truncated Total Least Squares , 1997, SIAM J. Sci. Comput..

[16]  D. O’Leary,et al.  Regularization algorithms based on total least squares , 1997 .