Perturbation analysis and condition numbers of scaled total least squares problems

The standard approaches to solving an overdetermined linear system Ax ≈ b find minimal corrections to the vector b and/or the matrix A such that the corrected system is consistent, such as the least squares (LS), the data least squares (DLS) and the total least squares (TLS). The scaled total least squares (STLS) method unifies the LS, DLS and TLS methods. The classical normwise condition numbers for the LS problem have been widely studied. However, there are no such similar results for the TLS and the STLS problems. In this paper, we first present a perturbation analysis of the STLS problem, which is a generalization of the TLS problem, and give a normwise condition number for the STLS problem. Different from normwise condition numbers, which measure the sizes of both input perturbations and output errors using some norms, componentwise condition numbers take into account the relation of each data component, and possible data sparsity. Then in this paper we give explicit expressions for the estimates of the mixed and componentwise condition numbers for the STLS problem. Since the TLS problem is a special case of the STLS problem, the condition numbers for the TLS problem follow immediately from our STLS results. All the discussions in this paper are under the Golub-Van Loan condition for the existence and uniqueness of the STLS solution.

[1]  J. Vandewalle,et al.  Analysis and solution of the nongeneric total least squares problem , 1988 .

[2]  Sabine Van Huffel,et al.  Recent advances in total least squares techniques and errors-in-variables modeling , 1997 .

[3]  Sabine Van Huffel,et al.  Consistency of elementwise-weighted total least squares estimator in a multivariate errors-in-variables model AX=B , 2004 .

[4]  Jiri Rohn.  New condition numbers for matrices and linear systems , 2005, Computing.

[5]  Sabine Van Huffel,et al.  Overview of total least-squares methods , 2007, Signal Process..

[6]  H. Zha,et al.  The restricted total least squares problem: formulation, algorithm, and properties , 1991 .

[7]  J. H. Wilkinson.  The algebraic eigenvalue problem , 1966 .

[8]  Christopher C. Paige,et al.  Scaled total least squares fundamentals , 2002, Numerische Mathematik.

[9]  Zdenek Strakos,et al.  Bounds for the least squares distance using scaled total least squares , 2002, Numerische Mathematik.

[10]  Yimin Wei,et al.  On mixed and componentwise condition numbers for Moore-Penrose inverse and linear least squares problems , 2006, Math. Comput..

[11]  J. Vandewalle,et al.  Analysis and properties of the generalized total least squares problem AX≈B when some or all columns in A are subject to error , 1989 .

[12]  Alexander Graham,et al.  Kronecker Products and Matrix Calculus: With Applications , 1981 .

[13]  James R. Bunch,et al.  Perturbation theory for orthogonal projection methods with applications to least squares and total least squares , 1996 .

[14]  Zdenek Strakos,et al.  Core Problems in Linear Algebraic Systems , 2005, SIAM J. Matrix Anal. Appl..

[15]  Israel Koltracht,et al.  Mixed componentwise and structured condition numbers , 1993 .

[16]  I. Markovsky,et al.  Consistency of the structured total least squares estimator in a multivariate errors-in-variables model , 2005 .

[17]  Robert D. Skeel,et al.  Scaling for Numerical Stability in Gaussian Elimination , 1979, JACM.

[18]  Iveta Hnÿ.  Lanczos tridiagonalization and core problems , 2007 .

[19]  Sabine Van Huffel,et al.  Total least squares problem - computational aspects and analysis , 1991, Frontiers in applied mathematics.

[20]  Musheng Wei,et al.  The Analysis for the Total Least Squares Problem with More Than One Solution , 1992, SIAM J. Matrix Anal. Appl..

[21]  Sabine Van Huffel.  Analysis of the Total Least Squares Problem and its Use in Parameter Estimation , 1987 .

[22]  Gene H. Golub,et al.  An analysis of the total least squares problem , 1980, Milestones in Matrix Computation.

[23]  Sabine Van Huffel.  On the Significance of Nongeneric Total Least Squares Problems , 1992, SIAM J. Matrix Anal. Appl..

[24]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[25]  Zdeněk Strakoš,et al.  Lanczos tridiagonalization and core problems , 2007 .

[26]  Sabine Van Huffel,et al.  The element-wise weighted total least-squares problem , 2006, Comput. Stat. Data Anal..

[27]  G. Stewart.  A second order perturbation expansion for small singular values , 1984 .

[28]  Sabine Van Huffel,et al.  Algebraic connections between the least squares and total least squares problems , 1989 .

[29]  X. Liu.  ON THE SOLVABILITY AND PERTURBATION ANALYSIS FOR TOTAL LEAST SQUARES PROBLEM , 1996 .

[30]  B. Rao.  Unified treatment of LS, TLS, and truncated SVD methods using a weighted TLS framework , 1997 .

[31]  Ricardo D. Fierro,et al.  The Total Least Squares Problem: Computational Aspects and Analysis (S. Van Huffel and J. Vandewalle) , 1993, SIAM Rev..

[32]  N. Higham.  A Survey of Componentwise Perturbation Theory in Numerical Linear Algebra , 1994 .