Analysis of the Structured Total Least Squares Problem for Hankel/Toeplitz Matrices

The Structured Total Least Squares (STLS) problem is a natural extension of the Total Least Squares (TLS) approach when structured matrices are involved and a similarly structured rank deficient approximation of that matrix is desired. In many of those cases the STLS approach yields a Maximum Likelihood (ML) estimate as opposed to, e.g., TLS.In this paper we analyze the STLS problem for Hankel matrices (the theory can be extended in a straightforward way to Toeplitz matrices, block Hankel and block Toeplitz matrices). Using a particular parametrisation of rank-deficient Hankel matrices, we show that this STLS problem suffers from multiple local minima, the properties of which depend on the parameters of the new parametrisation. The latter observation makes initial estimates an important issue in STLS problems and a new initialization method is proposed. The new initialization method is applied to a speech compression example and the results confirm the improved performance compared to other previously proposed initialization methods.

[1]  Sabine Van Huffel,et al.  Total least squares problem - computational aspects and analysis , 1991, Frontiers in applied mathematics.

[2]  R. Fletcher Practical Methods of Optimization , 1988 .

[3]  J. Mendel Lessons in Estimation Theory for Signal Processing, Communications, and Control , 1995 .

[4]  Sabine Van Huffel,et al.  Variable rate speech compression based on exact modeling and waveform vector quantization , 1998 .

[5]  S. Vanhuffel,et al.  Algorithm for time-domain NMR data fitting based on total least squares , 1994 .

[6]  Petre Stoica,et al.  Maximum likelihood estimation of the parameters of multiple sinusoids from noisy measurements , 1989, IEEE Trans. Acoust. Speech Signal Process..

[7]  Sabine Van Huffel,et al.  Structured total least squares problems: formulations, algorithms and applications , 1997 .

[8]  K. Arun,et al.  State-space and singular-value decomposition-based approximation methods for the harmonic retrieval problem , 1983 .

[9]  J. Mendel,et al.  Constrained total least squares , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Jerry M. Mendel,et al.  The constrained total least squares technique and its applications to harmonic superresolution , 1991, IEEE Trans. Signal Process..

[11]  Philip E. Gill,et al.  Practical optimization , 1981 .

[12]  Sabine Van Huffel,et al.  Speech compression based on exact modeling and structured total least norm optimization , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[13]  Bart De Moor,et al.  Total least squares for affinely structured matrices and the noisy realization problem , 1994, IEEE Trans. Signal Process..

[14]  Sabine Van Huffel,et al.  Formulation and solution of structured total least norm problems for parameter estimation , 1996, IEEE Trans. Signal Process..

[16]  A. van den Boom,et al.  Extended HTLS methods for parameter estimation of multiple data sets modeled as sums of exponentials , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[17]  Ed Anderson,et al.  LAPACK Users' Guide , 1995 .

[18]  Daniel Boley,et al.  Vandermonde Factorization of a Hankel Matrix ? , 2006 .

[19]  J. Ben Rosen,et al.  Total Least Norm Formulation and Solution for Structured Problems , 1996, SIAM J. Matrix Anal. Appl..