The constrained total least squares technique and its applications to harmonic superresolution

The constrained total least squares (CTLS) method is a natural extension of TLS to the case when the noise components of the coefficients are algebraically related. The CTLS technique is developed, and some of its applications to superresolution harmonic analysis are presented. The CTLS problem is reduced to an unconstrained minimization problem over a small set of variables. A perturbation analysis of the CTLS solution is derived, and from it the root mean-square error (RMSE) of the CTLS solution, which is valid for small noise levels, is obtained in closed form. The complex version of the Newton method is derived and applied to determine the CTLS solution. It is also shown that the CTLS problem is equivalent to a constrained parameter maximum-likelihood problem. The CTLS technique is applied to estimate the frequencies of sinusoids in white noise and the angle of arrival of narrowband wavefronts at a linear uniform array. In both cases the CTLS method shows superior or similar accuracy to other advanced techniques. >

[1]  Joos Vandewalle,et al.  The Use of Total Linear Least Squares Techniques for Identification and Parameter Estimation , 1985 .

[2]  T. J. Abatzoglou,et al.  Total least squares techniques for high resolution direction finding , 1988, MILCOM 88, 21st Century Military Communications - What's Possible?'. Conference record. Military Communications Conference.

[3]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[4]  L. Gleser.  Estimation in a Multivariate "Errors in Variables" Regression Model: Large Sample Results , 1981 .

[5]  A. Madansky.  The fitting of straight lines when both variables are subject to error , 1959 .

[6]  Eugene L. Allgower,et al.  Exact inverses of certain band matrices , 1973 .

[7]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[8]  R. Kumaresan,et al.  Estimation of frequencies of multiple sinusoids: Making linear prediction perform like maximum likelihood , 1982, Proceedings of the IEEE.

[9]  E. Polak.  Introduction to linear and nonlinear programming , 1973 .

[10]  Arye Nehorai,et al.  Maximum likelihood estimation of exponential signals in noise using a Newton algorithm , 1988, Fourth Annual ASSP Workshop on Spectrum Estimation and Modeling.

[11]  Sabine Van Huffel.  Analysis of the Total Least Squares Problem and its Use in Parameter Estimation , 1987 .

[12]  R. Kumaresan,et al.  Estimating the Angles of Arrival of Multiple Plane Waves , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Michael D. Zoltowski.  Generalized Minimum Norm And Constrained Total Least Squares With Applications To Array Signal Processing , 1988, Optics & Photonics.

[14]  Yoram Bresler,et al.  Exact maximum likelihood parameter estimation of superimposed exponential signals in noise , 1986, IEEE Trans. Acoust. Speech Signal Process..

[15]  Ramdas Kumaresan,et al.  An algorithm for pole-zero modeling and spectral analysis , 1986, IEEE Trans. Acoust. Speech Signal Process..

[16]  Jerry M. Mendel,et al.  Lessons in digital estimation theory , 1986 .

[17]  Thomas Kailath,et al.  ESPIRT-estimation of signal parameters via rotational invariance techniques , 1989 .

[18]  Edgar C. Tacker,et al.  Regularization of Marchenko’s integral equation by total least squares , 1982 .

[19]  T. T. Abatzoglou,et al.  Constrained total least squares applied to frequency estimation of sinusoids , 1988, Fourth Annual ASSP Workshop on Spectrum Estimation and Modeling.

[20]  J. Mendel,et al.  Constrained total least squares , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[21]  J. Vandewalle,et al.  Analysis and properties of the generalized total least squares problem AX≈B when some or all columns in A are subject to error , 1989 .

[22]  Kai-Bor Yu,et al.  Total least squares approach for frequency estimation using linear prediction , 1987, IEEE Trans. Acoust. Speech Signal Process..

[23]  B. A. D. H. Brandwood.  A complex gradient operator and its applica-tion in adaptive array theory , 1983 .