Lp normed minimization with applications to linear predictive modeling for sinusoidal frequency estimation

Abstract Robust time series modeling is an active area of research within many disciplines. For estimating the frequency of sinusoids from relatively short data records linear predictive methods have proven successful in numerous applications. Typically, least squares based solutions are invoked to calculate the model coefficients required to form frequency estimates for reasons of mathematical tractability and computational efficiency. The least squares error criteria equally weights all modeling errors and may produced biased frequency location estimates if the data are contaminated by impulsive noise or if transient components such as multipath are present. It is well known that a least absolute deviation error criteria may aid in generating a robust parametric model in such situations. Iterative algorithms possess the advantage of being able to generate L p normed solutions. It is natural to consider the behavior of the prediction error filter roots as the solution iterates from some initial state (e.g. a least squares solution) to the L p normed solution. Of particular interest may be the behavior of any extraneous roots introduced by overmodeling. By plotting prediction error filter roots in the complex z -plane at each iteration step, we have generated graphical data somewhat analogous to a root locus plot. From this approach we gain insight into the transient and steady behavior of the iterative algorithm. Additionally, the robustness of an L p normed solution when estimating the frequency of sinusoids from data contaminated by impulsive noise is demonstrated.

[1]  J. Rice The approximation of functions , 1964 .

[2]  Elwood T. Olsen,et al.  L1 and L∞ minimization via a variant of Karmarkar's algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  Narendra Karmarkar,et al.  A new polynomial-time algorithm for linear programming , 1984, Comb..

[4]  H. L. Taylor,et al.  Deconvolution with the l 1 norm , 1979 .

[5]  S.A. Kassam,et al.  Robust techniques for signal processing: A survey , 1985, Proceedings of the IEEE.

[6]  David J. Kuck,et al.  On Stable Parallel Linear System Solvers , 1978, JACM.

[7]  W. Steiger,et al.  Least Absolute Deviations: Theory, Applications and Algorithms , 1984 .

[8]  H. Leon Harter,et al.  Nonuniqueness of least absolute values regression , 1977 .

[9]  R. Yarlagadda,et al.  Fast Algorithms for lp Deconvolution , 1985 .

[10]  R. Koenker,et al.  Asymptotic Theory of Least Absolute Error Regression , 1978 .

[11]  J. Bee Bednar,et al.  L1 deconvolution and its application to seismic signal processing , 1986, IEEE Trans. Acoust. Speech Signal Process..

[12]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[13]  Etienne Denoel,et al.  Linear prediction of speech with a least absolute error criterion , 1985, IEEE Trans. Acoust. Speech Signal Process..

[14]  James E. Gentle,et al.  On least absolute values estimation , 1977 .

[15]  Andrew Young,et al.  Discrete Approximation in the L1 Norm , 1973, Comput. J..

[16]  A. Money,et al.  The linear regression model: Lp norm estimation and the choice of p , 1982 .

[17]  R. Douglas Martin,et al.  ROBUST METHODS FOR TIME SERIES , 1981 .

[18]  I. Barrodale,et al.  An Improved Algorithm for Discrete $l_1 $ Linear Approximation , 1973 .

[19]  Frederick Mosteller,et al.  Understanding robust and exploratory data analysis , 1983 .

[20]  J. Claerbout,et al.  Robust Modeling With Erratic Data , 1973 .

[21]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[22]  M. Kendall Elementary Statistics , 1945, Nature.

[23]  G. Watson Approximation theory and numerical methods , 1980 .

[24]  Sven Treitel,et al.  On the connection between IRLS and Gauss' method for l1inversion: Comments on "Fast algorithms for lpdeconvolution" , 1987, IEEE Trans. Acoust. Speech Signal Process..

[25]  J. Endsley,et al.  Lp Normed Spectral Estimation Residual Analysis , 1988, Twenty-Second Asilomar Conference on Signals, Systems and Computers.

[26]  V. A. Sposito,et al.  On the efficiency of using the sample kurtosis in selecting optimal lpestimators , 1983 .

[27]  R. K. Rao Yarlagadda,et al.  S8.9 ADAPTIVE L, APPROACH TO SPEECH CODING , 1988 .

[28]  J. Bee Bednar,et al.  Fast algorithms for lpdeconvolution , 1985, IEEE Trans. Acoust. Speech Signal Process..

[29]  A. Gersztenkorn,et al.  Robust iterative inversion for the one‐dimensional acoustic wave equation , 1986 .

[30]  Jürgen Fischer The convergence of the best discrete linear Lp approximation as p → 1 , 1983 .

[31]  D. Thomson,et al.  Robust-resistant spectrum estimation , 1982, Proceedings of the IEEE.

[32]  J. Rice,et al.  Norms for Smoothing and Estimation , 1964 .

[33]  R. K. Rao Yarlagadda,et al.  Linear predictive spectral estimation via the L1 norm , 1989 .

[34]  J. Scales,et al.  Robust methods in inverse theory , 1988 .