Lattice filters for adaptive processing

This paper presents a tutorial review of lattice structures and their use for adaptive prediction of time series. Lattice filters associated with stationary covariance sequences and their properties are discussed. The least squares prediction problem is defined for the given data case, and it is shown that many of the currently used lattice methods are actually approximations to the stationary least squares solution. The recently developed class of adaptive least squares lattice algorithms are described in detail, both in their unnormalized and normalized forms. The performance of the adaptive least squares lattice algorithm is compared to that of some gradient adaptive methods. Lattice forms for ARMA processes, for joint process estimation, and for the sliding-window covariance case are presented. The use of lattice structures for efficient factorization of covariance matrices and solution of Toeplitz sets of equations is briefly discussed.

[1]  G. Yule.  On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[2]  N. Levinson.  The Wiener (Root Mean Square) Error Criterion in Filter Design and Prediction , 1946 .

[3]  N. Wiener.  The Wiener RMS (Root Mean Square) Error Criterion in Filter Design and Prediction , 1949 .

[4]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[5]  James Durbin,et al.  The fitting of time series models , 1960 .

[6]  P. Whittle.  On the fitting of multivariate autoregressions, and the approximate canonical factorization of a spectral density matrix , 1963 .

[7]  E. Robinson,et al.  Recursive solution to the multichannel filtering problem , 1965 .

[8]  V. Belevitch,et al.  Classical network theory , 1968 .

[9]  F. Itakura,et al.  A statistical method for estimation of speech spectral density and formant frequencies , 1970 .

[10]  A. Fettweis,et al.  Some principles of designing digital filters imitating classical filter structures , 1971, IEEE Transactions on Circuit Theory.

[11]  R. Crochiere.  Digital ladder structures and coefficient sensitivity , 1972 .

[12]  A. Fettweis.  Pseudo-passivity, sensitivity, and stability of wave digital filters , 1972 .

[13]  K. Renner,et al.  On the design of wave digital filters with low sensitivity properties , 1973 .

[14]  A. Gray,et al.  On autocorrelation equations as applied to speech analysis , 1973 .

[15]  Waveforms Hisashi Wakita.  Direct Estimation of the Vocal Tract Shape by Inverse Filtering of Acoustic Speech , 1973 .

[16]  Alfred Fettweis,et al.  Digital filters with true ladder configuration , 1973 .

[17]  Sanjit K. Mitra,et al.  Digital ladder networks , 1973 .

[18]  O. Barndorff-Nielsen,et al.  On the parametrization of autoregressive models by partial autocorrelations , 1973 .

[19]  A. Gray,et al.  Digital lattice and ladder filter synthesis , 1973 .

[20]  Thomas Kailath,et al.  A view of three decades of linear filtering theory , 1974, IEEE Trans. Inf. Theory.

[21]  Sheng Hwang.  Realization of cannonical digital networks , 1974 .

[22]  Alfred Fettweis.  On sensitivity and roundoff noise in wave digital filters , 1974 .

[23]  Alfred Fettweis.  Wave digital filters with reduced number of delays , 1974 .

[24]  A. Fettweis,et al.  Wave digital lattice filters , 1974 .

[25]  M. Morf.  Fast Algorithms for Multivariable Systems , 1974 .

[26]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[27]  A. Gray,et al.  Roundoff noise characteristics of a class of orthogonal polynomial structures , 1975 .

[28]  Andrew P. Sage,et al.  Sequential estimation and identification of reflection coefficients by minimax entropy inverse filtering , 1975 .

[29]  A. Gray,et al.  Fixed-point implementation algorithms for a class of orthogonal polynominal filter structures , 1975 .

[30]  H. Wakita,et al.  Numerical determination of the lip impedance and vocal tract area functions , 1975 .

[31]  M. Morf,et al.  Inverses of Toeplitz operators, innovations, and orthogonal polynomials , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[32]  M. Srinath,et al.  Sequential algorithm for identification of parameters of an autoregressive process , 1975 .

[33]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[34]  A. Gray,et al.  A normalized digital filter structure , 1975 .

[35]  W. Ku,et al.  Floating-point coefficient sensitivity and roundoff noise of recursive digital filters realized in ladder structures , 1975 .

[36]  Bernard Widrow,et al.  A comparison of adaptive algorithms based on the methods of steepest descent and random search , 1976 .

[37]  Clifford T. Mullis,et al.  Synthesis of minimum roundoff noise fixed point digital filters , 1976 .

[38]  R. Roberts,et al.  Roundoff noise in digital filters: Frequency transformations and invariants , 1976 .

[39]  Leonard T. Bruton,et al.  Synthesis of digital ladder filters from LC filters , 1976 .

[40]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[41]  M. Morf,et al.  Fast algorithms for recursive identification , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[42]  Lennart Ljung,et al.  Analysis of recursive stochastic algorithms , 1977 .

[43]  John Makhoul.  New lattice methods for linear prediction , 1976, ICASSP.

[44]  S. Mitra,et al.  Cascaded lattice realization of digital filters , 1977 .

[45]  M. Morf,et al.  A classification of algorithms for ARMA models and ladder realizations , 1977 .

[46]  Richard D. Gitlin,et al.  Self-Orthogonalizing Adaptive Equalization Algorithms , 1977, IEEE Trans. Commun..

[47]  L. Griffiths.  A continuously-adaptive filter implemented as a lattice structure , 1977 .

[48]  M. Morf,et al.  Ladder forms for identification and speech processing , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[49]  J. Makhoul.  Stable and efficient lattice methods for linear prediction , 1977 .

[50]  Martin Morf,et al.  Ladder Forms Lin Estimation And System Identification , 1977 .

[51]  Bishnu S. Atal,et al.  On determining partial correlation coefficients by the covariance method of linear prediction , 1977 .

[52]  B. Dickinson,et al.  Efficient solution of covariance equations for linear prediction , 1977 .

[53]  Jerry D. Gibson,et al.  On reflection coefficients and the Cholesky decomposition , 1977 .

[54]  J. L. Roux,et al.  A fixed point computation of partial correlation coefficients , 1977 .

[55]  Thomas Kailath,et al.  On another approach to the Schur-Cohn criterion , 1977 .

[56]  Bradly Dickinson,et al.  Estimation of partial correlation matrices using cholesky decomposition , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[57]  L. Ljung,et al.  Generalized Krein-Levinson Equations for Efficient Calculation of Fredholm Resolvents of Non-Displacement Kernels , 1978 .

[58]  J. Makhoul.  A class of all-zero lattice digital filters: Properties and applications , 1978 .

[60]  M. Morf,et al.  Recursive least squares ladder forms for fast parameter tracking , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[61]  M. Morf,et al.  Spectral Estimation , 2006 .

[62]  Thomas E. Carter.  Study of an adaptive lattice structure for linear prediction analysis of speech , 1978, ICASSP.

[63]  W. Wegener,et al.  On the design of wave digital lattice filters with short coefficient word lengths and optimal dynamic range , 1978 .

[64]  Lloyd J. Griffiths,et al.  An adaptive lattice structure for noise-cancelling applications , 1978, ICASSP.

[65]  Bradley W. Dickinson,et al.  Autoregressive estimation using residual energy ratios (Corresp.) , 1978, IEEE Trans. Inf. Theory.

[66]  Thomas Kailath,et al.  Covariance Characterization by Partial Autocorrelation Matrices , 1978 .

[67]  Lloyd Griffiths,et al.  Convergence properties of an adaptive noise cancelling lattice structure , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[68]  T. Kailath,et al.  On a generalized Szegö- Levinson realization algorithm for optimal linear predictors based on a network synthesis approach , 1978 .

[69]  M. Alam,et al.  Orthonormal lattice filter—a multistage multichannel estimation technique , 1978 .

[70]  B. Dickinson.  Estimation of partial correlation matrices using Cholesky decomposition , 1978 .

[71]  H. Kotera,et al.  Application of Fast Kalman Estimation to Adaptive Equalization , 1978 .

[72]  L. Ljung,et al.  Extended Levinson and Chandrasekhar equations for general discrete-time linear estimation problems , 1978 .

[73]  L. Ljung,et al.  Fast calculation of gain matrices for recursive estimation schemes , 1978 .

[74]  Martin Morf,et al.  Fast Algorithms for Speech Modeling. , 1978 .

[75]  John Makhoul,et al.  Adaptive lattice methods for linear prediction , 1978, ICASSP.

[76]  S. T. Alexander,et al.  Channel Equalization Using Adaptive Lattice Algorithms , 1979, IEEE Trans. Commun..

[77]  M. Morf,et al.  Displacement ranks of matrices and linear equations , 1979 .

[78]  Lloyd J. Griffiths.  Adaptive structures for multiple-input noise cancelling applications , 1979, ICASSP.

[79]  E. Satorius,et al.  Adaptive noise cancelling of a sinusoidal interference using a lattice structure , 1979, ICASSP.

[80]  B. Dickinson,et al.  Reflection coefficient estimation using Cholesky decomposition , 1979 .

[81]  Thomas Kailath,et al.  Displacement ranks of a matrix , 1979 .

[82]  Bradley W. Dickinson,et al.  Reflection coefficient estimates based on a Markov chain model , 1979, ICASSP.

[83]  L. Ljung,et al.  New inversion formulas for matrices classified in terms of their distance from Toeplitz matrices , 1979 .

[84]  Lennart Ljung,et al.  The Factorization and Representation of Operators in the Algebra Generated by Toeplitz Operators , 1979 .

[85]  S. Stearns,et al.  An adaptive lattice algorithm for recursive filters , 1980 .

[86]  A. Sakla,et al.  Low-sensitivity digital ladder filters , 1980 .

[87]  M. Morf,et al.  Recursive ladder algorithms for ARMA modeling , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[88]  E. Robinson,et al.  Maximum entropy and the relationship of the partial autocorrelation to the reflection coefficients of a layered system , 1980 .

[89]  Martin Morf,et al.  Doubling algorithms for Toeplitz and related equations , 1980, ICASSP.

[90]  E. H. Satorius.  ON THE APPLICATION OF RECURSIVE LEAST SQUARES METHODS TO ADAPTIVE PROCESSING , 1980 .

[91]  Martin Morf,et al.  Recursive square-root ladder estimation algorithms , 1980, ICASSP.

[92]  Patrick Dewilde,et al.  Orthogonal cascade realization of real multiport digital filters , 1980 .

[93]  Martin Morf,et al.  A novel innovation based time domain pitch detector , 1980, ICASSP.

[94]  Bradley W. Dickinson,et al.  Characteristics of reflection coefficient estimates based on a Markov chain model , 1980, ICASSP.

[95]  David G. Messerschmitt,et al.  A class of generalized lattice filters , 1980 .

[96]  A tree classification of algorithms for Toeplitz and related equations including generalized Levinson and doubling type algoritms , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[97]  M. Morf,et al.  State-space structures of ladder canonical forms , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[98]  David G. Messerschmitt,et al.  Convergence properties of an adaptive digital lattice filter , 1980, ICASSP.

[99]  B. Friedlander,et al.  Recursive lattice forms for spectral estimation and adaptive control , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[100]  Simon Haykin,et al.  A comparison of algorithms for the calculation of adaptive lattice filters , 1980, ICASSP.

[101]  T. Kailath,et al.  Ladder-form filters for nonstationary processes , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[102]  Friedlander.  Recursive lattice forms for adaptive control , 1980 .

[103]  Albert Benveniste,et al.  AR and ARMA identification algorithms of Levinson type: An innovations approach , 1981 .

[104]  John Makhoul.  LATTICE METHODS IN SPECTRAL ESTIMATION , 1981 .

[105]  E. Satorius,et al.  Application of Least Squares Lattice Algorithms to Adaptive Equalization , 1981, IEEE Trans. Commun..

[106]  B. Friedlander.  A modified lattice algorithm for deconvolving filtered impulsive processes , 1981, ICASSP.

[107]  M. Morf,et al.  A VLSI speech analysis chip set based on square root normalized ladder forms , 1981, ICASSP.

[108]  David G. Messerschmitt,et al.  Convergence models for adaptive gradient and least squares algorithms , 1981, ICASSP.

[109]  Lattice implementation of the recursive maximum likelihood algorithm , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[110]  Lloyd J. Griffiths,et al.  A comparison of two fast linear predictors , 1981, ICASSP.

[111]  John Makhoul,et al.  Adaptive lattice analysis of speech , 1981 .

[112]  Carlos H. Muravchik,et al.  Hilbert space array methods for finite rank process estimation and ladder realizations for adaptive signal processing , 1981, ICASSP.

[113]  Thomas Kailath,et al.  Schur and Levinson algorithms for nonstationary processes , 1981, ICASSP.

[114]  Thomas Kailath,et al.  Optimized lattice-form adaptive line enhancer for a sinusoidal signal in broad-band noise , 1981 .

[115]  M. Shensa,et al.  Recursive least squares lattice algorithms--A geometrical approach , 1981 .

[116]  W. Hodgkiss,et al.  Adaptive tracking of multiple sinusoids whose power levels are widely separated , 1981 .

[117]  Jean-Marc Delosme,et al.  Highly concurrent computing structures for matrix arithmetic and signal processing , 1982, Computer.

[118]  Carlos H. Muravchik,et al.  Fast Cholesky algorithms and adaptive feedback filters , 1982, ICASSP.

[119]  Martin Morf,et al.  Generalized CORDIC for digital signal processing , 1982, ICASSP.

[120]  Benjamin Friedlander.  Recursive lattice forms for spectral estimation , 1982 .

[121]  William S. Hodgkiss,et al.  The complex adaptive least-squares lattice , 1982 .

[122]  Benjamin Friedlander,et al.  Instrumental variable methods for ARMA spectral estimation , 1982, ICASSP.

[123]  I. Ayala,et al.  On a new adaptive lattice algorithm for recursive filters , 1982 .

[124]  R.C. Johnson,et al.  Introduction to adaptive arrays , 1982, Proceedings of the IEEE.

[125]  J. M. Turner.  Application of recursive exact least square ladder estimation algorithm for speech recognition , 1982, ICASSP.

[126]  Jean-Marc Delosme,et al.  Constant-gain filters for finite shift-rank processes , 1982, ICASSP.

[127]  B. Friedlander.  Lattice methods for spectral estimation , 1982, Proceedings of the IEEE.

[128]  Hideaki Sakai,et al.  Circular lattice filtering using Pagano's method , 1982 .

[129]  T Kailath.  Time-Variant and Time-Invariant Lattice Filters for Nonstationary Processes. , 1982 .

[130]  Efficient computation of the covariance sequence of an autoregressive process , 1983 .

[131]  Benjamin Friedlander,et al.  Lattice implementation of some recursive parameter-estimation algorithms† , 1983 .

[132]  B. Friedlander.  A lattice algorithm for factoring the spectrum of a moving average process , 1983 .

[133]  Thomas Kailath,et al.  Correction to 'Lattice Filter Parametrization and Modeling of Nonstationary Processes' , 1984, IEEE Transactions on Information Theory.