Computational noise effects on adaptive filter algorithms

Abstract Finite word length arithmetic roundoff noise in adaptive filter algorithms results in statistical variations in the filter weight vector about the infinite precision arithmetic weight vector. These roundoff errors may be modeled as a statistically non stationary driving noise affecting weight mean and covariance convergence. Mean and covariance expressions and bounds are desired for word lengths in fixed-point arithmetic by making use of multiplication roundoff error models. The adaptive filter algorithms consist of the LMS algorithm, the Widrow-Hoff LMS algorithm, pilot-vector algorithm and clipped vector algorithm. All of these algorithms can be implemented on-line and real-time. However, only the behavior of the LMS algorithm is reported here. The implementation of the adaptive filter algorithms in finite word length arithmetic is most evident in minicomputer, microprocessor, and dedicated digital signal processors for on-line real-time signal identification and parameter estimation in many disciplines. Radar signal processing, adaptive beam forming, acoustic signal identification, communication channel enhancement have a definite need for advanced filtering concepts. Our adaptive algorithms are typically employed in these filter configurations. These filters can also be employed in phase distortion equalizers. A particular advantage of these filters is that they can be trained to equalize a variety of distortions. Should a particular distortion scenario change in time, the filters can be made to easily adapt to the new problem.

[1]  B. Widrow,et al.  Adaptive antenna systems , 1967 .

[2]  David Holstein,et al.  Digital computers in engineering , 1970 .

[3]  S. Shor Adaptive Technique to Discriminate against Coherent Noise in a Narrow‐Band System , 1966 .

[4]  Lee D. Davisson A theory of adaptive filtering , 1966, IEEE Trans. Inf. Theory.

[5]  A. Papoulis,et al.  The Fourier Integral and Its Applications , 1963 .

[6]  Mischa Schwartz,et al.  Rapidly converging second-order tracking algorithms for adaptive equalization , 1971, IEEE Trans. Inf. Theory.

[7]  Thomas A. Brubaker,et al.  Multiplication Using Logarithms Implemented with Read-Only Memory , 1975, IEEE Transactions on Computers.

[8]  E. M. Glaser,et al.  Signal detection by adaptive filters , 1961, IRE Trans. Inf. Theory.

[9]  Virgil W. Eveleigh,et al.  Adaptive Control And Optimization Techniques , 1967 .

[10]  A. Gersho Adaptive equalization of highly dispersive channels for data transmission , 1969 .

[11]  John G. Proakis,et al.  An adaptive receiver for digital signaling through channels with intersymbol interference , 1969, IEEE Trans. Inf. Theory.

[12]  David Middleton,et al.  Adaptive detection of statistical signals in noise , 1966, IEEE Trans. Inf. Theory.

[13]  Kumpati S. Narendra,et al.  Adaptation and learning in automatic systems , 1974 .

[14]  M. Schwartz,et al.  Adaptive Nonlinear Optimization of the Signal‐to‐Noise Ratio of an Array Subject to a Constraint , 1972 .

[15]  A. Wald,et al.  On the Statistical Treatment of Linear Stochastic Difference Equations , 1943 .

[16]  Daniel Graupe,et al.  Identification of Systems , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Mischa Schwartz,et al.  A Rapidly Converging First-Order Training Algorithm for an Adaptive Equalizer , 1971, IEEE Trans. Inf. Theory.

[18]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[19]  Hisashi Kobayashi Iterative Synthesis Methods for a Seismic Array Processor , 1970 .

[20]  L. Scharf,et al.  Optimum and adaptive array processing in frequency-wavenumber space , 1974, CDC 1974.

[21]  O. L. Frost,et al.  An algorithm for linearly constrained adaptive array processing , 1972 .

[22]  R. Bracewell The Fourier Transform and Its Applications , 1966 .

[23]  C. Niessen,et al.  Adaptive Equalizer for Pulse Transmission , 1970 .

[24]  Bernard Widrow,et al.  Effects of Quantization in Adaptive Processes. A Hybrid Adaptive Processor. , 1971 .

[25]  J. Blum Multidimensional Stochastic Approximation Methods , 1954 .

[26]  D. Svoboda A phase-locked receiving array for high-frequency communications use , 1964 .

[27]  Bede Liu,et al.  A new hardware realization of digital filters , 1974 .

[28]  V. Dupac A DYNAMIC STOCHASTIC APPROXIMATION METHOD , 1965 .

[29]  S. Applebaum,et al.  Adaptive arrays , 1976 .

[30]  R. Riegler,et al.  An adaptive array for interference rejection , 1973 .

[31]  Louis L. Scharf,et al.  On stochastic approximation and the hierarchy of adaptive array algorithms , 1972, CDC 1972.

[32]  R. D. Figueiredo Convergent algorithms for pattern recognition in nonlinearly evolving nonstationary environment , 1968 .

[33]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[34]  I. D. Landau,et al.  A survey of model reference adaptive techniques - Theory and applications , 1973, Autom..

[35]  David Sworder,et al.  Optimal adaptive control systems , 1966 .

[36]  Adaptive equalization using normalized stochastic approximation methods , 1974, CDC 1974.

[37]  THOMAS P. DANIELL Adaptive Estimation with Mutually Correlated Training Sequences , 1970, IEEE Trans. Syst. Sci. Cybern..

[38]  L. J. Griffiths,et al.  A simple adaptive algorithm for real-time processing in antenna arrays , 1969 .