Stochastic Analysis of the LMS and NLMS Algorithms for Cyclostationary White Gaussian Inputs

This paper studies the stochastic behavior of the LMS and NLMS algorithms for a system identification framework when the input signal is a cyclostationary white Gaussian process. The input cyclostationary signal is modeled by a white Gaussian random process with periodically time-varying power. Mathematical models are derived for the mean and mean-square-deviation (MSD) behavior of the adaptive weights with the input cyclostationarity. These models are also applied to the non-stationary system with a random walk variation of the optimal weights. Monte Carlo simulations of the two algorithms provide strong support for the theory. Finally, the performance of the two algorithms is compared for a variety of scenarios.

[1]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[2]  E. Eweda,et al.  Analysis and design of a signed regressor LMS algorithm for stationary and nonstationary adaptive filtering with correlated Gaussian data , 1990 .

[3]  Robert Price,et al.  A useful theorem for nonlinear devices having Gaussian inputs , 1958, IRE Trans. Inf. Theory.

[4]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[5]  William A. Gardner,et al.  Characterization of cyclostationary random signal processes , 1975, IEEE Trans. Inf. Theory.

[6]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[7]  Dimitris G. Manolakis,et al.  Statistical and Adaptive Signal Processing , 2000 .

[8]  Jun Yang,et al.  Blind adaptive beamforming algorithm based on cyclostationary signals , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[9]  Jeffrey H. Reed,et al.  The performance of time-dependent adaptive filters for interference rejection , 1990, IEEE Trans. Acoust. Speech Signal Process..

[10]  Eweda Eweda,et al.  Behavior of the least mean square algorithm with a periodically time‐varying input power , 2012 .

[11]  Eweda Eweda,et al.  Stochastic Analysis of an Adaptive Line Enhancer/Canceler With a Cyclostationary Input , 2016, IEEE Transactions on Signal Processing.

[12]  D. C. McLernon,et al.  Analysis of LMS algorithm with inputs from cyclostationary random processes , 1991 .

[13]  B. Widrow,et al.  The time-sequenced adaptive filter , 1981 .

[14]  G. Wittum,et al.  Adaptive filtering , 1997 .

[15]  Azzedine Zerguine,et al.  Tracking analysis of normalized adaptive algorithms , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[16]  Giacinto Gelli,et al.  Adaptive minimum variance equalization with interference suppression capabilities , 2001, IEEE Communications Letters.

[17]  Tapio Seppänen,et al.  Adaptive filtering of cyclostationary interference from speech , 2001, ICECS 2001. 8th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.01EX483).

[18]  Sérgio J. M. de Almeida,et al.  A Stochastic Model for a Pseudo Affine Projection Algorithm , 2009, IEEE Transactions on Signal Processing.

[19]  Aníbal R. Figueiras-Vidal,et al.  An adaptive beamforming technique based on cyclostationary signal properties , 1995, IEEE Trans. Signal Process..

[20]  Sung Ho Cho,et al.  Tracking analysis of the sign algorithm in nonstationary environments , 1990, IEEE Trans. Acoust. Speech Signal Process..

[21]  William A. Sethares,et al.  Weak convergence and local stability properties of fixed step size recursive algorithms , 1993, IEEE Trans. Inf. Theory.

[22]  Odile Macchi,et al.  Adaptive Processing: The Least Mean Squares Approach with Applications in Transmission , 1995 .

[23]  Andrew H. Jazwinski,et al.  Adaptive filtering , 1969, Autom..

[24]  Eweda Eweda.  Comparison of LMS and NLMS adaptive filters with a non-stationary input , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[25]  Antonio Napolitano,et al.  Cyclostationarity: Half a century of research , 2006, Signal Process..

[26]  José Carlos M. Bermudez,et al.  Transient and tracking performance analysis of the quantized LMS algorithm for time-varying system identification , 1996, IEEE Trans. Signal Process..

[27]  Eweda Eweda,et al.  Transient and tracking performance bounds of the sign-sign algorithm , 1999, IEEE Trans. Signal Process..

[28]  C. Richard Johnson,et al.  Characterizing persistent excitation for the sign-sign equation error identifier , 1993, Autom..

[29]  Eweda Eweda,et al.  Comparison of RLS, LMS, and sign algorithms for tracking randomly time-varying channels , 1994, IEEE Trans. Signal Process..

[30]  B. Anderson,et al.  Excitation conditions for signed regressor least mean squares adaptation , 1988 .

[31]  Neil J. Bershad,et al.  Stochastic analysis of the LMS algorithm for non-stationary white Gaussian inputs , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[32]  J. Minkoff,et al.  Comment on the "Unnecessary assumption of statistical independence between reference signal and filter weights in feedforward adaptive systems" , 2001, IEEE Trans. Signal Process..

[33]  William A. Gardner,et al.  A new method of channel identification , 1991, IEEE Trans. Commun..

[34]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[35]  Odile Macchi,et al.  Tracking capability of the least mean square algorithm: Application to an asynchronous echo canceller , 1987, IEEE Trans. Acoust. Speech Signal Process..

[36]  Ali H. Sayed,et al.  A unified approach to the steady-state and tracking analyses of adaptive filters , 2001, IEEE Trans. Signal Process..

[37]  José Carlos M. Bermudez,et al.  An improved model for the Normalized LMS algorithm with Gaussian inputs and large number of coefficients , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[38]  C. P. Kwong,et al.  Control-theoretic design of the LMS and the sign algorithms in nonstationary environments , 1990, IEEE Trans. Acoust. Speech Signal Process..

[39]  William A. Gardner,et al.  Cyclic Wiener filtering: theory and method , 1993, IEEE Trans. Commun..

[40]  Eweda Eweda,et al.  Stochastic analysis of the least mean fourth algorithm for non-stationary white Gaussian inputs , 2014, Signal Image Video Process..