Block conjugate gradient algorithms for adaptive filtering

Abstract Two adaptive algorithms based on the conjugate gradient method are presented for finite impulse response (FIR) block adaptive filters. First, the block conjugate gradient (BCG) algorithm is derived from minimization of an estimate of the block mean-square error (BMSE). Using the fast convolution technique, the BCG algorithm is then extended to the frequency-domain BCG (FBCG) algorithm that yields significant computational savings over the BCG algorithm, especially for a large filter-tap order. Through computer simulations, it is shown that although the adaptation accuracy of the BCG or the FBCG is nearly equal to that of the optimum block adaptive (OBA) algorithm, its convergence property is superior to that of the OBA algorithm under any input conditions. Moreover, it is also shown that their convergence rate is as fast as the recursive least-squares (RLS) algorithms for a relatively small eigenvalue spread.

[1]  Janusz S. Kowalik,et al.  Iterative methods for nonlinear optimization problems , 1972 .

[2]  Thomas Kailath,et al.  Windowed fast transversal filters adaptive algorithms with normalization , 1985, IEEE Trans. Acoust. Speech Signal Process..

[3]  S. T. Alexander,et al.  Adaptive Signal Processing: Theory and Applications , 1986 .

[4]  Giancarlo Prati,et al.  Self-Orthogonalizing Adaptive Equalization in the Discrete Frequency Domain , 1984, IEEE Trans. Commun..

[5]  Héctor M. Pérez Meana,et al.  A fast adaptive filter algorithm using eigenvalue reciprocals as stepsizes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[6]  J. Proakis,et al.  Channel identification for high speed digital communications , 1974 .

[7]  Sanjit K. Mitra,et al.  Block implementation of adaptive digital filters , 1981 .

[8]  K. R. Rao,et al.  Orthogonal Transforms for Digital Signal Processing , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  J. Daniel.  The Conjugate Gradient Method for Linear and Nonlinear Operator Equations , 1967 .

[10]  Bernard Mulgrew,et al.  A self-orthogonalizing efficient block adaptive filter , 1986, IEEE Trans. Acoust. Speech Signal Process..

[11]  Chong Kwan Un,et al.  Performance analysis of frequency-domain block LMS adaptive digital filters , 1989 .

[12]  R. T. Compton.  Adaptive Antennas: Concepts and Performance , 1988 .

[13]  Tamal Bose,et al.  Conjugate gradient method in adaptive bilinear filtering , 1995, IEEE Trans. Signal Process..

[14]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[15]  C. Burrus,et al.  Fast Convolution using fermat number transforms with applications to digital filtering , 1974 .

[16]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[17]  Wasfy B. Mikhael,et al.  A Fast Block FIR Adaptive Digital Filtering Algorithm with Individual Adaption of Parameters , 1989 .

[18]  Robert J. Plemmons,et al.  FFT-based RLS in signal processing , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[20]  J.-S. Soo,et al.  Multidelay block frequency domain adaptive filter , 1990, IEEE Trans. Acoust. Speech Signal Process..

[21]  Jacob Benesty,et al.  A gradient-based adaptive algorithm with reduced complexity, fast convergence and good tracking characteristics , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Sanjit K. Mitra,et al.  On the block least squares adaptive digital filters realized using the fast Fourier transform , 1988 .

[23]  J.C. Lee,et al.  A frequency-weighted block LMS algorithm and its application to speech processing , 1985, Proceedings of the IEEE.

[24]  E. Ferrara.  Fast implementations of LMS adaptive filters , 1980 .

[25]  Pierre Duhamel,et al.  A set of algorithms linking NLMS and block RLS algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  C. Burrus.  Block implementation of digital filters , 1971 .

[27]  W. Mikhael,et al.  Fast algorithms for block FIR adaptive digital filtering , 1987 .

[28]  Jacob Benesty,et al.  A fast exact least mean square adaptive algorithm , 1992, IEEE Trans. Signal Process..

[29]  Magnus R. Hestenes,et al.  Conjugate Direction Methods in Optimization , 1980 .

[30]  Richard E. Blahut,et al.  Fast Algorithms for Digital Signal Processing , 1985 .

[31]  David G. Luenberger,et al.  Linear and nonlinear programming , 1984 .

[32]  C. Un,et al.  Conjugate gradient algorithm for block FIR adaptive filtering , 1993 .

[33]  A. Gray,et al.  Unconstrained frequency-domain adaptive filter , 1982 .

[34]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[35]  M. Srinath,et al.  Conjugate gradient techniques for adaptive filtering , 1992 .