Split Recursive Least-Squares: algorithms, architectures, and applications

In this paper, a new computationally efficient algorithm for adaptive filtering is presented. The proposed Split Recursive Least-Squares (Split RLS) algorithm can perform the approximated RLS with O(N) complexity for signals having no special data structure to be exploited (e.g., the signals in multichannel adaptive filtering applications, which are not shifts of a single-channel signal data), while avoiding the high computational complexity (O(N/sup 2/)) required in the conventional RLS algorithms. Our performance analysis shows that the estimation bias will be small when the input data are less correlated. We also show that for highly correlated data, the orthogonal preprocessing scheme can be used to improve the performance of the Split RLS. Furthermore, the systolic implementation of our algorithm based on the QR-decomposition RLS (QRD-RLS) array as well as its application to multidimensional adaptive filtering is also discussed. The hardware complexity for the resulting array is only O(N) and the system latency can be reduced to O(log/sub 2/ N). The simulation results show that the Split RLS outperforms the conventional RLS in the application of image restoration. A major advantage of the Split RLS is its superior tracking capability over the conventional RLS under nonstationary environments.

[1]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[2]  Mohamed Najim,et al.  Two-dimensional joint process lattice for adaptive restoration of images , 1992, IEEE Trans. Image Process..

[3]  Thomas F. Quatieri,et al.  McClellan transformations for two-dimensional digital filtering. I - Design , 1976 .

[4]  K. J. Ray Liu,et al.  Unified parallel lattice structures for time-recursive discrete cosine/sine/Hartley transforms , 1993, IEEE Trans. Signal Process..

[5]  K. Tanabe Projection method for solving a singular system of linear equations and its applications , 1971 .

[6]  David W. Thomas,et al.  The two-dimensional adaptive LMS (TDLMS) algorithm , 1988 .

[7]  T. Elfving Block-iterative methods for consistent and inconsistent linear equations , 1980 .

[8]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[9]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[10]  W. K. Jenkins,et al.  The use of orthogonal transforms for improving performance of adaptive filters , 1989 .

[11]  David H. Staelin,et al.  Algorithms and systolic architectures for multidimensional adaptive filtering via McClellan transformations , 1992, IEEE Trans. Circuits Syst. Video Technol..

[12]  David G. Messerschmitt,et al.  Adaptive Filters: Structures, Algorithms and Applications , 1984 .

[13]  J. G. McWhirter,et al.  Recursive Least-Squares Minimization Using A Systolic Array , 1983, Optics & Photonics.

[14]  Peter Strobach Fast recursive eigensubspace adaptive filters , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[15]  TanabeKunio Projection method for solving a singular system of linear equations and its applications , 1971 .

[16]  J. McClellan,et al.  A 2-D FIR filter structure derived from the Chebyshev recursion , 1977 .

[17]  G. Stewart Introduction to matrix computations , 1973 .

[18]  Steve Rogers,et al.  Adaptive Filter Theory , 1996 .

[19]  R. M. Mersereau,et al.  McClellan transformations for two-dimensional digital filtering-Part I: Design , 1976 .

[20]  H. T. Kung,et al.  Matrix Triangularization By Systolic Arrays , 1982, Optics & Photonics.

[21]  Ahmed H. Sameh,et al.  Row Projection Methods for Large Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[22]  Saeed Gazor,et al.  Selection of orthonormal transforms for improving the performance of the transform domain normalised LMS algorithm , 1992 .