Two-channel constrained least squares problems: solutions using power methods and connections with canonical coordinates

The problem of two-channel constrained least squares (CLS) filtering under various sets of constraints is considered, and a general set of solutions is derived. For each set of constraints, the solution is determined by a coupled (asymmetric) generalized eigenvalue problem. This eigenvalue problem establishes a connection between two-channel CLS filtering and transform methods for resolving channel measurements into canonical or half-canonical coordinates. Based on this connection, a unified framework for reduced-rank Wiener filtering is presented. Then, various representations of reduced-rank Wiener filters in canonical and half-canonical coordinates are introduced. An alternating power method is proposed to recursively compute the canonical coordinate and half-canonical coordinate mappings. A deflation process is introduced to extract the mappings associated with the dominant coordinates. The correctness of the alternating power method is demonstrated on a synthesized data set, and conclusions are drawn.

[1]  B. AfeArd CALCULATING THE SINGULAR VALUES AND PSEUDOINVERSE OF A MATRIX , 2022 .

[2]  Yingbo Hua,et al.  Generalized Karhunen-Loeve transform , 1998, IEEE Signal Processing Letters.

[3]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[4]  Louis L. Scharf,et al.  Signal processing applications of oblique projection operators , 1994, IEEE Trans. Signal Process..

[5]  Louis L. Scharf,et al.  Canonical coordinates and the geometry of inference, rate, and capacity , 2000, IEEE Trans. Signal Process..

[6]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[7]  D. Brillinger Time series - data analysis and theory , 1981, Classics in applied mathematics.

[8]  M.A. Mow,et al.  Programmable canonical correlation analyzers with recursion and feedback , 1995, Conference Record of The Twenty-Ninth Asilomar Conference on Signals, Systems and Computers.

[9]  David R. Brillinger,et al.  Time Series: Data Analysis and Theory. , 1982 .

[10]  Donald W. Tufts,et al.  Simple, effective computation of principal eigenvectors and their eigenvalues and application to high-resolution estimation of frequencies , 1986, IEEE Trans. Acoust. Speech Signal Process..

[11]  Louis L. Scharf,et al.  The SVD and reduced rank signal processing , 1991, Signal Process..

[12]  Yingbo Hua,et al.  Computing the reduced rank Wiener filter by IQMD , 1999, IEEE Signal Processing Letters.

[13]  Petre Stoica,et al.  Optimal reduced-rank estimation and filtering , 2001, IEEE Trans. Signal Process..

[14]  G. Golub,et al.  Tracking a few extreme singular values and vectors in signal processing , 1990, Proc. IEEE.

[15]  Gene H. Golub,et al.  Calculating the singular values and pseudo-inverse of a matrix , 2007, Milestones in Matrix Computation.

[16]  William A. Gardner,et al.  Programmable canonical correlation analysis: a flexible framework for blind adaptive spatial filtering , 1995, IEEE Trans. Signal Process..

[17]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[18]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[19]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[20]  M. L. Eaton Multivariate statistics : a vector space approach , 1985 .

[21]  Franklin T. Luk,et al.  A Block Lanczos Method for Computing the Singular Values and Corresponding Singular Vectors of a Matrix , 1981, TOMS.

[22]  David S. Watkins,et al.  Fundamentals of matrix computations , 1991 .

[23]  Howard L. Weinert,et al.  Oblique projections: Formulas, algorithms, and error bounds , 1989, Math. Control. Signals Syst..

[24]  John K. Thomas,et al.  Wiener filters in canonical coordinates for transform coding, filtering, and quantizing , 1998, IEEE Trans. Signal Process..

[25]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[26]  L. Mirsky SYMMETRIC GAUGE FUNCTIONS AND UNITARILY INVARIANT NORMS , 1960 .

[27]  Tony F. Chan,et al.  An Improved Algorithm for Computing the Singular Value Decomposition , 1982, TOMS.