A “Sequentially Drilled” Joint Congruence (SeDJoCo) Transformation With Applications in Blind Source Separation and Multiuser MIMO Systems

We consider a particular form of the classical approximate joint diagonalization (AJD) problem, which we call a “sequentially drilled” joint congruence (SeDJoCo) transformation. The problem consists of a set of symmetric real-valued (or Hermitian-symmetric complex-valued) target-matrices. The number of matrices in the set equals their dimension, and the joint diagonality criterion requires that in each transformed (“diagonalized”) target-matrix, all off-diagonal elements on one specific row and column (corresponding to the matrix-index in the set) be exactly zeros, yet does not care about the other (diagonal or off-diagonal) elements. The motivation for this form arises in (at least) two different contexts: maximum likelihood blind (or semiblind) source separation and coordinated beamforming for multiple-input multiple-output (MIMO) broadcast channels. We prove that SeDJoCo always has a solution when the target-matrices are positive-definite . We also propose two possible iterative solution algorithms, based on defining and optimizing two different criteria functions, using Newton's method for the first function and successive Jacobi-like transformations for the second. The algorithms' convergence behavior and the attainable performance in the two contexts above are demonstrated in simulation experiments.

[1]  Andreas Ziehe,et al.  A Fast Algorithm for Joint Diagonalization with Non-orthogonal Transformations and its Application to Blind Source Separation , 2004, J. Mach. Learn. Res..

[2]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[3]  B. A. D. H. Brandwood A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[4]  Martin Haardt,et al.  Zero-forcing methods for downlink spatial multiplexing in multiuser MIMO channels , 2004, IEEE Transactions on Signal Processing.

[5]  Hualiang Li,et al.  Stability analysis of complex maximum likelihood ica using Wirtinger calculus , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Veljko Stankovic,et al.  Generalized Design of Multi-User MIMO Precoding Matrices , 2008, IEEE Transactions on Wireless Communications.

[7]  Arie Yeredor On hybrid exact-approximate joint diagonalization , 2009, 2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[8]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[9]  Visa Koivunen,et al.  Complex random vectors and ICA models: identifiability, uniqueness, and separability , 2005, IEEE Transactions on Information Theory.

[10]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[11]  Tülay Adali,et al.  On ICA of improper and noncircular sources , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Klaus Obermayer,et al.  Quadratic optimization for simultaneous matrix diagonalization , 2006, IEEE Transactions on Signal Processing.

[13]  A. Yeredor Blind separation of Gaussian sources via second-order statistics with asymptotically optimal weighting , 2000, IEEE Signal Processing Letters.

[14]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[15]  Bijan Afsari,et al.  Simple LU and QR Based Non-orthogonal Matrix Joint Diagonalization , 2006, ICA.

[16]  Arie Yeredor,et al.  Blind Separation of Gaussian Sources With General Covariance Structures: Bounds and Optimal Estimation , 2010, IEEE Transactions on Signal Processing.

[17]  Serge Dégerine,et al.  Separation of an instantaneous mixture of Gaussian autoregressive sources by the exact maximum likelihood approach , 2004, IEEE Transactions on Signal Processing.

[18]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[19]  P. Tichavsky,et al.  Fast Approximate Joint Diagonalization Incorporating Weight Matrices , 2009, IEEE Transactions on Signal Processing.

[20]  Robert W. Heath,et al.  Coordinated Beamforming for the Multiuser MIMO Broadcast Channel With Limited Feedforward , 2008, IEEE Transactions on Signal Processing.

[21]  Xi-Lin Li,et al.  Nonorthogonal Joint Diagonalization Free of Degenerate Solution , 2007, IEEE Transactions on Signal Processing.

[22]  A. Bos Complex gradient and Hessian , 1994 .

[23]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[24]  Robert W. Heath,et al.  Coordinated beamforming with limited feedback in the MIMO broadcast channel , 2008, IEEE Journal on Selected Areas in Communications.

[25]  Shlomo Shamai,et al.  The capacity region of the Gaussian MIMO broadcast channel , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[26]  Alle-Jan van der Veen,et al.  Joint diagonalization via subspace fitting techniques , 2001, ICASSP.

[27]  Tung-Sang Ng,et al.  Generalized multiuser orthogonal space-division multiplexing , 2004, IEEE Transactions on Wireless Communications.

[28]  Bin Song,et al.  Using a new structured joint congruence (STJOCO) transformation of Hermitian matrices for precoding in multi-user MIMO systems , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.