A Block-Jacobi Algorithm for Non-Symmetric Joint Diagonalization of Matrices

This paper studies the problem of Non-symmetric Joint Diagonalization NsJD of matrices, namely, jointly diagonalizing a set of complex matrices by one matrix multiplication from the left and one multiplication with possibly another matrix from the right. In order to avoid ambiguities in the solutions, these two matrices are restricted to lie in the complex oblique manifold. We derive a necessary and sufficient condition for the uniqueness of solutions, and characterize the Hessian of global minimizers of the off-norm cost function, which is typically used to measure joint diagonality. By exploiting existing results on Jacobi algorithms, we develop a block-Jacobi method that guarantees local convergence to a pair of joint diagonalizers at a quadratic rate. The performance of the proposed algorithm is investigated by numerical experiments.

[1]  Hao Shen,et al.  Uniqueness Analysis of Non-Unitary Matrix Joint Diagonalization , 2011, IEEE Transactions on Signal Processing.

[2]  Jun Zhang,et al.  Nonorthogonal Joint Diagonalization Algorithm Based on Trigonometric Parameterization , 2007, IEEE Transactions on Signal Processing.

[3]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[4]  Hao Shen,et al.  A Geometric Framework for Non-Unitary Joint Diagonalization of Complex Symmetric Matrices , 2013, GSI.

[5]  Hao Shen,et al.  A Matrix Joint Diagonalization Approach for Complex Independent Vector Analysis , 2012, LVA/ICA.

[6]  Dinh Tuan Pham,et al.  Joint Approximate Diagonalization of Positive Definite Hermitian Matrices , 2000, SIAM J. Matrix Anal. Appl..

[7]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[8]  Arie Yeredor,et al.  Joint Matrices Decompositions and Blind Source Separation: A survey of methods, identification, and applications , 2014, IEEE Signal Processing Magazine.

[9]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[10]  Hao Shen,et al.  Block-Jacobi Methods with Newton-Steps and Non-unitary Joint Matrix Diagonalization , 2015, GSI.

[11]  Antoine Souloumiac,et al.  Nonorthogonal Joint Diagonalization by Combining Givens and Hyperbolic Rotations , 2009, IEEE Transactions on Signal Processing.

[12]  Gilles Chabriel,et al.  Non-Symmetrical Joint Zero-Diagonalization and MIMO Zero-Division Multiple Access , 2011, IEEE Transactions on Signal Processing.

[13]  Hao Shen,et al.  Block Jacobi-type methods for non-orthogonal joint diagonalisation , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.