A new class of block coordinate algorithms for the joint eigenvalue decomposition of complex matrices

Abstract Several signal processing problems can be written as the joint eigenvalue decomposition (JEVD) of a set of noisy matrices. JEVD notably occurs in source separation problems and for the canonical polyadic decomposition of tensors. Most of the existing JEVD algorithms are based on a block coordinate procedure and require significant modifications to deal with complex-valued matrices. These modifications decrease algorithms performances either in terms of estimation accuracy of the eigenvectors or in terms of computational cost. Therefore, we propose a class of algorithms working equally with real- or complex-valued matrices. These algorithms are still based on a block coordinate procedure and multiplicative updates. The originality of the proposed approach lies in the structure of the updating matrix and in the way the optimization problem is solved in C N × N . That structure is parametrized and allows to define up to five different JEVD algorithms. Thanks to numerical simulations, we show that, with respect to the more accurate algorithms of the literature, this approach improves the estimation of the eigenvectors and has a computational cost significantly lower. Finally, as an application example, one of the proposed algorithm is successfully applied to the blind source separation of Direct-Sequence Code Division Multiple Access signals.

[1]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[2]  Eric Moreau,et al.  A coupled joint eigenvalue decomposition algorithm for canonical polyadic decomposition of tensors , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[3]  Peter Strobach Bi-iteration multiple invariance subspace tracking and adaptive ESPRIT , 2000, IEEE Trans. Signal Process..

[4]  Nikos D. Sidiropoulos,et al.  Blind PARAFAC receivers for DS-CDMA systems , 2000, IEEE Trans. Signal Process..

[5]  Adel Belouchrani,et al.  A New Algorithm for Complex Non-Orthogonal Joint Diagonalization Based on Shear and Givens Rotations , 2013, IEEE Transactions on Signal Processing.

[6]  Lieven De Lathauwer,et al.  A Block Component Model-Based Blind DS-CDMA Receiver , 2008, IEEE Transactions on Signal Processing.

[7]  Percy Liang,et al.  Tensor Factorization via Matrix Factorization , 2015, AISTATS.

[8]  Irving Kaplansky Algebraic polar decomposition , 1990 .

[9]  M. Haardt,et al.  A closed-form solution for multilinear PARAFAC decompositions , 2008, 2008 5th IEEE Sensor Array and Multichannel Signal Processing Workshop.

[10]  André Lima Férrer de Almeida,et al.  Joint data and connection topology recovery in collaborative wireless sensor networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Xiqi Gao,et al.  Simultaneous Diagonalization With Similarity Transformation for Non-Defective Matrices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  Jean-Marc Robin,et al.  Estimating Multivariate Latent-Structure Models , 2016, 1603.09141.

[13]  C. Jacobi Über ein leichtes Verfahren die in der Theorie der Säcularstörungen vorkommenden Gleichungen numerisch aufzulösen*). , 2022 .

[14]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[15]  Josef A. Nossek,et al.  Simultaneous Schur decomposition of several nonsymmetric matrices to achieve automatic pairing in multidimensional harmonic retrieval problems , 1998, IEEE Trans. Signal Process..

[16]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[17]  Pierre Comon,et al.  Enhanced Line Search: A Novel Method to Accelerate PARAFAC , 2008, SIAM J. Matrix Anal. Appl..

[18]  Tosio Kato A Short Introduction to Perturbation Theory for Linear Operators , 1982 .

[19]  Ed F. Deprettere,et al.  Analysis of joint angle-frequency estimation using ESPRIT , 2003, IEEE Trans. Signal Process..

[20]  A complex orthogonal-symmetric analog of the polar decomposition , 1987 .

[21]  Karim Abed-Meraim,et al.  A new Jacobi-like method for joint diagonalization of arbitrary non-defective matrices , 2009, Appl. Math. Comput..

[22]  Antoine Souloumiac,et al.  Nonorthogonal Joint Diagonalization by Combining Givens and Hyperbolic Rotations , 2009, IEEE Transactions on Signal Processing.

[23]  André Lima Férrer de Almeida,et al.  Space-time spreading MIMO-CDMA downlink systems using constrained tensor modeling , 2008, Signal Process..

[24]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[25]  Laurent Albera,et al.  Joint Eigenvalue Decomposition of Non-Defective Matrices Based on the LU Factorization With Application to ICA , 2015, IEEE Transactions on Signal Processing.

[26]  Lieven De Lathauwer,et al.  A Link between the Canonical Decomposition in Multilinear Algebra and Simultaneous Matrix Diagonalization , 2006, SIAM J. Matrix Anal. Appl..

[27]  Lieven De Lathauwer,et al.  An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA , 2008, Signal Process..

[28]  Ed F. Deprettere,et al.  Azimuth and elevation computation in high resolution DOA estimation , 1992, IEEE Trans. Signal Process..

[29]  C. Jacobi,et al.  C. G. J. Jacobi's Gesammelte Werke: Über ein leichtes Verfahren, die in der Theorie der Sacularstorungen vorkommenden Gleichungen numerisch aufzulosen , 1846 .

[30]  Joos Vandewalle,et al.  Computation of the Canonical Decomposition by Means of a Simultaneous Generalized Schur Decomposition , 2005, SIAM J. Matrix Anal. Appl..

[31]  X. Luciani,et al.  Canonical Polyadic Decomposition based on joint eigenvalue decomposition , 2014 .

[32]  Eric Moreau,et al.  Jacobi like algorithm for non-orthogonal joint diagonalization of hermitian matrices , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  João Marcos Travassos Romano,et al.  Tensor coding for CDMA-mimowireless communication systems , 2011, 2011 19th European Signal Processing Conference.