A Coordinate Descent Algorithm for Complex Joint Diagonalization Under Hermitian and Transpose Congruences

This paper deals with the problem of joint complex matrix diagonalization by considering both the Hermitian and transpose congruences. We address the general case where the searched diagonalizing matrix is a priori nonunitary. Based on the minimization of a quadratic criterion, we propose a flexible algorithm in the sense that it allows to directly consider a rectangular diagonalizing matrix and to take into consideration both the Hermitian and transpose congruences within the same framework. The proposed algorithm is a coordinate descent algorithm that is based on an approximate criterion leading to the analytical derivation of the minima arguments. Computer simulations are drawn to illustrate the usefulness and performances of the algorithm and a comparison to state-of-the-art algorithms is presented. Finally, an application to independent component analysis based on fourth-order statistics is also presented.

[1]  Tülay Adali,et al.  Blind Separation of Noncircular Correlated Sources Using Gaussian Entropy Rate , 2011, IEEE Transactions on Signal Processing.

[2]  Dinh Tuan Pham,et al.  Joint Approximate Diagonalization of Positive Definite Hermitian Matrices , 2000, SIAM J. Matrix Anal. Appl..

[3]  Bijan Afsari,et al.  Some Gradient Based Joint Diagonalization Methods for ICA , 2004, ICA.

[4]  Tülay Adali,et al.  A relative gradient algorithm for joint decompositions of complex matrices , 2010, 2010 18th European Signal Processing Conference.

[5]  M. J. Seaton.  Diagonalisation of complex symmetric matrices using a modified Jacobi method , 1969, Comput. J..

[6]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[7]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[8]  V. Koivunen,et al.  Ieee Workshop on Machine Learning for Signal Processing Complex-valued Ica Using Second , 2022 .

[9]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[10]  Xi-Lin Li,et al.  Nonorthogonal Joint Diagonalization Free of Degenerate Solution , 2007, IEEE Transactions on Signal Processing.

[11]  Bart De Moor,et al.  On the blind separation of non-circular sources , 2002, 2002 11th European Signal Processing Conference.

[12]  Bijan Afsari,et al.  Sensitivity Analysis for the Problem of Matrix Joint Diagonalization , 2008, SIAM J. Matrix Anal. Appl..

[13]  Eric Moreau,et al.  A one stage self-adaptive algorithm for source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Eric Moreau,et al.  Nonsymmetrical contrasts for sources separation , 1999, IEEE Trans. Signal Process..

[15]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[16]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[17]  Ronald Phlypo,et al.  Orthogonal and non-orthogonal joint blind source separation in the least-squares sense , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[18]  Heinz Mathis,et al.  Joint diagonalization of correlation matrices by using gradient methods with application to blind signal separation , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[19]  Bernard C. Picinbono,et al.  On circularity , 1994, IEEE Trans. Signal Process..

[20]  Christian Jutten,et al.  On the blind source separation of human electroencephalogram by approximate joint diagonalization of second order statistics , 2008, Clinical Neurophysiology.

[21]  El Mostafa Fadaili,et al.  Nonorthogonal Joint Diagonalization/Zero Diagonalization for Source Separation Based on Time-Frequency Distributions , 2007, IEEE Transactions on Signal Processing.

[22]  Are Hjørungnes,et al.  Complex-Valued Matrix Differentiation: Techniques and Key Results , 2007, IEEE Transactions on Signal Processing.

[23]  Shihua Zhu,et al.  Approximate joint diagonalization by nonorthogonal nonparametric Jacobi transformations , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  P. Tichavsky,et al.  Fast Approximate Joint Diagonalization Incorporating Weight Matrices , 2009, IEEE Transactions on Signal Processing.

[25]  J. Berge,et al.  On uniqueness in candecomp/parafac , 2002 .

[26]  Arie Yeredor,et al.  Approximate Joint Diagonalization Using a Natural Gradient Approach , 2004, ICA.

[27]  Moeness G. Amin,et al.  Blind source separation based on time-frequency signal representations , 1998, IEEE Trans. Signal Process..

[28]  Visa Koivunen,et al.  Adaptive Signal Processing: Next Generation Solutions , 2010 .

[29]  Eric Moreau,et al.  Blind Identification and Separation of Complex-Valued Signals: Moreau/Blind Identification and Separation of Complex-Valued Signals , 2013 .

[30]  Pascal Chevalier,et al.  Second-Order Optimal Array Receivers for Synchronization of BPSK, MSK, and GMSK Signals Corrupted by Noncircular Interferences , 2007, EURASIP J. Adv. Signal Process..

[31]  Lieven De Lathauwer,et al.  A Link between the Canonical Decomposition in Multilinear Algebra and Simultaneous Matrix Diagonalization , 2006, SIAM J. Matrix Anal. Appl..

[32]  Arie Yeredor,et al.  Joint Matrices Decompositions and Blind Source Separation: A survey of methods, identification, and applications , 2014, IEEE Signal Processing Magazine.

[33]  Eric Moreau,et al.  A least squares algorithm for global joint decomposition of complex matrix sets , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[34]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[35]  Hao Shen,et al.  Uniqueness Analysis of Non-Unitary Matrix Joint Diagonalization , 2011, IEEE Transactions on Signal Processing.

[36]  Andreas Ziehe,et al.  A Fast Algorithm for Joint Diagonalization with Non-orthogonal Transformations and its Application to Blind Source Separation , 2004, J. Mach. Learn. Res..

[37]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..