Two new gradient based non-unitary joint block-diagonalization algorithms

This paper addresses the problem of the non-unitary joint block diagonalization (NU - JBD) of a given set of matrices. Such a problem arises in various fields of applications among which blind separation of convolutive mixtures of sources and array processing for wide-band signals. We present two new algorithms based respectively on (absolute) gradient and relative gradient descendent approaches. The main advantage of the proposed algorithms is that they are more general (the real, positive definite or hermitian assumptions about the matrices belonging to the considered set are no more necessary and the found joint block diagonalizer can be either a unitary or non-unitary matrix). These algorithms also outperform the JBD algorithm based on an optimal step size but “approximate gradient” approach that we had previously suggested in [12]. In fact, here, the exact calculus of the complex gradient matrix is performed whereas it was approximated in [12]. Finally, by ensuring the invertibility of the estimated matrix, the relative gradient approach makes the proposed NU - JBD algorithm more stable and consequently more robust. Computer simulations are provided in order to illustrate the effectiveness of the proposed approaches in two cases: when exact block-diagonal matrices are considered and when they are perturbed by an additive Gaussian noise. A comparison with the method presented in [12] is also performed, emphasizing the good behavior of the proposed algorithms.

[1]  Hicham Ghennioui,et al.  A Nonunitary Joint Block Diagonalization Algorithm for Blind Separation of Convolutive Mixtures of Sources , 2007, IEEE Signal Processing Letters.

[2]  D. T. Pham,et al.  Blind Separation of Cyclostationary Sources Using Joint Block Approximate Diagonalization , 2007, ICA.

[3]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[4]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[5]  Nadège Thirion-Moreau,et al.  Algebraic Joint Zero-Diagonalization and Blind Sources Separation , 2008, IEEE Transactions on Signal Processing.

[6]  Joos Vandewalle,et al.  Jacobi Algorithm for Joint Block Diagonalization in Blind Idenfitication , 2002 .

[7]  Are Hjørungnes,et al.  Complex-Valued Matrix Differentiation: Techniques and Key Results , 2007, IEEE Transactions on Signal Processing.

[8]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[9]  M. Joho,et al.  Joint diagonalization of correlation matrices by using Newton methods with application to blind signal separation , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[10]  Abdelhak M. Zoubir,et al.  Joint anti-diagonalization for blind source separation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[11]  Heinz Mathis,et al.  Joint diagonalization of correlation matrices by using gradient methods with application to blind signal separation , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[12]  El Mostafa Fadaili,et al.  Nonorthogonal Joint Diagonalization/Zero Diagonalization for Source Separation Based on Time-Frequency Distributions , 2007, IEEE Transactions on Signal Processing.

[13]  Driss Aboutajdine,et al.  A novel approach based on non-unitary joint block-diagonalization for the blind MIMO equalization of cyclo-stationary signals , 2008, 2008 16th European Signal Processing Conference.

[14]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[15]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[16]  Arie Yeredor,et al.  Approximate Joint Diagonalization Using a Natural Gradient Approach , 2004, ICA.

[17]  A. Belouchrani,et al.  Blind separation of non stationary sources using joint block diagonalization , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[18]  Andreas Ziehe,et al.  A Fast Algorithm for Joint Diagonalization with Non-orthogonal Transformations and its Application to Blind Source Separation , 2004, J. Mach. Learn. Res..

[19]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[20]  S. Dégerine,et al.  Sur la diagonalisation conjointe approchée par un critère des moindres carrés , 2001 .

[21]  L. Lathauwer,et al.  Signal Processing based on Multilinear Algebra , 1997 .

[22]  Driss Aboutajdine,et al.  Non Unitary Joint Block Diagonalization of Complex Matrices Using a Gradient Approach , 2007, ICA.