On using exact joint diagonalization for noniterative approximate joint diagonalization

We propose a novel, noniterative approach for the problem of nonunitary, least-squares (LS) approximate joint diagonalization (AJD) of several Hermitian target matrices. Dwelling on the fact that exact joint diagonalization (EJD) of two Hermitian matrices can almost always be easily obtained in closed form, we show how two "representative matrices" can be constructed out of the original set of all target matrices, such that their EJD would be useful in the AJD of the original set. Indeed, for the two-by-two case, we show that the EJD of the representative matrices yields the optimal AJD solution. For larger-scale cases, the EJD can provide a suboptimal AJD solution, possibly serving as a good initial guess for a subsequent iterative algorithm. Additionally, we provide an informative lower bound on the attainable LS fit, which is useful in gauging the distance of prospective solutions from optimality.

[1]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..

[2]  James P. Reilly,et al.  Blind identification of MIMO FIR systems driven by quasistationary sources using second-order statistics: a frequency domain approach , 2004, IEEE Transactions on Signal Processing.

[3]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[4]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[5]  Arie Yeredor,et al.  Approximate Joint Diagonalization Using a Natural Gradient Approach , 2004, ICA.

[6]  Arie Yeredor,et al.  Blind source separation via the second characteristic function , 2000, Signal Process..

[7]  J. Cardoso.  On the Performance of Orthogonal Source Separation Algorithms , 1994 .

[8]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[9]  Heinz Mathis,et al.  Joint diagonalization of correlation matrices by using gradient methods with application to blind signal separation , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[10]  Andreas Ziehe,et al.  A Fast Algorithm for Joint Diagonalization with Non-orthogonal Transformations and its Application to Blind Source Separation , 2004, J. Mach. Learn. Res..

[11]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[12]  Dinh Tuan Pham,et al.  Joint Approximate Diagonalization of Positive Definite Hermitian Matrices , 2000, SIAM J. Matrix Anal. Appl..

[13]  Andreas Ziehe,et al.  An approach to blind source separation based on temporal structure of speech signals , 2001, Neurocomputing.

[14]  M. Joho,et al.  Joint diagonalization of correlation matrices by using Newton methods with application to blind signal separation , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[15]  Arie Yeredor,et al.  Optimization of JADE using a novel optimally weighted joint diagonalization approach , 2004, 2004 12th European Signal Processing Conference.

[16]  Zhi Ding,et al.  A two-stage algorithm for MIMO blind deconvolution of nonstationary colored signals , 2000, IEEE Trans. Signal Process..

[17]  Moeness G. Amin,et al.  Blind source separation based on time-frequency signal representations , 1998, IEEE Trans. Signal Process..

[18]  A.-J. van der Veen.  Joint diagonalization via subspace fitting techniques , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).