Joint Block Diagonalization Algorithms for Optimal Separation of Multidimensional Components

This paper deals with non-orthogonal joint block diagonalization. Two algorithms which minimize the Kullback-Leibler divergence between a set of real positive-definite matrices and a block-diagonal transformation thereof are suggested. One algorithm is based on the relative gradient, and the other is based on a quasi-Newton method. These algorithms allow for the optimal, in the mean square error sense, blind separation of multidimensional Gaussian components. Simulations demonstrate the convergence properties of the suggested algorithms, as well as the dependence of the criterion on some of the model parameters.

[1]  Driss Aboutajdine,et al.  Gradient-based joint block diagonalization algorithms: Application to blind separation of FIR convolutive mixtures , 2010, Signal Process..

[2]  Aapo Hyvärinen,et al.  Learning Natural Image Structure with a Horizontal Product Model , 2009, ICA.

[3]  Pham Dinh-Tuan,et al.  Information Approach to Blind Source Separation and Deconvolution , 2009 .

[4]  Tülay Adali,et al.  A maximum likelihood approach for independent vector analysis of Gaussian data sets , 2011, 2011 IEEE International Workshop on Machine Learning for Signal Processing.

[5]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..

[6]  E. Oja,et al.  Independent Component Analysis , 2001 .

[7]  Matthias Dehmer,et al.  Information Theory and Statistical Learning , 2010 .

[8]  Hagit Messer,et al.  Second-Order Multidimensional ICA: Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[9]  Dinh Tuan Pham,et al.  Joint Approximate Diagonalization of Positive Definite Hermitian Matrices , 2000, SIAM J. Matrix Anal. Appl..

[10]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[11]  Dimitri Nion,et al.  A Tensor Framework for Nonunitary Joint Block Diagonalization , 2011, IEEE Transactions on Signal Processing.

[12]  D. T. Pham,et al.  Blind Separation of Cyclostationary Sources Using Joint Block Approximate Diagonalization , 2007, ICA.

[13]  P. Comon Independent Component Analysis , 1992 .

[14]  Harold W. Gutch,et al.  Second Order Subspace Analysis and Simple Decompositions , 2010, LVA/ICA.

[15]  A. Belouchrani,et al.  Blind separation of non stationary sources using joint block diagonalization , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[16]  Alexander Graham,et al.  Kronecker Products and Matrix Calculus: With Applications , 1981 .

[17]  Rémi Gribonval,et al.  Latent variable analysis and signal separation , 2012, Signal Process..

[18]  S. Yau Mathematics and its applications , 2002 .