Blind Underdetermined Mixture Identification by Joint Canonical Decomposition of HO Cumulants

A new family of cumulant-based algorithms is proposed in order to blindly identify potentially underdetermined mixtures of statistically independent sources. These algorithms perform a joint canonical decomposition (CAND) of several higher order cumulants through a CAND of a three-way array with special symmetries. These techniques are studied in terms of identifiability, performance and numerical complexity. From a signal processing viewpoint, the proposed methods are shown i) to have a better estimation resolution and ii) to be able to process more sources than the other classical cumulant-based techniques. Second, from a numerical analysis viewpoint, we deal with the convergence speed of several procedures for three-way array decomposition, such as the ACDC scheme. We also show how to accelerate the iterative CAND algorithms by using differently the symmetries of the considered three-way array. Next, from a multilinear algebra viewpoint the paper aims at giving some insights on the uniqueness of a joint CAND of several Hermitian multiway arrays compared to the CAND of only one array. This allows us, as a result, to extend the concept of virtual array (VA) to the case of combination of several VAs.

[1]  P. Comon,et al.  Blind Identification of Overcomplete MixturEs of sources (BIOME) , 2004 .

[2]  Lieven De Lathauwer,et al.  Blind Identification of Underdetermined Mixtures by Simultaneous Matrix Diagonalization , 2008, IEEE Transactions on Signal Processing.

[3]  Laurent Albera,et al.  On the virtual array concept for higher order array processing , 2005, IEEE Transactions on Signal Processing.

[4]  Lieven De Lathauwer,et al.  Fourth-Order Cumulant-Based Blind Identification of Underdetermined Mixtures , 2007, IEEE Transactions on Signal Processing.

[5]  Dinh-Tuan Pham,et al.  Fast algorithms for mutual information based independent component analysis , 2004, IEEE Transactions on Signal Processing.

[6]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[7]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[8]  Anne Ferréol,et al.  On the virtual array concept for the fourth-order direction finding problem , 1999, IEEE Trans. Signal Process..

[9]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2006, Signal Process..

[10]  Arie Yeredor,et al.  On using exact joint diagonalization for noniterative approximate joint diagonalization , 2005, IEEE Signal Processing Letters.

[11]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[12]  Pierre Comon,et al.  Enhanced Line Search: A Novel Method to Accelerate PARAFAC , 2008, SIAM J. Matrix Anal. Appl..

[13]  João Cesar M. Mota,et al.  Blind channel identification algorithms based on the Parafac decomposition of cumulant tensors: The single and multiuser cases , 2008, Signal Process..

[14]  Nikos D. Sidiropoulos,et al.  Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints , 2004, IEEE Transactions on Signal Processing.

[15]  Anisse Taleb,et al.  An algorithm for the blind identification of N independent signals with 2 sensors , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[16]  Laurent Albera,et al.  Fourth-order blind identification of underdetermined mixtures of sources (FOBIUM) , 2005, IEEE Transactions on Signal Processing.

[17]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[18]  P. Comon,et al.  ICAR: a tool for blind source separation using fourth-order statistics only , 2005, IEEE Transactions on Signal Processing.

[19]  J. Kruskal Rank, decomposition, and uniqueness for 3-way and n -way arrays , 1989 .

[20]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[21]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[22]  Lieven De Lathauwer,et al.  A Link between the Canonical Decomposition in Multilinear Algebra and Simultaneous Matrix Diagonalization , 2006, SIAM J. Matrix Anal. Appl..

[23]  R. Liu,et al.  AMUSE: a new blind identification algorithm , 1990, IEEE International Symposium on Circuits and Systems.

[24]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[25]  Pierre Comon,et al.  Blind identification and source separation in 2×3 under-determined mixtures , 2004, IEEE Trans. Signal Process..

[26]  Lieven De Lathauwer,et al.  An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA , 2008, Signal Process..

[27]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[28]  N. Sidiropoulos,et al.  On the uniqueness of multilinear decomposition of N‐way arrays , 2000 .

[29]  Pierre Comon,et al.  Blind Identification of Underdetermined Mixtures Based on the Characteristic Function: The Complex Case , 2011, IEEE Transactions on Signal Processing.

[30]  L. De Lathauwer,et al.  Canonical decomposition of even higher order cumulant arrays for blind underdetermined mixture identification , 2008, 2008 5th IEEE Sensor Array and Multichannel Signal Processing Workshop.

[31]  Visa Koivunen,et al.  Blind separation methods based on Pearson system and its extensions , 2002, Signal Process..

[32]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[33]  P. McCullagh Tensor Methods in Statistics , 1987 .

[34]  P. Comon,et al.  Ica: a potential tool for bci systems , 2008, IEEE Signal Processing Magazine.

[35]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[36]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[37]  Christian Jutten,et al.  On underdetermined source separation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[38]  E. Moreau,et al.  New criteria for blind signal separation , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[39]  A. Zaidi Positive definite combination of symmetric matrices , 2005, IEEE Transactions on Signal Processing.

[40]  Lotfi Senhadji,et al.  Blind source separation for ambulatory sleep recording , 2006, IEEE Transactions on Information Technology in Biomedicine.

[41]  Nadège Thirion-Moreau,et al.  Algebraic Joint Zero-Diagonalization and Blind Sources Separation , 2008, IEEE Transactions on Signal Processing.

[42]  W. Givens Computation of Plain Unitary Rotations Transforming a General Matrix to Triangular Form , 1958 .

[43]  Visa Koivunen,et al.  Complex random vectors and ICA models: identifiability, uniqueness, and separability , 2005, IEEE Transactions on Information Theory.

[44]  Lang Tong,et al.  A finite-step global convergence algorithm for the parameter estimation of multichannel MA processes , 1992, IEEE Trans. Signal Process..

[45]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[46]  L. Lathauwer,et al.  An enhanced plane search scheme for complex-valued tensor decompositions , 2010 .

[47]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[48]  Gene H. Golub,et al.  Symmetric Tensors and Symmetric Tensor Rank , 2008, SIAM J. Matrix Anal. Appl..

[49]  Joos Vandewalle,et al.  Independent component analysis and (simultaneous) third-order tensor diagonalization , 2001, IEEE Trans. Signal Process..

[50]  William A. Gardner,et al.  The cumulant theory of cyclostationary time-series. II. Development and applications , 1994, IEEE Trans. Signal Process..

[51]  Jean-Christophe Pesquet,et al.  Cumulant-based independence measures for linear mixtures , 2001, IEEE Trans. Inf. Theory.