Generalized generating function with tucker decomposition and alternating least squares for underdetermined blind identification

Generating function (GF) has been used in blind identification for real-valued signals. In this paper, the definition of GF is first generalized for complex-valued random variables in order to exploit the statistical information carried on complex signals in a more effective way. Then an algebraic structure is proposed to identify the mixing matrix from underdetermined mixtures using the generalized generating function (GGF). Two methods, namely GGF-ALS and GGF-TALS, are developed for this purpose. In the GGF-ALS method, the mixing matrix is estimated by the decomposition of the tensor constructed from the Hessian matrices of the GGF of the observations, using an alternating least squares (ALS) algorithm. The GGF-TALS method is an improved version of the GGF-ALS algorithm based on Tucker decomposition. More specifically, the original tensor, as formed in GGF-ALS, is first converted to a lower-rank core tensor using the Tucker decomposition, where the factors are obtained by the left singular-value decomposition of the original tensor’s mode-3 matrix. Then the mixing matrix is estimated by decomposing the core tensor with the ALS algorithm. Simulation results show that (a) the proposed GGF-ALS and GGF-TALS approaches have almost the same performance in terms of the relative errors, whereas the GGF-TALS has much lower computational complexity, and (b) the proposed GGF algorithms have superior performance to the latest GF-based baseline approaches.

[1]  Bernie Mulgrew,et al.  IEEE Workshop on Statistical Signal Processing , 2005 .

[2]  Andrzej Cichocki,et al.  Fast and unique Tucker decompositions via multiway blind source separation , 2012 .

[3]  P. Comon,et al.  Blind Identification of Overcomplete MixturEs of sources (BIOME) , 2004 .

[4]  Wei Dai,et al.  Simultaneous Codeword Optimization (SimCO) for Dictionary Update and Learning , 2011, IEEE Transactions on Signal Processing.

[5]  Lieven De Lathauwer,et al.  Blind Identification of Underdetermined Mixtures by Simultaneous Matrix Diagonalization , 2008, IEEE Transactions on Signal Processing.

[6]  Lieven De Lathauwer,et al.  Fourth-Order Cumulant-Based Blind Identification of Underdetermined Mixtures , 2007, IEEE Transactions on Signal Processing.

[7]  James P. Reilly,et al.  A frequency domain method for blind source separation of convolutive audio mixtures , 2005, IEEE Transactions on Speech and Audio Processing.

[8]  Abdeldjalil Aïssa-El-Bey,et al.  Underdetermined Blind Separation of Nondisjoint Sources in the Time-Frequency Domain , 2007, IEEE Transactions on Signal Processing.

[9]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[10]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[11]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[12]  Laurent Albera,et al.  Fourth-order blind identification of underdetermined mixtures of sources (FOBIUM) , 2005, IEEE Transactions on Signal Processing.

[13]  Laurent Albera,et al.  Blind identification of underdetermined mixtures based on the hexacovariance and higher-order cyclostationarity , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[14]  Liqun Qi,et al.  New ALS Methods With Extrapolating Search Directions and Optimal Step Size for Complex-Valued Tensor Decompositions , 2011, IEEE Transactions on Signal Processing.

[15]  Zbynek Koldovský,et al.  Weight Adjusted Tensor Method for Blind Separation of Underdetermined Mixtures of Nonstationary Sources , 2011, IEEE Transactions on Signal Processing.

[16]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[17]  Laurent Albera,et al.  Blind Underdetermined Mixture Identification by Joint Canonical Decomposition of HO Cumulants , 2010, IEEE Transactions on Signal Processing.

[18]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[19]  Arie Yeredor,et al.  Blind source separation via the second characteristic function , 2000, Signal Process..

[20]  Erik G. Larsson,et al.  Lecture Notes: Floating-Point Numbers , 2010 .

[21]  Arie Yeredor,et al.  Blind MIMO identification using the second characteristic function , 2004, IEEE Transactions on Signal Processing.

[22]  Laurent Albera,et al.  SIXTH ORDER BLIND IDENTIFICATION OF UNDERDETERMINED MIXTURES (BIRTH) OF SOURCES , 2003 .

[23]  Lieven De Lathauwer,et al.  An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA , 2008, Signal Process..

[24]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2006, Signal Process..

[25]  Athina P. Petropulu,et al.  Frequency domain blind MIMO system identification based on second and higher order statistics , 2001, IEEE Trans. Signal Process..

[26]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[27]  Pierre Comon,et al.  Blind Identification of Underdetermined Mixtures Based on the Characteristic Function: The Complex Case , 2011, IEEE Transactions on Signal Processing.

[28]  Simon J. Godsill,et al.  A Bayesian Approach for Blind Separation of Sparse Sources , 2006, IEEE Transactions on Audio, Speech, and Language Processing.