Second-order tensor-based convolutive ICA: Deconvolution versus tensorization

Independent component analysis (ICA) research has been driven by various applications in biomedical signal separation, telecommunications, speech analysis, and more. One particular class of algorithms for instantaneous ICA uses tensors, which have useful properties. In an attempt to port these properties to convolutive methods, we zoom in on an existing method that uses second-order statistics. By pointing out links in the literature, we show that this method is in fact a typical tensor-based method, even though this was not recognized by the authors at the time. The existing method mentioned above can be interpreted as a tensorization step followed by a deconvolution step. However, as sometimes done in literature, one may consider using the opposite approach; starting with a deconvolution step and then tensorizing the remaining instantaneous mixture. Because subspace-based deconvolution can be slow, we propose a fast variant which uses only partial information. We then use this variant to compare the approach starting with tensorization and the one starting with deconvolution.

[1]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[2]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part III: Alternating Least Squares Algorithms , 2008, SIAM J. Matrix Anal. Appl..

[3]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[4]  N. Tandon,et al.  A review of vibration and acoustic measurement methods for the detection of defects in rolling element bearings , 1999 .

[5]  João Cesar M. Mota,et al.  Blind Multipath MIMO Channel Parameter Estimation Using the Parafac Decomposition , 2009, 2009 IEEE International Conference on Communications.

[6]  Lieven De Lathauwer,et al.  On the Uniqueness of the Canonical Polyadic Decomposition of Third-Order Tensors - Part I: Basic Results and Uniqueness of One Factor Matrix , 2013, SIAM J. Matrix Anal. Appl..

[7]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part II: Definitions and Uniqueness , 2008, SIAM J. Matrix Anal. Appl..

[8]  Ali Mansour,et al.  Blind separation of sources : Methods, assumptions and applications , 2000 .

[9]  A. Belouchrani,et al.  Jacobi-like algorithm for blind signal separation of convolutive mixtures , 2001 .

[10]  Lieven De Lathauwer,et al.  Tensor Decompositions With Several Block-Hankel Factors and Application in Blind System Identification , 2017, IEEE Transactions on Signal Processing.

[11]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[12]  Lieven De Lathauwer,et al.  Canonical Polyadic Decomposition of Third-Order Tensors: Reduction to Generalized Eigenvalue Decomposition , 2013, SIAM J. Matrix Anal. Appl..

[13]  Lieven De Lathauwer,et al.  Optimization-Based Algorithms for Tensor Decompositions: Canonical Polyadic Decomposition, Decomposition in Rank-(Lr, Lr, 1) Terms, and a New Generalization , 2013, SIAM J. Optim..

[14]  Karim Abed-Meraim,et al.  Algorithms for joint block diagonalization , 2004, 2004 12th European Signal Processing Conference.

[15]  Arogyaswami Paulraj,et al.  A subspace approach to blind space-time signal processing for wireless communication systems , 1997, IEEE Trans. Signal Process..

[16]  Hui Liu,et al.  Multiuser blind channel estimation and spatial channel pre-equalization , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[17]  S. Talwar,et al.  Blind estimation of multiple digital signals transmitted over FIR channels , 1995, IEEE Signal Processing Letters.

[18]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[19]  Philippe Loubaton,et al.  Subspace method for blind separation of sources in convolutive mixture , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[20]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[21]  Guillaume Gelle,et al.  BLIND SOURCE SEPARATION: A TOOL FOR ROTATING MACHINE MONITORING BY VIBRATIONS ANALYSIS? , 2001 .

[22]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[23]  Hui Liu,et al.  Smart antennas in wireless systems: uplink multiuser blind channel and sequence detection , 1997, IEEE Trans. Commun..

[24]  Hui Liu,et al.  Closed-form blind symbol estimation in digital communications , 1995, IEEE Trans. Signal Process..

[25]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[26]  Bart De Moor,et al.  The singular value decomposition and long and short spaces of noisy matrices , 1993, IEEE Trans. Signal Process..

[27]  Karim Abed-Meraim,et al.  Blind separation of convolutive mixtures using joint block diagonalization , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[28]  Karim Abed-Meraim,et al.  Blind system identification , 1997, Proc. IEEE.

[29]  A. Gorokhov,et al.  Subspace-based techniques for blind separation of convolutive mixtures with temporally correlated sources , 1997 .