Coupled and Incomplete Tensors in Blind System Identification

Blind system identification (BSI) is an important problem in signal processing, arising in applications such as wireless telecommunications, biomedical signal processing, and seismic signal processing. In the past decades, tensors have proven to be useful tools for these blind identification and separation problems. Most often, tensor-based methods based on fourth-order statistics are used, which have been studied extensively for independent component analysis and its convolutive extensions. However, these tensor-based methods have two main drawbacks: the accuracy is often limited by the estimation error of the statistics and the computation of these fourth-order statistics is time intensive. In this paper, we propose to counter these drawbacks for BSI by coupling the fourth-order statistics with second-order statistics and by using incomplete tensors. By doing so, we can obtain more accurate results or obtain results in a much faster way.

[1]  A. Belouchrani,et al.  Jacobi-like algorithm for blind signal separation of convolutive mixtures , 2001 .

[2]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[3]  P. Tichavsky,et al.  Fast Approximate Joint Diagonalization Incorporating Weight Matrices , 2009, IEEE Transactions on Signal Processing.

[4]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part II: Definitions and Uniqueness , 2008, SIAM J. Matrix Anal. Appl..

[5]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[6]  Eric Moulines,et al.  Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Joao C. M. Mota,et al.  Parafac-based Blind Identification of Convolutive MIMO Linear Systems , 2009 .

[8]  Christopher J. Hillar,et al.  Most Tensor Problems Are NP-Hard , 2009, JACM.

[9]  John G. McWhirter,et al.  Blind signal separation of convolutive mixtures , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[10]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[11]  Lieven De Lathauwer,et al.  On the Uniqueness of the Canonical Polyadic Decomposition of Third-Order Tensors - Part I: Basic Results and Uniqueness of One Factor Matrix , 2013, SIAM J. Matrix Anal. Appl..

[12]  Zhi Ding,et al.  Blind MIMO system identification based on cumulant subspace decomposition , 2003, IEEE Trans. Signal Process..

[13]  R. Bro,et al.  PARAFAC and missing values , 2005 .

[14]  Pierre Comon,et al.  Blind paraunitary equalization , 2009, Signal Process..

[15]  J. Kruskal.  Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[16]  Lieven De Lathauwer,et al.  Coupled Canonical Polyadic Decompositions and (Coupled) Decompositions in Multilinear Rank-(Lr, n, Lr, n, 1) Terms - Part I: Uniqueness , 2015, SIAM J. Matrix Anal. Appl..

[17]  Athina P. Petropulu,et al.  PARAFAC-Based Blind Estimation Of Possibly Underdetermined Convolutive MIMO Systems , 2008, IEEE Transactions on Signal Processing.

[18]  L. Lathauwer,et al.  Canonical polyadic decomposition of third-order tensors: relaxed uniqueness conditions and algebraic algorithm , 2015, 1501.07251.

[19]  J. Cardoso,et al.  On optimal source separation based on second and fourth order cumulants , 1996, Proceedings of 8th Workshop on Statistical Signal and Array Processing.

[20]  Philippe Loubaton,et al.  Subspace method for blind separation of sources in convolutive mixture , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[21]  Athina P. Petropulu,et al.  Frequency domain blind MIMO system identification based on second and higher order statistics , 2001, IEEE Trans. Signal Process..

[22]  Nico Vervliet,et al.  Tensorlab 3.0 — Numerical optimization strategies for large-scale constrained and coupled matrix/tensor factorization , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[23]  L. Lathauwer,et al.  Dimensionality reduction in higher-order signal processing and rank-(R1,R2,…,RN) reduction in multilinear algebra , 2004 .

[24]  Hui Liu,et al.  Multiuser blind channel estimation and spatial channel pre-equalization , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[25]  S. Talwar,et al.  Blind estimation of multiple digital signals transmitted over FIR channels , 1995, IEEE Signal Processing Letters.

[26]  A.-J. van der Veen.  Joint diagonalization via subspace fitting techniques , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[27]  João Cesar M. Mota,et al.  Blind channel identification algorithms based on the Parafac decomposition of cumulant tensors: The single and multiuser cases , 2008, Signal Process..

[28]  Lieven De Lathauwer,et al.  Coupled Canonical Polyadic Decompositions and (Coupled) Decompositions in Multilinear Rank- (Lr, n, Lr, n, 1) Terms - Part II: Algorithms , 2015, SIAM J. Matrix Anal. Appl..

[29]  Karim Abed-Meraim,et al.  Blind separation of convolutive mixtures using joint block diagonalization , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[30]  B. Moor,et al.  Independent component analysis based on higher-order statistics only , 1996, Proceedings of 8th Workshop on Statistical Signal and Array Processing.

[31]  Lars Karlsson,et al.  Parallel algorithms for tensor completion in the CP format , 2016, Parallel Comput..

[32]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[33]  Nico Vervliet,et al.  Breaking the Curse of Dimensionality Using Decompositions of Incomplete Tensors: Tensor-based scientific computing in big data analysis , 2014, IEEE Signal Processing Magazine.

[34]  Lieven De Lathauwer,et al.  Second-order tensor-based convolutive ICA: Deconvolution versus tensorization , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Lieven De Lathauwer,et al.  On Jacobi-type methods for blind equalization of paraunitary channels , 2012, Signal Process..

[36]  Lucas C. Parra,et al.  A SURVEY OF CONVOLUTIVE BLIND SOURCE SEPARATION METHODS , 2007 .

[37]  Christopher J James,et al.  Independent component analysis for biomedical signals , 2005, Physiological measurement.

[38]  Lieven De Lathauwer,et al.  Structured Data Fusion , 2015, IEEE Journal of Selected Topics in Signal Processing.

[39]  Zbynek Koldovský,et al.  Weight Adjusted Tensor Method for Blind Separation of Underdetermined Mixtures of Nonstationary Sources , 2011, IEEE Transactions on Signal Processing.

[40]  Jean-Francois Cardoso,et al.  Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[41]  L. Lathauwer,et al.  Signal Processing based on Multilinear Algebra , 1997 .

[42]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[43]  Lieven De Lathauwer,et al.  Tensor Decompositions With Several Block-Hankel Factors and Application in Blind System Identification , 2017, IEEE Transactions on Signal Processing.

[44]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[45]  Rasmus Bro,et al.  Understanding data fusion within the framework of coupled matrix and tensor factorizations , 2013 .

[46]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[47]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[48]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[49]  N. Sidiropoulos,et al.  On the uniqueness of multilinear decomposition of N‐way arrays , 2000 .

[50]  Arogyaswami Paulraj,et al.  A subspace approach to blind space-time signal processing for wireless communication systems , 1997, IEEE Trans. Signal Process..

[51]  Lieven De Lathauwer,et al.  Fiber Sampling Approach to Canonical Polyadic Decomposition and Application to Tensor Completion , 2019, SIAM J. Matrix Anal. Appl..

[52]  J. Cardoso.  On the Performance of Orthogonal Source Separation Algorithms , 1994 .

[53]  Arogyaswami Paulraj,et al.  An analytical constant modulus algorithm , 1996, IEEE Trans. Signal Process..

[54]  Karim Abed-Meraim,et al.  Blind system identification , 1997, Proc. IEEE.

[55]  A. Gorokhov,et al.  Subspace-based techniques for blind separation of convolutive mixtures with temporally correlated sources , 1997 .

[56]  Johan Håstad,et al.  Tensor Rank is NP-Complete , 1989, ICALP.

[57]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[58]  Lieven De Lathauwer,et al.  Canonical Polyadic Decomposition of Third-Order Tensors: Reduction to Generalized Eigenvalue Decomposition , 2013, SIAM J. Matrix Anal. Appl..

[59]  Joos Vandewalle,et al.  A prewhitening-induced bound on the identification error in independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[60]  Lieven De Lathauwer,et al.  A Tensor-Based Method for Large-Scale Blind Source Separation Using Segmentation , 2017, IEEE Transactions on Signal Processing.