Efficient Computation of the PARAFAC2 Decomposition via Generalized Tensor Contractions

The PARAFAC2 decomposition is a generalization of the PARAFAC/CP (Canonical Polyadic) tensor decomposition. This tensor decomposition represents a set of coupled matrix decompositions with one mode in common, i.e., one of the components varies along the set of matrices (tensor slices), whereas the second component stays constant. It has many applications including the analysis of chromatographic data, data clustering, and biomedical signal processing. Typically, the PARAFAC2 decomposition is described using a slice-wise notation, where each of the slices corresponds to one of the matrix decompositions. In this paper, we first present a generalization of the slice-wise multiplication based on the tensor contraction operator, where the generalized contraction operator represents an inner product between two tensors of compatible dimensions. Next, we express the PARAFAC2 decomposition in terms of this new tensor model resulting in a constrained CP model. Moreover, we show that this new description opens an efficient single loop way to compute the PARAFAC2 decomposition based on the generalized tensor contraction.

[1]  R. Harshman The differences between analysis of covariance and correlation , 2001 .

[2]  R. Bro,et al.  PARAFAC2—Part I. A direct fitting algorithm for the PARAFAC2 model , 1999 .

[3]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[4]  André Lima Férrer de Almeida,et al.  Uniqueness Conditions for Constrained Three-Way Factor Decompositions with Linearly Dependent Loadings , 2009, SIAM J. Matrix Anal. Appl..

[5]  Florian Roemer,et al.  Multi-dimensional PARAFAC2 component analysis of multi-channel EEG data including temporal tracking , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  W. Marsden I and J , 2012 .

[7]  Florian Roemer,et al.  A semi-algebraic framework for approximate CP decompositions via simultaneous matrix diagonalizations (SECSI) , 2013, Signal Process..

[8]  H. Kiers An alternating least squares algorithms for PARAFAC2 and three-way DEDICOM , 1993 .

[9]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part II: Definitions and Uniqueness , 2008, SIAM J. Matrix Anal. Appl..

[10]  Florian Roemer,et al.  A semi-algebraic framework for approximate CP decompositions via joint matrix diagonalization and generalized unfoldings , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[11]  R. Harshman,et al.  Uniqueness proof for a family of models sharing features of Tucker's three-mode factor analysis and PARAFAC/candecomp , 1996 .

[12]  André Lima Férrer de Almeida,et al.  Overview of constrained PARAFAC models , 2014, EURASIP Journal on Advances in Signal Processing.

[13]  Laurent Albera,et al.  Semi-algebraic canonical decomposition of multi-way arrays and Joint Eigenvalue Decomposition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Florian Roemer,et al.  Temporally resolved multi-way component analysis of dynamic sources in event-related EEG data using parafac2 , 2010, 2010 18th European Signal Processing Conference.

[15]  Martin Haardt,et al.  A new coupled PARAFAC2 decomposition for joint processing of somatosensory evoked magnetic fields and somatosensory evoked electrical potentials , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[16]  Andrzej Cichocki,et al.  Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions , 2014, ArXiv.

[17]  Rasmus Broa,et al.  Modeling multiway data with linearly dependent loadings y , 2009 .

[18]  André Lima Férrer de Almeida,et al.  A Constrained Factor Decomposition With Application to MIMO Antenna Systems , 2008, IEEE Transactions on Signal Processing.

[19]  Martin Haardt,et al.  Generalized tensor contraction with application to khatri-rao coded MIMO OFDM systems , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[20]  Martin Haardt,et al.  Generalized Tensor Contractions for an Improved Receiver Design in MIMO-OFDM Systems , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).