A closed-form solution for Parallel Factor (PARAFAC) Analysis

Parallel factor analysis (PARAFAC) is a branch of multi-way signal processing that has received increased attention recently. This is due to the large class of applications as well as the milestone identifiability results demonstrating the superiority to matrix (two-way) analysis approaches. A significant amount of research was dedicated to iterative methods to estimate the factors from noisy data. In many situations these require many iterations and are not guaranteed to converge to the global optimum. Therefore, suboptimal closed-form solutions were proposed as initializations. In this contribution we derive a closed-form solution to completely replace the iterative approach by transforming PARAFAC into several joint diagonalization problems. Thereby, we obtain several estimates for each of the factors and present a new "best matching" scheme to select the best estimate for each factor. In contrast to the techniques known from the literature, our closed-form solution can efficiently exploit symmetric as well as Hermitian symmetric models and solve the underdetermined case, if there are at least two modes that are non-degenerate and full rank. This closed-form solution achieves approximately the same performance as previously proposed iterative solutions and even outperforms them in critical scenarios.

[1]  Xiqi Gao,et al.  Simultaneous Diagonalization With Similarity Transformation for Non-Defective Matrices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[2]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[3]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[4]  L. De Lathauwer,et al.  Parallel factor analysis by means of simultaneous matrix decompositions , 2005 .

[5]  Nikos D. Sidiropoulos,et al.  Blind PARAFAC receivers for DS-CDMA systems , 2000, IEEE Trans. Signal Process..

[6]  Nikos D. Sidiropoulos,et al.  Blind spatial signature estimation via time-varying user power loading and parallel factor analysis , 2005, IEEE Transactions on Signal Processing.

[7]  Lieven De Lathauwer,et al.  A Link between the Canonical Decomposition in Multilinear Algebra and Simultaneous Matrix Diagonalization , 2006, SIAM J. Matrix Anal. Appl..

[8]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[9]  G. Giannakis,et al.  A FAST LEAST SQUARES ALGORITHM FOR SEPARATING TRILINEAR MIXTURES , 2004 .

[10]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[11]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[12]  R. Cattell “Parallel proportional profiles” and other principles for determining the choice of factors by rotation , 1944 .

[13]  B. Kowalski,et al.  Tensorial resolution: A direct trilinear decomposition , 1990 .

[14]  P. Comon,et al.  Link Between the Joint Diagonalisation of Symmetrical Cubes and PARAFAC: An Application to Secondary Surveillance Radar , 2006, Fourth IEEE Workshop on Sensor Array and Multichannel Processing, 2006..