On JEVD of semi-definite positive matrices and CPD of nonnegative tensors

In this paper, we mainly address the problem of Joint EigenValue Decomposition (JEVD) subject to nonnegative constraints on the eigenvalues of the matrices to be diagonalized. An efficient method based on the Alternating Direction Method of Multipliers (ADMM) is designed. ADMM provides an elegant approach for handling nonnegativity constraints, while taking advantage of the structure of the objective function. Numerical tests on simulated matrices show the interest of the proposed method for low Signal-to-Noise Ratio (SNR) values when the similarity transformation matrix is ill-conditioned. The ADMM was recently used for the Canonical Polyadic Decomposition (CPD) of nonnegative tensors leading to the ADMoM algorithm. We show through computer results that DIAG+, a semi-algebraic CPD method using our ADMM-based JEVD+ algorithm, will give a better estimation of factors than ADMoM in the presence of swamps. DIAG+ also appears to be less time-consuming than ADMoM when low-rank tensors of high dimensions are considered.

[1]  Laurent Albera,et al.  Joint Eigenvalue Decomposition of Non-Defective Matrices Based on the LU Factorization With Application to ICA , 2015, IEEE Transactions on Signal Processing.

[2]  Sepideh Hajipour Sardouie,et al.  Canonical Polyadic decomposition of complex-valued multi-way arrays based on Simultaneous Schur Decomposition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Pierre Comon,et al.  Nonnegative approximations of nonnegative tensors , 2009, ArXiv.

[4]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[5]  Pierre Comon,et al.  Tensors : A brief introduction , 2014, IEEE Signal Processing Magazine.

[6]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[7]  X. Luciani,et al.  Canonical Polyadic Decomposition based on joint eigenvalue decomposition , 2014 .

[8]  Nikos D. Sidiropoulos,et al.  Parallel Algorithms for Constrained Tensor Factorization via Alternating Direction Method of Multipliers , 2014, IEEE Transactions on Signal Processing.

[9]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[10]  Florian Roemer,et al.  A semi-algebraic framework for approximate CP decompositions via simultaneous matrix diagonalizations (SECSI) , 2013, Signal Process..

[11]  Xiqi Gao,et al.  Simultaneous Diagonalization With Similarity Transformation for Non-Defective Matrices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  Joos Vandewalle,et al.  Computation of the Canonical Decomposition by Means of a Simultaneous Generalized Schur Decomposition , 2005, SIAM J. Matrix Anal. Appl..

[13]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[14]  Andrzej Cichocki,et al.  CANDECOMP/PARAFAC Decomposition of High-Order Tensors Through Tensor Reshaping , 2012, IEEE Transactions on Signal Processing.

[15]  Rémi Gribonval,et al.  Brain-Source Imaging: From sparse to tensor models , 2015, IEEE Signal Processing Magazine.

[16]  Karim Abed-Meraim,et al.  A new Jacobi-like method for joint diagonalization of arbitrary non-defective matrices , 2009, Appl. Math. Comput..