An adaptive gradient method for computing generalized tensor eigenpairs

High order tensor arises more and more often in signal processing, data analysis, higher-order statistics, as well as imaging sciences. In this paper, an adaptive gradient (AG) method is presented for generalized tensor eigenpairs. Global convergence and linear convergence rate are established under some suitable conditions. Numerical results are reported to illustrate the efficiency of the proposed method. Comparing with the GEAP method, an adaptive shifted power method proposed by Kolda and Mayo (SIAM J Matrix Anal Appl 35:1563–1581, 2014) the AG method is much faster and could reach the largest eigenpair with a higher probability.

[1]  Lek-Heng Lim,et al.  Singular values and eigenvalues of tensors: a variational approach , 2005, 1st IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005..

[2]  Li Wang,et al.  Semidefinite Relaxations for Best Rank-1 Tensor Approximations , 2013, SIAM J. Matrix Anal. Appl..

[3]  Jieping Ye,et al.  Hypergraph spectral learning for multi-label classification , 2008, KDD.

[4]  Fei Wang,et al.  Z-eigenvalue methods for a global polynomial optimization problem , 2009, Math. Program..

[5]  Kung-Ching Chang,et al.  On eigenvalue problems of real symmetric tensors , 2009 .

[6]  Yu-Hong Dai,et al.  A sequential subspace projection method for extreme Z-eigenvalues of supersymmetric tensors , 2015, Numer. Linear Algebra Appl..

[7]  Kung-Ching Chang,et al.  Perron-Frobenius theorem for nonnegative tensors , 2008 .

[8]  Liqun Qi,et al.  D-eigenvalues of diffusion kurtosis tensors , 2008 .

[9]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[10]  Liqun Qi,et al.  Eigenvalues of a real supersymmetric tensor , 2005, J. Symb. Comput..

[11]  Yisheng Song,et al.  Properties of Solution Set of Tensor Complementarity Problem , 2015, J. Optim. Theory Appl..

[12]  L. Qi,et al.  Principal invariants and inherent parameters of diffusion kurtosis tensors , 2009 .

[13]  L. De Lathauwer,et al.  Exponential data fitting using multilinear algebra: the decimative case , 2009 .

[14]  Fan Zhang,et al.  Gradient skewness tensors and local illumination detection for images , 2013, J. Comput. Appl. Math..

[15]  L. Qi.  Eigenvalues and invariants of tensors , 2007 .

[16]  Zheng-Hai Huang,et al.  Finding the extreme Z‐eigenvalues of tensors via a sequential semidefinite programming method , 2013, Numer. Linear Algebra Appl..

[17]  Qin Ni,et al.  A quadratically convergent algorithm for finding the largest eigenvalue of a nonnegative homogeneous polynomial map , 2014, Journal of Global Optimization.

[18]  Phillip A. Regalia,et al.  On the Best Rank-1 Approximation of Higher-Order Supersymmetric Tensors , 2001, SIAM J. Matrix Anal. Appl..

[19]  Yimin Wei,et al.  Generalized Tensor Eigenvalue Problems , 2015, SIAM J. Matrix Anal. Appl..

[20]  Guoyin Li,et al.  Finding the Maximum Eigenvalue of Essentially Nonnegative Symmetric Tensors via Sum of Squares Programming , 2013, J. Optim. Theory Appl..

[21]  Christopher J. Hillar,et al.  Most Tensor Problems Are NP-Hard , 2009, JACM.

[22]  Qingzhi Yang,et al.  Further Results for Perron-Frobenius Theorem for Nonnegative Tensors , 2010, SIAM J. Matrix Anal. Appl..

[23]  Jinshan Xie,et al.  On the Z‐eigenvalues of the signless Laplacian tensor for an even uniform hypergraph , 2013, Numer. Linear Algebra Appl..

[24]  Tan Zhang,et al.  A survey on the spectral theory of nonnegative tensors , 2013, Numer. Linear Algebra Appl..

[25]  Liqun Qi,et al.  Linear convergence of an algorithm for computing the largest eigenvalue of a nonnegative tensor , 2012, Numer. Linear Algebra Appl..

[26]  Tamara G. Kolda,et al.  An Adaptive Shifted Power Method for Computing Generalized Tensor Eigenpairs , 2014, SIAM J. Matrix Anal. Appl..

[27]  Jiawang Nie,et al.  All Real Eigenvalues of Symmetric Tensors , 2014, SIAM J. Matrix Anal. Appl..

[28]  Yi,et al.  LINEAR CONVERGENCE OF THE LZI ALGORITHM FOR WEAKLY POSITIVE TENSORS , 2012 .

[29]  Luke Bloy,et al.  On Computing the Underlying Fiber Directions from the Diffusion Orientation Distribution Function , 2008, MICCAI.

[30]  Yu-Hong Dai,et al.  A FEASIBLE TRUST-REGION METHOD FOR CALCULATING EXTREME Z-EIGENVALUES OF SYMMETRIC TENSORS , 2015 .

[31]  Hans-Peter Seidel,et al.  Estimating Crossing Fibers: A Tensor Decomposition Approach , 2008, IEEE Transactions on Visualization and Computer Graphics.

[32]  Tan Zhang,et al.  Primitivity, the Convergence of the NQZ Method, and the Largest Eigenvalue for Nonnegative Tensors , 2011, SIAM Journal on Matrix Analysis and Applications.

[33]  Michael K. Ng,et al.  Finding the Largest Eigenvalue of a Nonnegative Tensor , 2009, SIAM J. Matrix Anal. Appl..

[34]  Kung-Ching Chang,et al.  On the uniqueness and non-uniqueness of the positive Z-eigenvector for transition probability tensors , 2013 .

[35]  Lixing Han.  An unconstrained optimization approach for finding real eigenvalues of even order symmetric tensors , 2012, 1203.5150.

[36]  Yi Xu,et al.  Nonnegative Diffusion Orientation Distribution Function , 2012, Journal of Mathematical Imaging and Vision.

[37]  Qun Wang,et al.  Computing Extreme Eigenvalues of Large Scale Hankel Tensors , 2016, J. Sci. Comput..

[38]  Liqun Qi,et al.  Properties of Some Classes of Structured Tensors , 2014, J. Optim. Theory Appl..

[39]  Qingzhi Yang,et al.  Further Results for Perron-Frobenius Theorem for Nonnegative Tensors II , 2011, SIAM J. Matrix Anal. Appl..

[40]  Tamara G. Kolda,et al.  Shifted Power Method for Computing Tensor Eigenpairs , 2010, SIAM J. Matrix Anal. Appl..

[41]  Lixing Yang,et al.  Quadratic third-order tensor optimization problem with quadratic constraints , 2014 .

[42]  L. Qi,et al.  Higher Order Positive Semidefinite Diffusion Tensor Imaging , 2010, SIAM J. Imaging Sci..

[43]  Fei Wang,et al.  An Eigenvalue Method for Testing Positive Definiteness of a Multivariate Form , 2008, IEEE Transactions on Automatic Control.

[44]  Guoyin Li,et al.  The Z‐eigenvalues of a symmetric tensor and its application to spectral hypergraph theory , 2013, Numer. Linear Algebra Appl..

[45]  Wenyu Sun,et al.  Positive Semidefinite Generalized Diffusion Tensor Imaging via Quadratic Semidefinite Programming , 2013, SIAM J. Imaging Sci..

[46]  Gözde B. Ünal,et al.  A Higher-Order Tensor Vessel Tractography for Segmentation of Vascular Structures , 2015, IEEE Transactions on Medical Imaging.

[47]  Liqun Qi,et al.  Semismoothness of the maximum eigenvalue function of a symmetric tensor and its application , 2013 .

[48]  Liqun Qi,et al.  Geometric Measure of Entanglement and U-Eigenvalues of Tensors , 2014, SIAM J. Matrix Anal. Appl..

[49]  Liqun Qi,et al.  Tensor Complementarity Problem and Semi-positive Tensors , 2015, J. Optim. Theory Appl..

[50]  M. Ng,et al.  On the limiting probability distribution of a transition probability tensor , 2014 .

[51]  Liqun Qi,et al.  Computing Eigenvalues of Large Scale Hankel Tensors , 2015 .

[52]  Sabine Van Huffel,et al.  Exponential data fitting using multilinear algebra: the single‐channel and multi‐channel case , 2005, Numer. Linear Algebra Appl..