Hierarchical tucker tensor regression: Application to brain imaging data analysis

We present a novel generalized linear tensor regression model, which takes tensor-variate inputs as covariates and finds low-rank (almost) best approximation of regression coefficient arrays using hierarchical Tucker decomposition. With limited sample size, our model is highly compact and extremely efficient as it requires only O(dr3 + dpr) parameters for order d tensors of mode size p and rank r, which avoids the exponential growth in d, in contrast to O(rd + dpr) parameters of Tucker regression modeling. Our model also maintains the flexibility like classical Tucker regression by allowing distinct ranks on different modes according to a dimension tree structure. We evaluate our new model on both synthetic data and real-life MRI images to show its effectiveness.

[1]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[2]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[3]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[4]  P. McCullagh,et al.  An outline of generalized linear models , 1983 .

[5]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[6]  Hans-Hermann Bock,et al.  Information Systems and Data Analysis , 1994 .

[7]  Kenneth Lange,et al.  Numerical analysis for statisticians , 1999 .

[8]  Sukumar Bandopadhyay,et al.  An Objective Analysis of Support Vector Machine Based Classification for Remote Sensing , 2008 .

[9]  W. Hackbusch,et al.  A New Scheme for the Tensor Representation , 2009 .

[10]  Lars Grasedyck,et al.  Hierarchical Singular Value Decomposition of Tensors , 2010, SIAM J. Matrix Anal. Appl..

[11]  Weiwei Guo,et al.  Tensor Learning for Regression , 2012, IEEE Transactions on Image Processing.

[12]  Naotaka Fujii,et al.  Higher Order Partial Least Squares (HOPLS): A Generalized Multilinear Regression Method , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Andrey Eliseyev,et al.  Recursive N-Way Partial Least Squares for Brain-Computer Interface , 2013, PloS one.

[14]  Hongtu Zhu,et al.  Tensor Regression with Applications in Neuroimaging Data Analysis , 2012, Journal of the American Statistical Association.

[15]  Liqing Zhang,et al.  Kernelization of Tensor-Based Models for Multiway Data Analysis: Processing of Multidimensional Structured Data , 2013, IEEE Signal Processing Magazine.

[16]  Liqing Zhang,et al.  Tensor-variate Gaussian processes regression and its application to video surveillance , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Xiaoshan Li,et al.  Tucker Tensor Regression and Neuroimaging Analysis , 2018, Statistics in Biosciences.