A survey of multilinear subspace learning for tensor data

Increasingly large amount of multidimensional data are being generated on a daily basis in many applications. This leads to a strong demand for learning algorithms to extract useful information from these massive data. This paper surveys the field of multilinear subspace learning (MSL) for dimensionality reduction of multidimensional data directly from their tensorial representations. It discusses the central issues of MSL, including establishing the foundations of the field via multilinear projections, formulating a unifying MSL framework for systematic treatment of the problem, examining the algorithmic aspects of typical MSL solutions, and categorizing both unsupervised and supervised MSL algorithms into taxonomies. Lastly, the paper summarizes a wide range of MSL applications and concludes with perspectives on future research directions.

[1]  Hanqing Lu,et al.  Face recognition using kernel scatter-difference-based discriminant analysis , 2006, IEEE Trans. Neural Networks.

[2]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[3]  Jimeng Sun,et al.  Beyond streams and graphs: dynamic tensor analysis , 2006, KDD '06.

[4]  T. Moon,et al.  Mathematical Methods and Algorithms for Signal Processing , 1999 .

[5]  Stefanos Zafeiriou,et al.  Algorithms for Nonnegative Tensor Factorization , 2009, Tensors in Image Processing and Computer Vision.

[6]  Salah Bourennane,et al.  Dimensionality Reduction Based on Tensor Modeling for Classification Methods , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[7]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[8]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[9]  Narendra Ahuja,et al.  A Tensor Approximation Approach to Dimensionality Reduction , 2008, International Journal of Computer Vision.

[10]  Stephen Lin,et al.  Rank-one Projections with Adaptive Margins for Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Andrew Zisserman,et al.  Advances in Neural Information Processing Systems (NIPS) , 2007 .

[12]  K. Plataniotis,et al.  8 A Review on Face and Gait Recognition: System, Data and Algorithms , 2008 .

[13]  James L. Crowley,et al.  "How old are you?" : Age Estimation with Tensors of Binary Gaussian Receptive Maps , 2010, BMVC.

[14]  Xuelong Li,et al.  Tensors in Image Processing and Computer Vision , 2009, Advances in Pattern Recognition.

[15]  Haiping Lu,et al.  Uncorrelated Multilinear Discriminant Analysis with Regularization for Gait Recognition , 2007, 2007 Biometrics Symposium.

[16]  Rama Chellappa,et al.  Recognition of Humans and Their Activities Using Video , 2005, Recognition of Humans and Their Activities Using Video.

[17]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[18]  Gregory Shakhnarovich,et al.  Face Recognition in Subspaces , 2011, Handbook of Face Recognition.

[19]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[20]  Deng Cai,et al.  Tensor Subspace Analysis , 2005, NIPS.

[21]  Haiping Lu,et al.  Boosting LDA with Regularization on MPCA Features for Gait Recognition , 2007, 2007 Biometrics Symposium.

[22]  Rasmus Bro,et al.  MULTI-WAY ANALYSIS IN THE FOOD INDUSTRY Models, Algorithms & Applications , 1998 .

[23]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[25]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[26]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[27]  Pierre Comon,et al.  Decomposition of quantics in sums of powers of linear forms , 1996, Signal Process..

[28]  Jie Li,et al.  A Prior Neurophysiologic Knowledge Free Tensor-Based Scheme for Single Trial EEG Classification , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Yong Wang,et al.  Tensor Discriminant Analysis for View-based Object Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[31]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[32]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[33]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  L. Qi,et al.  Numerical multilinear algebra and its applications , 2007 .

[35]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[36]  Jing-Yu Yang,et al.  A theorem on the uncorrelated optimal discriminant vectors , 2001, Pattern Recognit..

[37]  Tae-Kyun Kim,et al.  Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2004, Machine Learning.

[39]  Xinbo Gao,et al.  Incremental tensor biased discriminant analysis: A new color-based visual tracking method , 2010, Neurocomputing.

[40]  Michael Grüninger,et al.  Introduction , 2002, CACM.

[41]  Tamara G. Kolda,et al.  Categories and Subject Descriptors: G.4 [Mathematics of Computing]: Mathematical Software— , 2022 .

[42]  Salah Bourennane,et al.  Survey on tensor signal algebraic filtering , 2007, Signal Process..

[43]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[44]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[45]  Xuelong Li,et al.  Shot-based video retrieval with optical flow tensor and HMMs , 2009, Pattern Recognit. Lett..

[46]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[47]  B. Thompson Canonical Correlation Analysis: Uses and Interpretation , 1984 .

[48]  Constantine Kotropoulos,et al.  Non-Negative Multilinear Principal Component Analysis of Auditory Temporal Modulations for Music Genre Classification , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[49]  Xuelong Li,et al.  Elapsed Time in Human Gait Recognition: A New Approach , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[50]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[51]  H. Neudecker,et al.  An approach ton-mode components analysis , 1986 .

[52]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[54]  Petros Drineas,et al.  Workshop on Algorithms for Modern Massive Datasets , 2006 .

[55]  Ling Guan,et al.  Quantifying and recognizing human movement patterns from monocular video images-part II: applications to biometrics , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Khashayar Khorasani,et al.  A neural-network appearance-based 3-D object recognition using independent component analysis , 2003, IEEE Trans. Neural Networks.

[57]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[58]  James L. Crowley,et al.  "How old are you?" A possible answer using Tensors of Binary Gaussian Receptive Maps , 2010, British Machine Vision Conference.

[59]  W. Greub Linear Algebra , 1981 .

[60]  Christopher M. Bishop,et al.  Bayesian PCA , 1998, NIPS.

[61]  Demetri Terzopoulos,et al.  Multilinear image analysis for facial recognition , 2002, Object recognition supported by user interaction for service robots.

[62]  Tamara G. Kolda,et al.  Orthogonal Tensor Decompositions , 2000, SIAM J. Matrix Anal. Appl..

[63]  Kohei Inoue,et al.  Robust multilinear principal component analysis , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[64]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[65]  L. Lathauwer,et al.  On the Best Rank-1 and Rank-( , 2004 .

[66]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[67]  Xuelong Li,et al.  Tensor Rank One Discriminant Analysis - A convergent method for discriminative multilinear subspace selection , 2008, Neurocomputing.

[68]  Xuelong Li,et al.  Discriminative optical flow tensor for video semantic analysis , 2009, Comput. Vis. Image Underst..

[69]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[70]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[71]  Stephen Lin,et al.  Reconstruction and Recognition of Tensor-Based Objects With Concurrent Subspaces Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[72]  Konstantinos N. Plataniotis,et al.  Biometrics: Theory, Methods, and Applications , 2009 .

[73]  J. Kruskal,et al.  Candelinc: A general approach to multidimensional analysis of many-way arrays with linear constraints on parameters , 1980 .

[74]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[75]  Konstantinos N. Plataniotis,et al.  Face recognition using kernel direct discriminant analysis algorithms , 2003, IEEE Trans. Neural Networks.

[76]  Stan Z. Li,et al.  Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels , 2005, AMFG.

[77]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[78]  Jimeng Sun,et al.  Two heads better than one: pattern discovery in time-evolving multi-aspect data , 2008, Data Mining and Knowledge Discovery.

[79]  Dit-Yan Yeung,et al.  Tensor Embedding Methods , 2006, AAAI.

[80]  Haiping Lu,et al.  Uncorrelated multilinear principal component analysis through successive variance maximization , 2008, ICML '08.

[81]  Gang Hua,et al.  Face Recognition using Discriminatively Trained Orthogonal Rank One Tensor Projections , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[82]  Rudolf Fleischer,et al.  Low-Resolution Gait Recognition , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[83]  Haiping Lu,et al.  Uncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning , 2009, IEEE Transactions on Neural Networks.

[84]  Xuelong Li,et al.  Incremental learning of weighted tensor subspace for visual tracking , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[85]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[86]  Tamir Hazan,et al.  Non-negative tensor factorization with applications to statistics and computer vision , 2005, ICML.

[87]  L. Lathauwer,et al.  Dimensionality reduction in higher-order signal processing and rank-(R1,R2,…,RN) reduction in multilinear algebra , 2004 .

[88]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[89]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[90]  Konstantinos N. Plataniotis,et al.  A Taxonomy of Emerging Multilinear Discriminant Analysis Solutions for Biometric Signal Recognition , 2010 .

[91]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[92]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[93]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[94]  M. Alex O. Vasilescu Human motion signatures: analysis, synthesis, recognition , 2002, Object recognition supported by user interaction for service robots.

[95]  Jieping Ye,et al.  GPCA: an efficient dimension reduction scheme for image compression and retrieval , 2004, KDD.

[96]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[97]  Stephen Lin,et al.  Element Rearrangement for Tensor-Based Subspace Learning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[98]  Jieping Ye,et al.  Feature Reduction via Generalized Uncorrelated Linear Discriminant Analysis , 2006, IEEE Transactions on Knowledge and Data Engineering.

[99]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[100]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[101]  Haiping Lu,et al.  Boosting Discriminant Learners for Gait Recognition Using MPCA Features , 2009, EURASIP J. Image Video Process..

[102]  Tamir Hazan,et al.  Sparse image coding using a 3D non-negative tensor factorization , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[103]  Haiping Lu,et al.  Multilinear Subspace Learning for Face and Gait Recognition , 2009 .

[104]  P. Comon Independent Component Analysis , 1992 .

[105]  Stephen Lin,et al.  Enhancing Bilinear Subspace Learning by Element Rearrangement , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[106]  Haiping Lu,et al.  Multilinear Principal Component Analysis of Tensor Objects for Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[107]  David G. Stork,et al.  Pattern Classification , 1973 .

[108]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[109]  Bülent Yener,et al.  Unsupervised Multiway Data Analysis: A Literature Survey , 2009, IEEE Transactions on Knowledge and Data Engineering.

[110]  Lu Wang,et al.  Multilinear principal component analysis for face recognition with fewer features , 2010, Neurocomputing.

[111]  Jimeng Sun,et al.  Less is More: Sparse Graph Mining with Compact Matrix Decomposition , 2008, Stat. Anal. Data Min..

[112]  John Shawe-Taylor,et al.  Decomposing the tensor kernel support vector machine for neuroscience data with structured labels , 2010, Machine Learning.

[113]  Amnon Shashua,et al.  Linear image coding for regression and classification using the tensor-rank principle , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[114]  Ahmed M. Elgammal,et al.  Towards Scalable View-Invariant Gait Recognition: Multilinear Analysis for Gait , 2005, AVBPA.

[115]  Jimeng Sun,et al.  Streaming Pattern Discovery in Multiple Time-Series , 2005, VLDB.

[116]  Haiping Lu,et al.  Uncorrelated Multilinear Discriminant Analysis With Regularization and Aggregation for Tensor Object Recognition , 2009, IEEE Transactions on Neural Networks.

[117]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[118]  Rasmus Bro,et al.  Multi-way Analysis with Applications in the Chemical Sciences , 2004 .

[119]  Haiping Lu,et al.  Visualization and clustering of crowd video content in MPCA subspace , 2010, CIKM.

[120]  Xiaofei He Incremental semi-supervised subspace learning for image retrieval , 2004, MULTIMEDIA '04.

[121]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .