A BPSO-Based Tensor Feature Selection and Parameter Optimization Algorithm for Linear Support Higher-Order Tensor Machine

Feature selection is one of the key problems in the field of pattern recognition, computer vision, and image processing. With the continuous development of machine learning, the feature dimension of the object is becoming higher and higher, which leads to the problem of dimension disaster and over fitting. Tensor as a powerful expression of high dimensional data, can be a good solution to the above problems. Considering the much redundancy information in the tensor data and the model parameter largely affects the performance of linear support higher-order tensor machine (SHTM), a BPSO-based tensor feature selection and parameter optimization algorithm for SHTM is proposed. The algorithm can obtain better generalized accuracy by searching for the optimal model parameter and feature subset simultaneously. Experiments on USF gait recognition tensor set show that compared with the ordinary tensor classification algorithm and GA-TFS algorithm, this algorithm can shorten the time of large-scale data classification, reduce about 22.06% time-consuming, and improve the classification accuracy in a certain extent.

[1]  Johan A. K. Suykens,et al.  A kernel-based framework to tensorial data analysis , 2011, Neural Networks.

[2]  Brian J. d'Auriol,et al.  A novel feature selection method based on normalized mutual information , 2011, Applied Intelligence.

[3]  Jirí Vomlel,et al.  Exploiting tensor rank-one decomposition in probabilistic inference , 2007, Kybernetika.

[4]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[5]  Yueting Zhuang,et al.  Tensor-Based Transductive Learning for Multimodality Video Semantic Concept Detection , 2009, IEEE Transactions on Multimedia.

[6]  K. Plataniotis,et al.  Color Image Processing and Applications , 2000 .

[7]  Pooran Singh Negi,et al.  3-D Discrete Shearlet Transform and Video Processing , 2012, IEEE Transactions on Image Processing.

[8]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[9]  Johan A. K. Suykens,et al.  Classification of Multichannel Signals With Cumulant-Based Kernels , 2012, IEEE Transactions on Signal Processing.

[10]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[11]  N. Ahuja,et al.  Compact representation of multidimensional data using tensor rank-one decomposition , 2004, ICPR 2004.

[12]  Xiaowei Yang,et al.  A Linear Support Higher-Order Tensor Machine for Classification , 2013, IEEE Transactions on Image Processing.

[13]  Haiping Lu,et al.  Uncorrelated Multilinear Discriminant Analysis With Regularization and Aggregation for Tensor Object Recognition , 2009, IEEE Transactions on Neural Networks.

[14]  Zhi-Hua Zhou,et al.  Face Image Modeling by Multilinear Subspace Analysis With Missing Values , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Keith C. C. Chan,et al.  Tensor-based locally maximum margin classifier for image and video classification , 2011, Comput. Vis. Image Underst..

[16]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.