Classification of multivariate time series using supervised neighborhood preserving embedding

Multivariate time series (MTS) are used in very broad areas such as finance, medicine, multimedia and speech recognition. Most of existing approaches for MTS classification are not designed for preserving the within-class local structure of the MTS dataset. The within-class local structure is important when a classifier is used for classification. In this paper, a new feature extraction method for MTS classification based on supervised Neighborhood Preserving Embedding (NPE) is proposed. MTS samples are projected into the PCA (principal component analysis) subspace by throwing away the smallest principal components, and then, the MTS samples in the PCA subspace are projected into a lower-dimensional space by using supervised NPE. Four different classifiers are used in our experiment. Experimental results performed on six real-world datasets demonstrate the effectiveness of our proposed approach for MTS classification.

[1]  Cyrus Shahabi,et al.  A PCA-based similarity measure for multivariate time series , 2004, MMDB '04.

[2]  Latifur Khan,et al.  Real-time classification of variable length multi-attribute motions , 2006, Knowledge and Information Systems.

[3]  Claude Sammut,et al.  Classification of Multivariate Time Series and Structured Data Using Constructive Induction , 2005, Machine Learning.

[4]  Junyi Shen,et al.  Classification of multivariate time series using two-dimensional singular value decomposition , 2008, Knowl. Based Syst..

[5]  Akira Hayashi,et al.  Embedding Time Series Data for Classification , 2005, MLDM.

[6]  S Chandrakala,et al.  Support vector regression based autoassociative models for time series classification , 2010, 2010 National Conference On Communications (NCC).

[7]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[8]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[9]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Ying Liu,et al.  C3M: A Classification Model for Multivariate Motion Time Series , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[11]  Juan José Rodríguez Diez,et al.  Support vector machines of interval-based features for time series classification , 2005, Knowl. Based Syst..

[12]  Elizabeth Ann Maharaj,et al.  Comparison and classification of stationary multivariate time series , 1999, Pattern Recognit..

[13]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[14]  Pierre Geurts,et al.  Segment and Combine Approach for Non-parametric Time-Series Classification , 2005, PKDD.

[15]  Latifur Khan,et al.  Feature Selection for Classification of Variable Length Multiattribute Motions , 2007 .

[16]  Qingshan Jiang,et al.  A New Metric for Classification of Multivariate Time Series , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[17]  Junyi Shen,et al.  Classification of multivariate time series using locality preserving projections , 2008, Knowl. Based Syst..

[18]  Carlo Vercellis,et al.  Combining discrete SVM and fixed cardinality warping distances for multivariate time series classification , 2010, Pattern Recognit..

[19]  Cyrus Shahabi,et al.  CL eVer: A Feature Subset Selection Technique for Multivariate Time Series , 2005, PAKDD.