An overview on feature-based classification algorithms for multivariate time series

The research on multivariate time series (MTS) has developed rapidly in the past two decades. As an important part of data mining, the classification task for MTS has gained increasing attention from experts of diverse fields. In this paper, 26 feature-based classification methods for MTS are analyzed and summarize. Since the extraction of temporal features are the core of feature-based MTS classification, these methods are mainly divided into two categories: methods with hand-crafted features and methods with learnt features. The principles and procedures of these methods are introduced, and the advantages and disadvantages are also analyzed. Besides, the recent research directions in MTS classification, such as: early classification, imbalanced classification and classification with missing value are also discussed.

[1]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[2]  Xiaoqing Weng.  Classification of multivariate time series using supervised neighborhood preserving embedding , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[3]  Mohamed F. Ghalwash,et al.  Early classification of multivariate temporal observations by extraction of interpretable shapelets , 2012, BMC Bioinformatics.

[4]  Chris H. Q. Ding,et al.  2-Dimensional Singular Value Decomposition for 2D Maps and Images , 2005, SDM.

[5]  János Abonyi,et al.  Modified Gath-Geva clustering for fuzzy segmentation of multivariate time-series , 2005, Fuzzy Sets Syst..

[6]  S. Dlugosz.  Give Missings a Chance: Combined Stochastic and Rule-Based Approach to Improve Regression Models with Mismeasured Monotonic Covariates Without Side Information , 2011 .

[7]  Xu Chen,et al.  Early prediction on imbalanced multivariate time series , 2013, CIKM.

[8]  Pierre Geurts,et al.  Segment and Combine Approach for Non-parametric Time-Series Classification , 2005, PKDD.

[9]  Eamonn J. Keogh,et al.  Searching and Mining Trillions of Time Series Subsequences under Dynamic Time Warping , 2012, KDD.

[10]  See-Kiong Ng,et al.  SPO: Structure Preserving Oversampling for Imbalanced Time Series Classification , 2011, 2011 IEEE 11th International Conference on Data Mining.

[11]  Juan José Rodríguez Diez,et al.  Support vector machines of interval-based features for time series classification , 2004, Knowl. Based Syst..

[12]  George C. Runger,et al.  Learning a symbolic representation for multivariate time series classification , 2015, Data Mining and Knowledge Discovery.

[13]  Yuan-Fang Wang,et al.  Learning a Mahalanobis Distance-Based Dynamic Time Warping Measure for Multivariate Time Series Classification , 2016, IEEE Transactions on Cybernetics.

[14]  Sahin Albayrak,et al.  Pattern recognition and classification for multivariate time series , 2011, SensorKDD '11.

[15]  Chengqi Zhang,et al.  An efficient and simple under-sampling technique for imbalanced time series classification , 2012, CIKM.

[16]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[17]  Mohamed F. Ghalwash,et al.  Early classification of multivariate time series using a hybrid HMM/SVM model , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[18]  János Abonyi,et al.  Dynamic Principal Component Analysis in Multivariate Time-Series Segmentation , 2011 .

[19]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[20]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[21]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Shan Liu,et al.  An effective multivariate time series classification approach using echo state network and adaptive differential evolution algorithm , 2016, Expert Syst. Appl..

[23]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[24]  Yi Zheng,et al.  Exploiting multi-channels deep convolutional neural networks for multivariate time series classification , 2015, Frontiers of Computer Science.

[25]  Lars Schmidt-Thieme,et al.  Fast classification of univariate and multivariate time series through shapelet discovery , 2016, Knowledge and Information Systems.

[26]  J. Koenderink.  Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[27]  Claude Sammut,et al.  Classification of Multivariate Time Series and Structured Data Using Constructive Induction , 2005, Machine Learning.

[28]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[29]  Jie Lv,et al.  Detecting novel hypermethylated genes in Breast cancer benefiting from feature selection , 2010, Comput. Biol. Medicine.

[30]  Junyi Shen,et al.  Classification of multivariate time series using locality preserving projections , 2008, Knowl. Based Syst..

[31]  Adam Zagorecki.  A versatile approach to classification of multivariate time series data , 2015, 2015 Federated Conference on Computer Science and Information Systems (FedCSIS).

[32]  Junyi Shen,et al.  Classification of multivariate time series using two-dimensional singular value decomposition , 2008, Knowl. Based Syst..

[33]  Latifur Khan,et al.  Real-time classification of variable length multi-attribute motions , 2006, Knowledge and Information Systems.

[34]  Fan Zhang,et al.  Representation Learning with Deconvolution for Multivariate Time Series Classification and Visualization , 2016, ICPCSEE.